Professional Documents
Culture Documents
Evaluation Research
Evaluation Research
Evaluation Research
Research
Kodi D. Havins
AED 615
Fall 2006
Dr. Franklin
Evaluation Research
• Definitions:
– “Evaluationis the systematic
assessment of the worth or merit
of some object”
– “Evaluation is the systematic
acquisition and assessment of
information to provide useful
feedback about some object”
(Trochim, 2006)
Evaluation Research
• Basically is used to provide feedback on an
event, organization, program, policy, technology,
person, activity, etc.
– All of these are called “object(s)”
• It assesses information about the “object”
• Used heavily in social sciences and government
agencies
• Usually outcomes influence
decision-making process
Research Designs
• 4 Major Types:
1. Survey Research
2. Case Study
3. Field Experiment
4. Secondary Data Analysis
(Garson, n.d.)
Procedures
• 4 Strategies:
1. Scientific-Experimental Models
2. Management-Oriented Systems
Models
3. Qualitative/Anthropological Models
4. Participant-Oriented Models
(Trochim, 2006)
1. Scientific-Experimental
Models
• Take values and methods from the
sciences (especially social sciences)
• Prioritize on the desirability of
impartiality, accuracy, objectivity, and
validity of the information generated
(Trochim, 2006)
1. Scientific-Experimental
Models
• Examples:
Tradition of experimental and quasi-
experimental designs
Objectives-based research that comes
from education
Econometrically-oriented perspectives
including cost-effectiveness and cost-
benefit analysis
Recent articulation of theory-driven
evaluation
(Trochim, 2006)
2. Management-Oriented
Systems
• 2 of the most common:
– Program Evaluation and Review Technique
(PERT)
– Critical Path Method (CPM)
(Trochim, 2006)
2. Management-Oriented
Systems
Examples:
• Framework (“Logframe”) Model
– Used widely by U.S. Agency for
International Development
(Trochim, 2006)
3. Qualitative/Anthropological
Models
• Emphasis on:
– The importance of observation
– The need to retain the phenomenological
quality of the evaluation context
– The value of subjective human
interpretation in the evaluation process
(Trochim, 2006)
3. Qualitative/Anthropological
Models
Examples:
– The approaches known in evaluation as
naturalistic or “Fourth Generation”
Evaluation
– The various qualitative schools
– Critical Theory and art criticism approaches
– The “Grounded Theory” approaches of
Glaser and Strauss
(Trochim, 2006)
4. Participant-Oriented Models
Examples:
– Client-Centered Research
– Stakeholder Approaches
– Consumer-Oriented Research
(Trochim, 2006)
So, how do you decide
which one to use???
Things to keep in mind:
• 2 Important Types:
1. Formative Evaluation
2. Summative Evaluation
(Trochim, 2006)
1. Formative Evaluation
• Purpose:
– To strengthen or improve the
object being evaluated
(Trochim, 2006)
• Purpose:
– To examine the effects or
outcomes of some object
(Trochim, 2006)
Retrieved from:
Journal of Agriculture Education
http://pubs.aged.tamu.edu/jae/search/defa
ult.asp
Purpose of Study
Top 5 Studies:
• 75 Secondary Agriculture Programs
Studies
• 70 Styles/Theory and Cognition Studies
• 43 Professionalism Studies
• 42 Extension Studies
• 38 Agriculture Mechanics/Safety Studies
Conclusions of Study