Monitoring and

Evaluation
Frameworks
Learning Objectives
At the end of the session, participants will be able to:
• Identify and differentiate between conceptual
frameworks, results and logical frameworks,
and logic models
• Design goals and objectives for specific intervention
programs
• Design frameworks for specific intervention programs
• Discuss how frameworks are used for M&E planning
Module Outline
• Review components of an M&E Plan
• Introduction to frameworks
– Conceptual Frameworks
– Goals and objectives
– Results and Logical Frameworks
– Logic models
• Exercises developing frameworks
• Interface between frameworks and M&E planning
• Work on group project
Why are frameworks useful?
Designing frameworks assists to develop:
• Clearly understood program/project goals and measurable,
long-term, short-term, and intermediate objectives
• Clearly defined relationships between program/project
inputs, processes, outputs, and outcomes, and between
program/project activities
and the external context (environmental factors)
• Sound implementation and M&E plans
Types of Frameworks
• Conceptual Frameworks
• Results Frameworks
• Logical Frameworks
• Logic Models
Conceptual Frameworks
(aka. research or theoretical frameworks)

Diagram that identifies and illustrates the relationships between all relevant
systemic, organizational, individual, or other salient factors that may influence
program/project operation and the successful achievement of program or project
goals.

M&E Purpose:
• To show where program fits into wider context
• To clarify assumptions about causal relationships
• To show how program components will operate to influence outcomes
• To guide identification of indicators
• To guide impact analysis (causal pathways)

Similar frameworks:
• Proximate Determinants
Conceptual Frameworks
Individual
characteristics
Healthy Health
Service practices status
utilization

Institutional Program
Program supply
capacity sustainability

Technical
inputs
Conceptual Frameworks
National Tuberculosis (TB) Program
External Factors
• Demographic: TB infection
(age, gender)
• Socio-economic:
(education, occupation) Health Systems
• Environmental: (DOTS) TB Morbidity
(war, weather) • Availability • Prevalence
• Access • Incidence
• Utilization TB
• HIV co-infection
•Case Detection • MDR-TB mortality

Program Factors
• Political commitment Co-morbidity
TB Knowledge • HIV
• Donor involvement • Stigma
• Malnutrition
• National TB program • Treatable
• Alcoholism
• Symptoms
•Diabetes
Source: MEASURE Evaluation 2004 (draft)
Conceptual Frameworks
Causes of malnutrition in society
Child malnutrition,
Outcomes
death and disability

Inadequate Disease Immediate

dietary intake causes

Underlying
Insufficient Inadequate Poor water/sanitation causes at
access to food maternal & child & inadequate health household/
care practices services family level

Quantity & quality of actual

resources - human, economic and
Basic
organizational – and the way they
causes at
are controlled
societal
level
Potential Resources:
environment, technology, people
Source: UNICEF, State of the World’s Children, 1998
Goals and Objectives
• Goal: a broad statement of a desired, long-term
outcome of the program
• Objectives: statements of desired, specific, realistic
and measurable program results
 SMART
• Specific: identifies concrete events or actions that will take place
• Measurable: quantifies the amount of resources, activity, or change
to be expended and achieved
• Appropriate: logically relates to the overall problem statement and desired
effects of the program
• Realistic: Provides a realistic dimension that can be achieved
with the available resources and plans for implementation
• Time-based: specifies a time within which the objective
will be achieved

Source: GAP 2003

Goals and Objectives
National AIDS Committee (NAC) 2005 Strategic Plan
• Goal: Prevent the spread of HIV epidemic and
minimise its impact on nation by 2009
• Objective 1: Reduction of HIV prevalence in nation
• Objective 2: Improved health & quality of life of
people infected & affected by HIV/AIDS
• Objective 3: Strengthened capacity of NAC &
stakeholders to respond to the HIV/AIDS epidemic
at all levels through improved research, M&E and
improved management & coordination
Goals and Objectives: Activity
Child malnutrition,
death and disability Outcomes

Inadequate Disease Immediate

dietary intake causes

Underlying
Insufficient Inadequate Poor water/sanitation
causes at
access to food maternal & child & inadequate health
household/
care practices services
family level

Quantity & quality of actual

resources - human, economic and
organizational – and the way they Basic
are controlled causes at
societal
level
Potential Resources:
environment, technology, people
Source: UNICEF, State of the World’s Children, 1998
Results Frameworks
Diagrams that identify steps or levels of results and illustrate the
causal relationships linking all levels of a program’s objectives.
Purposes:
• Provides a clarified focus on the causal relationships that
connect incremental achievement of results to the
comprehensive program impact
• Clarifies project/program mechanics and factors’ relationships
that suggest ways and means of objectively measuring the
achievement of desired ends
Other terms used:
• Strategic frameworks
 Results Frameworks
Goal: Improved Health Status
and/or Decreased Fertility

Objective: Improved Use of Health/FP Services

and/or Appropriate Practices

IR1: Access/Availability IR2: Quality IR3: Sustainability IR4: Demand

IR1.1:Commodities/Facilities IR2.2: Provider Performance IR3.1: Policy IR4.1: Attitude

IR1.2: Equity IR2.3: Training/Supervision IR3.2: Health Care Finance IR4.2: Knowledge

IR2.4: Information System IR3.3: Private Sector IR4.3: Community Support

Source: David Marsh, 1999

Results Frameworks
Tuberculosis (TB) Control Programs

SO1: Increase tuberculosis case detection rate to 70%

IR1: Increased availability IR2: Increased demand

of quality services for quality services

IR1.1: Services increased IR2.1: Customer

knowledge of TB improved

IR1.2: Practitioners’ skills

and knowledge increased IR2.2: Social support for
TB practices increased

IR1.3: Improved
program management
Source: MEASURE Evaluation, 2004 (draft)
Results Frameworks
Donor/USAID Reproductive Health Program

SO1: Increased Utilization of Family Planning/Reproductive Health Services

IR1 Strengthened sustainability IR2 Expansion of high quality FP/RH

of FP/RH Program services in the public and private sectors

IR1.1 Improved policy IR2.1 Increased availability of

environment for the provision postpartum and postabortion FP services
of FP/RH services in the public
and private sectors IR2.2 Increased accurate knowledge
of clients about modern methods
and FP services
IR1.2 Strengthened NGO
advocacy for FP program
IR2.3 Improved job performance of
health providers, trainers, and administrators

Source: USAID/Turkey Performance Monitoring Plan, 1998-2001

Results Frameworks
FIVE-YEAR GOAL: Foundation Established for
Reducing Famine Vulnerability, Hunger and Poverty

SO 14: Human capacity and social resiliency increased

IR 14.1: Use of high impact health, IR 14.2: HIV/AIDS prevalence IR 14.3: Use of quality primary
family planning, and nutrition services, reduced and mitigation of the education services enhanced
products, and practices increased impact of HIV/AIDS increased

IR 14.1.1: Community support
for high impact health
interventions increased
IR 14.1.2: Availability of key
health services and products
improved
IR 14.1.3: Quality of key
health services improved
IR 14.1.4: Health sector
resources and systems
improved
IR 14.2.1: Reduced risk behavior
IR 14.2.2: Mother-to-child
transmission of HIV reduced
IR 14.2.3: Access to care and
treatment for people living with
HIV and AIDS increased
IR 14.2.4: Care and support for
orphans and vulnerable children
expanded
IR 14.2.5: A more supportive
environment for responding to
HIV/AIDS
IR 14.3.1: Community
participation in the management
and delivery of primary education
services strengthened
IR 14.3.2: Planning, mgmt and
monitoring and evaluation for
delivery of primary education
services strengthened
IR 14.3.3: Quality of primary
education improved
IR 14.3.4: Equitable primary
education services strengthened

Source: USAID/Ethiopia Integrated Strategic Plan, February, 2004 (revised draft)

Logical Frameworks
Present a standardized summary of the project and its logic.
Purposes:
• Summarizes what the project intends to do and how
• Summarizes key assumptions
• Summarizes outputs and outcomes that will be monitored
and evaluated
Other terms used:
• Logframe matrix
Logical Frameworks
Means of
Project Description Performance Indicators Verification Assumptions
Goal: The broader Measures of the extent to Sources of
development impact to which which a sustainable information and
the project contributes - at a contribution to the goal has methods used to
national and sectoral level. been made. Used during collect and report it.
evaluation.
Purpose: The development Conditions at the end of the Sources of Assumptions
outcome expected at the end project indicating that the information and concerning the
of the project. All Purpose has been achieved and methods used to purpose/goal
components will contribute to that benefits are sustainable. collect and report it. linkage.
this Used for project completion
and evaluation.

Component Objectives: The Measures of the extent to Sources of Assumptions

expected outcome of which component objectives information and concerning the
producing each component's have been achieved and lead to methods used to component
outputs. sustainable benefits. Used collect and report it. objective/purpose
during review and evaluation. linkage.
Outputs: The direct Measures of the quantity and Sources of Assumptions
measurable results (goods quality of outputs and the information and concerning the
and services) of the project timing of their delivery. Used methods used to output/component
which are largely under during monitoring and review. collect and report it. objective linkage.
project management's control
Activities: The tasks carried Implementation/work program Sources of Assumptions
out to implement the project targets. Used during information and concerning the
and deliver the identified monitoring. methods used to activity/output
outputs. collect and report it. linkage.
 Logical Frameworks
Taskforce on Communicable Disease Control
in the Region X: Tuberculosis
GOAL PERFORMANCE MEANS OF  ASSUMPTIONS
INDICATORS VERIFICATION  
A. Reduced A. Notification rate A. Annual notification - A dual HIV/TB epidemic
burden of TB reports (surveillance) causing increase in TB
to reach incidence does not occur
global average - Control of private
levels practitioner and
B. Further pharmaceutical sectors to
development prevent MDR
of multi-drug B-1. Treatment B-1. Annual reports on
outcome of treatment - Prevalence of resistance to
resistant TB outcome second line anti-TB drugs
(MDR-TB) (cohort analysis)
B-2. Prevalence of low enough at the outset so
prevented Multi-drug B-2. Periodic reports on as not to seriously
  Resistance in “new” surveillance of anti- compromise treatment
and previously TB drug resistance success ratio
treated TB patients  
 Logical Frameworks

Taskforce on Communicable Disease Control

in the Barents and Baltic Sea Regions: Tuberculosis
PURPOSE PERFORMANCE MEANS OF ASSUMPTIONS
  INDICATORS   VERIFICATION  
[Implementing] 1. Coverage of TB programmes 1. Annual reports - Stable political situation,
cost-effective in line with international sustained political commitment
2. Annual reports
measures for the recommendations. and financing
3. National / local
prevention and 2. Proportion of patients annual - Sufficient numbers of
control of TB defaulting out of patients competent health care personnel
notification
operating within treated. reports in the government sector
civil and 3. Proportion of previously (surveillance)
penitentiary treated cases among all
health services 4. Annual record
cases.
in the Task reviews during
4. Proportion of patients on site visits
Force area
ambulatory treatment out (consecutive
of all patients treated. series of
patients)
Logical Frameworks
Taskforce on Communicable Disease Control
in the Barents and Baltic Sea Regions: Tuberculosis
(only one output and related activities shown here)
OUTPUTS PERFORMANCE MEANS OF ASSUMPTIONS
  INDICATORS   VERIFICATION  
  1. Relevant persons
8.1. Number of motivated to participate
8. Measures to increase pamphlets / 8.1. Material produced /
awareness of TB and its posters printed distributed 2. Professional interest,
treatment among all and distributed sufficient financing
members of the community annually 3. Target groups
8.2. KAP or other
developed and tested 8.2. Awareness of TB surveys (before/after) interested in (their)
among target health and able to
groups participate

 ACTIVITIES  INPUTS MEANS OF ASSUMPTIONS

    VERIFICATION
8.1 Identify groups at risk for  
TB Financial management
8.2 Develop advocacy material reports
suitable for all target groups
(not only risk groups)
8.3 Organize health education
directed at all target groups
8.4 Involve the mass media
Logic Models
Diagrams that identify and illustrate the linear relationships flowing
from program inputs, processes, outputs, and outcomes. Inputs or
resources affect Processes or activities which produce
immediateresults or Outputs, ultimately leading to longer term or
broader results, or Outcomes.
Purposes:
• Provides a streamlined interpretation of planned use of
resources and desired ends
• Clarifies project/program assumptions about linear
relationships between key factors relevant to desired ends
Other terms used:
• M&E Frameworks, Logical Frameworks
 Logic Models: Training

INPUT PROCESS OUTPUT OUTCOME IMPACT

Develop Conduct Practitioners Increase in Declining

clinical training trained in new clients served morbidity
training events clinical by (newly) levels in target
curriculum techniques trained population
providers
Logic Models
Voluntary Counseling and Testing (VCT)
Problem Statement: HIV infection rates continue to rise, underscoring the importance for people to
know their serostatus, develop personalized risk-reduction strategies, and access care and treatment services.

INPUTS PROCESSES OUTPUTS OUTCOMES IMPACTS

Financial Supervision and Clients (HIV+ Risk

Resources training for and -) develop behaviors HIV
VCT personnel People & adhere to decreased transmissi
Demand for know their personalized on rates
Services Provide pre-test HIV status HIV risk- decreased
counseling reduction Increase in
Infrastructure care,
Provide HIV testing HIV+ Clients prevention, and
VCT MIS** HIV+ develop & treatment HIV
people are adhere to services for incidence
VCT protocols, Provide post-test referred to personalized HIV+, HIV-, decreased
guidelines, and counseling appropriate HIV care, and discordant
training services support, and couples
documents** Refer HIV+ clients treatment plans
to appropriate
Counseling services (PMTCT, Health HIV
and Testing care and support, outcomes of morbidity
Client Continuity of &
Personnel* treatment) HIV +
records are care is mortality
improve
HIV test kits available available decreased
Maintain patient
records
Referral Service Program and
system for Complete reports are services are
prevention & reporting produced improved
Tx services** requirements
Results Framework
Tuberculosis (TB) Control Programs
SO1: Increase tuberculosis case detection rate to 70%

IR1: Increased availability IR2: Increased demand

of quality services for quality services

IR1.1: Services increased IR2.1: Customer

knowledge of TB improved

IR1.2: Practitioners’ skills

and knowledge increased IR2.2: Social support for
TB practices increased

IR1.3: Improved
program management
Source: MEASURE Evaluation, 2004 (draft)
 Logic Model
Portion of model for tuberculosis control relating
to increasing demand for quality services

INPUT PROCESS OUTPUT OUTCOME IMPACT

•Human and •Distribute •Brochure •Increased •Decreased TB
financial brochure to distributed to customer infection,
resources to health clients of knowledge of morbidity and
develop and facilities facilities TB transmission mortality
print and treatment
•Meet with
educational
physicians to •Increased
brochure
promote demand for
distribution of quality TB
brochure services
Frameworks for M&E Planning
• Purposes:
– clarifying assumptions, goals, and interrelationships
between factors relevant to the project or program
– defining objectives
– selecting activities
– defining levels of performance and desired results in terms
of planned activities and realistic, objective impacts
• Monitoring and evaluation plans incorporate:
– program managers’ assumptions and objectives, in a given
context
– a schematic design displaying the directional linkages
between key program elements and/or planned results, and
other relevant factors
 Summary of Frameworks
Type of Brief Description Program Basis for Monitoring
Framework Management and Evaluation
Conceptual Interaction of various Determine which factors No. Can help to explain
factors the program will influence results

Results Logically linked program Shows the causal Yes – at the objective level
objectives relationship between
program objectives
Logical Logically linked program Shows the causal Yes – at the output and
objectives, outputs, and relationship between objective level
activities activities and objectives
Logic model Logically links inputs, Shows the causal Yes – at all stages of the
processes, outputs, and relationship between program from inputs to
outcomes, inputs and the objectives process to outputs to
outcomes/ objectives
References
• AusGuide. The Logical Framework Approach.
http://www.ausaid.gov.au/ausguide/ausguidelines/1-1-1.cfm
• Bertrand, Jane T., Magnani, Robert J, and Rutenberg, Naomi, 1996.
Evaluating Family Planning Programs, with Adaptations for Reproductive
Health, Chapel Hill, N.C.: The EVALUATION Project.
• Global AIDS Program. (2003) Monitoring and Evaluation Capacity Building
for Program Improvement Field Guide, Version 1. U.S. Centers for Disease
Control and Prevention, Atlanta, GA.
• Marsh, David. 1999. Results Frameworks & Performance Monitoring. A
Refresher by David Marsh (ppt)
http://www.childsurvival.com/tools/Marsh/sld001.htm
• Tsui, Amy. 1998. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
• Tsui, Amy. 1999. Frameworks (ppt). Presented at the Summer Institute,
University of North Carolina, Chapel Hill.
• UNICEF. 1998. State of the World’s Children.