Topic 18B - Formulating the Monitoring and Evaluation

Plan
Results-based Evaluation

● Results-based evaluation is a periodic assessment of the design, implementation

and results of an ongoing, or completed intervention to determine its relevance,
efficiency, effectiveness, impact, and/or sustainability.

Why We Do Evaluation?

● To determine if projects are meeting the intended objectives and desired results
● To build greater transparency and accountability in terms of the use of project
resources
● To provide management with a clear basis for decision making
● To improve planning and design of projects using lessons learned from project
experiences.

Results-Based Evaluation: Basic Steps

Types and Purpose of Evaluation

Ex-ante Evaluation - Examines the validity of the contents of project plans

Mid-term Evaluation - Examines whether the project is producing effects at mid-term

Terminal Evaluation - Examines whether the project is producing effects at completion

Ex-post Evaluation - Examines whether expected impact is generated years after project termination
Grasping the Logic of Intervention

Grasping the Results Framework

Preparing the Evaluation Plan
Steps

1
Determine evaluation items (What are the major items to be assessed?)
.

2
Develop evaluation questions (What to know through the evaluation?)
.

3
Determine necessary data (What specific data need to be collected?)
.

4
Identify data sources (Where can the data be obtained?)
.
Evaluation Plan
5
Select data collection method (How to collect the data?)
.
Data
Main Data Data
Evaluation questions collection
items of evaluation needed sources
(main & sub) method

Major Evaluation Items (Criteria)

1. Evaluation of Project Performance

2. Evaluation of Implementation Process
 3. Evaluation of Five DAC-OECD Evaluation Criteria

RF and its Links to 5 Evaluation Criteria

Formulating Evaluation Questions

Key Questions for Ex-ante Evaluation

● Is the project relevant to donor/GOP goals?

● Are the outcomes likely to be produced?
● Is the cost justifiable?
● Are the outcomes likely to be sustained in the future?
● Is the project design valid?

Key Questions for Mid-term Evaluation

● Can we continue the project as designed?

● Can we expect the outcomes as the result of project intervention?
● Should we change the project strategy and activities?
● Is the project design still relevant?
● Are Outputs being delivered?
● Is the project cost-efficient?
● Is sustainability to be expected?
● Are there any internal/external barriers so far?
● Is the project design still relevant?
● Are Outputs being delivered?

Key Questions for Terminal Evaluation

● Are outcomes being observed? If not, why?

● Are outcomes the result of Outputs & Activities?
 ● Are outcomes/impact sustainable? If not why?
● Is the project cost effective to achieve these results?
● How to ensure sustainability?
● What are the lessons learned for future strategy and project formulation?

Key Questions for Ex-post Evaluation

● Is there any impact observed? Is so, can this be attributed to the project?
● What are the promoting/hindering factors?
● Are the impacts likely to be sustained?
● How can sustainability be ensured?
● What are the lessons learned for future strategy and project formulation?

DAC’s Five Evaluation Criteria

Relevance - Consistency of project objectives with development needs and priorities
Efficiency - Efficiency of converting inputs into outputs during project implementation
Effectiveness - Degree by which Project Outcome is achieved through the Outputs
- Positive or negative changes produced, directly or indirectly, intended or unintended, as
Impact
a result of the project
Sustainabilit - Continuity of the benefits or effects of the project after donor funding or technical
y assistance has been withdrawn.

Evaluation Questions and 5 Criteria

Evaluation Plan – RSP
Assessment
Key points to remember

● A monitoring and evaluation plans builds on the program logic and basically outlines
what you will collect, when and by whom it is to be collected, what question the
information will answer, and the audience you are reporting to.
● Developing a monitoring and evaluation plan should be undertaken as part of your
project planning process.
● Designing the evaluation plan should involve the participation of key stakeholders of
a program.