TE PIMS 3280 BRA BrazilianMangroves TE Report Annex 6 EvaluationMatrix

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

Annex 6.

Evaluation Matrix

Evaluation Questions Indicator Means of verification Methodology


criterion/
dimension
Are the project assumptions
valid?
Project assumptions are
Were all the risks to the project
confirmed by peer reviewed Peer reviewed literature,
strategy properly considered?
literature, government policy government policy documents Document analysis
Do the proposed sequence of
documents and other relevant and other relevant literature
activities and deliverables lead to
literature
the hypothesized outcomes and
Project strategy impacts (given the time and
and resources constraints?
formulation Have lessons learned from other Individual semi-structured
similar initiatives been Assessment by key project interview and/or Focus group
Key project stakeholders
incorporated into the project stakeholders discussion (FDG)
design?

Was the project prompted by Project concept and idea can be Government policy documents Document analysis
national assessments or policies traced back to government Individual semi-structured
Key project stakeholders
or at national initiative? policy and initiative interview and/or FDG
Evaluation Questions Indicator Means of verification Methodology
criterion/
dimension
Documented changes effected in
Project Did the project cope with the project document/ work
Project reports and minutes of
implementation challenges, risks and socio- plans/ management Document analysis
meetings
& adaptive political changes during the arrangements in response to
challenges
management. project implementation?
Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Did the project management Degree to which relevant groups Project reports and minutes of
structures or local participatory were included in the project meetings
Document analysis
Partnership venues/ groups include all management structures or Government, NGO and private
agreements groups/ organizations affected participatory venues/ groups sectors papers and reports
by the project or with capacity to Assessment by key project Individual semi-structured
Key project stakeholders
affect the project? stakeholders interview and/or FDG
Logframe indicators have SMART
Project logical framework Document analysis
Did the logframe indicators characteristics
comply with SMART criteria? Assessment by implementing, by implementing, executing Individual semi-structured
executing agency and PMU agency and PMU interview and/or FDG
minutes of steering/ technical
M&E system committee meetings,
documented modifications of
Did the M&E system guide Degree to which the M&E system
work plans and project Document analysis
project implementation? guided project implementation
document based on monitoring
results, and project management
of the midterm review 

Evaluation Questions Indicator Means of verification Methodology
criterion/
dimension
PMU quantified and documented
Project and audit reports Document analysis
Was committed co-finance committed co-funds
delivered as committed? Individual semi-structured
Assessment by co-financiers Co-financiers
interview and/or FDG
Co-finance Project and co-financier’s reports
Did the project and its
reflect coordination and Project and co-financiers reports Document analysis
implementing/ executing
mutually acknowledge results
agencies coordinate with co-
Individual semi-structured
financers projects and initiatives? Assessment by co-financiers Co-financiers
interview and/or FDG
Concordance between yearly
Was disbursement and
budgets and expenditure and Work plans and combined
expenditure effected in a timely
delivery reports (CDR)
and transparent manner? delivery schedule) and if

Financial Were reporting and Document analysis


execution
accountability lines clear and in
compliance with UNDP and External audit reports reveal
External audit reports
compliance with actions required
national rules (as shown in)
Evaluation Questions Indicator Means of verification Methodology
criterion/
dimension
Reports are honest and truthfully
reveal project progress and PIRs Document analysis
Did implementing and executing shortcomings
agency provide the necessary Assessment by key project Individual semi-structured
Key project stakeholders
Agency resources and technical and stakeholders interview and/or FDG
performance administrative support for the Work plans concord with the
Project work plans Document analysis
implementation of the project? project’s logical framework
Key stakeholders aware of
Individual semi-structured
project objectives, outcomes, Key project stakeholders
interview and/or FDG
outputs and actions
Agreement between project
Did the project support national, objective and outcomes with Policy documents Document analysis
subnational or local, formal or policy objective
informal policy objectives? Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Relevance
Agreement between project
Was the project framed within objective and outcomes with GEF Policy documents Document analysis
GEF biodiversity strategy, UNDP’s 4, CPD and UNDAF
CPD and UNDAF? Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Project reports, grey literature,
Logical framework indicators Document analysis
Did the project achieved its peer reviewed literature
Effectiveness
expected targets? Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Project reports, grey literature,
Efficiency Was the project cost-effective? Positive cost-benefit analysis Document analysis
peer reviewed literature
Evaluation Questions Indicator Means of verification Methodology
criterion/
dimension
Number and distribution of
Project reports, grey literature,
threatened species associated Document analysis
peer reviewed literature
Did the project cause changes in with mangroves
drivers of ecological status? Project reports, grey literature,
Changes in area covered by
peer reviewed literature, maps, Document analysis
mangroves
aerial or satellite imagery
Changes in average monthly
Impact Project reports, grey literature,
Has the project caused changes household income or Document analysis
peer reviewed literature
in the socio-economic status of consumption
intended beneficiaries? Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Has the project caused Individual semi-structured
Assessment by key project
behavioral or value changes of Key project stakeholders interview and/or FDG
stakeholders
key stakeholders? Structured observation
Project reports, grey literature,
Status and trends of public Document analysis
peer reviewed literature
budgets and expenditure on
Individual semi-structured
mangrove protected areas Key project stakeholders
Are there any financial risks to interview and/or FDG
Sustainability
project sustainability? Project reports, grey literature,
Document analysis
Status and trends of the peer reviewed literature
protected area financial gap Individual semi-structured
Key project stakeholders
interview and/or FDG
Evaluation Questions Indicator Means of verification Methodology
criterion/
dimension
Degree to which project Individual semi-structured
Key project stakeholders
interview and/or FDG
stakeholders see that it is in their
Are there any socio-economic interest that project benefits
risks to project sustainability? Policy documents produced by
continue to flow Document analysis
project stakeholders

The current or foreseeable policy


Project reports, policy and legal
and regulatory framework
documents, grey literature, peer Document analysis
Sustainability Are there institutional risks to sustain project-developed
reviewed literature
project sustainability? mechanisms
Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG
Threatened species associated
with mangroves have the Project reports, grey literature,
Document analysis
Are there environmental risks to capacity to recover at the peer reviewed literature
project sustainability? current threat level
Assessment by key project Individual semi-structured
Key project stakeholders
stakeholders interview and/or FDG

You might also like