IVEN Final Evaluation Report en Final 18 April 2016

IMPROVING VOICE THROUGH EFFECTIVE NETWORKS
(IVEN) PROJECT
Project Final Evaluation Report
Hanoi, March 2016
Acronyms
CCIHP
Center for Creative Initiatives in Health and Population
CEMA
Committee for Ethnic Minority Affairs
DECEN
Cao Bang Community Development Centre
EM
Ethnic Minority
GoV
Government of Vietnam
IVEN
Improving voice through effective network
NGO
Non-Government Organization
NorthNet
Network of Northern Mountainous Civil Society Organizations for

Sustainable Community Development in Vietnam
PAHE
Partnership for Action in Health Equity Network
WU
Women Union
CSO
Civil Society Organization
EM
Ethnic Minority
EMW
Ethnic Minority Women
EMWG
Ethnic Minority Working Group
NA
National Assembly
PC
People Committee
PCC
People Council
SED
Socio-Economic Development
SEDP
Socio-Economic Development Plan
TOR
Terms of Reference
WU
Womens Union
Table of Content
Acronyms ......................................................................................................................................... i
Table of Content.............................................................................................................................. ii
Table and Figures ........................................................................................................................... iii
Acknowledgement ......................................................................................................................... iv
Executive Summary ......................................................................................................................... v
1.
Introduction ............................................................................................................................. 1
2.
Project background .................................................................................................................. 1
3.
Evaluation objective ................................................................................................................. 3
4.
Evaluation methodology .......................................................................................................... 4
5.
Major findings .......................................................................................................................... 6

5.1. Relevance.......................................................................................................................................... 6
5.2. Effectiveness ..................................................................................................................................... 8
5.3. Efficiency ..........................................................................................................................................23
5.4. Impact..............................................................................................................................................23
5.5. Sustainability....................................................................................................................................24
5.6. Project approach and methodology ..................................................................................................24
6.
Lessons learnt ........................................................................................................................ 25
7.
Recommendations and conclusions ....................................................................................... 25
8.
Annexes ................................................................................................................................. 27
Annex 1: Project Achievements against target indicators .............................................................. 27

Annex 2: List of participants participated in the Evaluation ........................................................... 34
Annex 3: Evaluation Process, Methodologies and Tools ................................................................ 37
ii
Table and Figures
Figure 1: IVEN project desired ..................................................................................................... 3

Figure 2: Summary of Analytical framework ................................................................................ 5
Figure 3: Local Government, People Councils and People Power relationships ......................... 8
Figure 4: EM forum model in Bao Lac ........................................................................................ 18
Figure 5: Health Equity model in Que Phong ............................................................................. 19
Table 1: Key questions for the Evaluation .................................................................................... 4

Table 2: Key achievements of Results 1 ....................................................................................... 9
Table 3: Key achievements of Results 2 ..................................................................................... 13
Table 4: Key achievements of Results 3 ..................................................................................... 15
Table 5: Key achievements of Results 4 for both Bao Lac and Que Phong Models ..................... 16
Table 6: Key Achievement of the Overall Objective ................................................................... 22
Table 7: Key Achievement of the Overall Objective ................................................................... 21
Table 8: Financial efficiency Financial Input per deliver outputs ............................................. 23
iii
Acknowledgement
CARE International in Viet Nam would like to express sincerely thanks to the technical consultancy
of Mr. Nguyen Van Anh, who has successfully taken project end-evaluation of Improving Voice
through Effective Networks (IVEN). CARE International in Viet Nam also made it recognition of its
staffs great contribution and actively participation in all process of the research, including
technical inputs to the development of evaluation methodologies and tools, logistic arrangements
for the evaluation in the fields, and technical inputs to the development and finalization of the
project evaluation report.
The CARE International in Viet Nam would like to express its gratitude for the kind supports and
donation from European Union (EU) that has been made remarkable changes of most vulnerable
populations livelihood in the context of strengthen institutional capacity of local NGOs, ensuring
poverty reduction and health equity for ethnic minorities through strategic policy dialogue. CARE
International in Vietnam would express sincerest appreciation and thanks to CARE Denmark for
their great coordination, technical support contributes to the success of the project. Sincere
thanks are expressed by CARE International in Viet Nam to each and every all local people,
families, including women and male villagers, service providers, commune/village leaders in Bao
Lac district (Cao Bang province) and Que Phong district (Nghe An province), who enthusiastically
participated and shared their ideas, experiences and views during implementation and evaluation
of IVEN Project.
Most importantly, CARE International in Viet Nam hopes that this IVEN project end-evaluation
report and its advocacy products will be a useful reference documents for relevant government
agencies, localities, partners and stakeholders to improve the voice of ethnic minority people
through effective institutional capacity of local NGOs (including North net and PAHE) and ensuring
the poverty reduction and health equity for ethnic minorities through strategic policy dialogue and
implementation.
iv
Executive Summary
To contribute to a representative and capable civil society that influences policy and practice for
the benefit of poor, remote ethnic minorities in Vietnam, CARE has worked in partnership with
Center for Creative Initiatives in Health and Population (CCIHP) and Cao Bang Community
Development Centre (DECEN) to implement the Project Improving voice through effective
network (IVEN) from March 2013 to February 2016. The project focus on strengthening
institutional capacity of Health Equity Network (PAHE) and Northern Mountainous Civil Society
Organizations for Sustainable Community Development in Vietnam Network (NorthNet). Two
small-scale demonstration models for improving local governance and participation of ethnic
minorities in decision making in Bao Lac district, Cao Bang province in Que Phong district, Nghe An
province were implemented. A final evaluation of IVEN Project was conducted in March 2016 to
assess achievements against project objectives, outcomes and capture lessons learned. Results of
this evaluation are summarized as below.
Relevance
IVEN project is extremely relevant to EU strategy and programs focuses including the European
Commission Communication Strategy and CSO Road Map, in terms of strengthening institutional
capacity of NorthNet and PAHE networks of CSOs, supporting their advocacy/dialogue with local
and national authorities, building their capacities for improved health service delivery and
promoting voice of people in poverty reduction to the most vulnerable and marginalized groups,
poor EM communities and EM women.
The project is very relevant to Vietnam poverty reduction context as EMs still are among the most
disadvantaged, have low voice/low level of participation in Vietnam. The project is relevant to the
needs of NorthNet and PAHE, local authorities, government public health services and local EM
people.
Positive changes in right-holders and duty-bearers confirmed that Rights Based Approach (RBA) as
well as other methodologies applied by the project are relevant to local context and can create
positive impact in both long terms and short terms.
Effectiveness
Overall assessment is that the project was implemented successfully, achieved most their target
outputs and outcomes (19/24 targets fully achieved and 5/24 to be achieved). Great
improvements were made by the IVEN project to the capacity of the networks. In the area of
internal governance systems, the IVEN project was assessed by the two network members to have
left a good impact on network internal systems capacity, and created a solid foundation for further
development of the two networks. Significant increase in capacity of the two networks to more
effectively function as unified networks with a shared vision, planning and coordination
mechanism in place with better representation of their network members. All internal governance
regulations such as sharing and learning, decision-making, internal and external communications
are available and with strong commitments of the members to follow. Most of interviewed
NorthNet and PAHE members were satisfied with the representation of their views.
Relating to specific capacity of the network members, the project have been a great help for the
staff of the two network members to understand the considerable benefits of networking such as
working closely together for greater effectiveness, to be able to identify common interests and
priority issues, and better represent marginalised EMs. Significant increases in capacity of
networks member staff has been obtained, including better access to information needed for
their organization development; research capacity; networking, policy analysis and advocacy
planning capacity; methodology to work with EM and promoting EMs participation and proposal
writing. However, capacity of NorthNet is still limited in areas of strategic information sharing.
Learning processes so far among NorthNet members depended on level of active from individual
members to learn by themselves, because the learning and sharing events from the project are
not deep enough to replicate.
IVEN project has already created good impact on the capacity of the network members. Different
collaboration among members of NorthNet and among members of PAHE has been made based
on their interests for joint-project designing, joint-sharing and learning. IVEN network model
(including Bao Lac and Que Phong models) have been replicated by some members in more than
12 projects.
Relating to external relation, PAHE is in much better position in terms of external linkages to
national stakeholders to compare with NorthNet. The main reason is that all members of
NorthNet are located in remote areas of the Northern Mountain of Vietnam with limited
opportunities for them to meet others, to join different meetings, workshops and forum at
national level.
The two models in Bao Lac and Que Phong have been implemented very successfully in terms of
strengthening EM voice in decision making processes, by creating space for a
monitoring/watchdog mechanism and providing health services for isolated EM women. Strong
evidence of changes in local government staffs attitude and practice to support EM voice, and
improvement of livelihood and health of the EM people in six project communes in Bao Lac and
Que Phong were obtained.
IVEN project was assessed very successful in achieving the Specific Objective of the project.
However, several opportunities have been missed by the project that could have led to a higher
level of impact and sustainability. The process of documentation of successfully strengthening
NorthNet and PAHE networks and Bao Lac/Que Phong models were done late and only
disseminated at the end of the project to the two network members and to other CSOs/networks.
This limited sharing, learning and advocacy for replication project results at local level and limit the
impact towards other CSOs/networks in Vietnam. CARE Vietnam and partners expressed strong
plans and commitment to do this in April 2016 to ensure better impact of IVEN project at national
level.
Efficiency: IVEN project was assessed as high level of financial efficiency. Financial resource
available for project implementation and project created all the desired outputs and more
number of outputs in some areas. The average cost per actual beneficiaries is five times
vi
lower than in the project design. Project equipment and facilities are available for project
implementation. However, significant delays of some main results (such as capacity for
PAHE network, documentation and dissemination of lessoned learnt) caused some
inefficient use of project resources to achieve maximum level of efficiency.
Impact: The project was assessed as good economic/livelihood impact, good social impact
but limited level of policy impact.
Sustainability: Overall assessment, the project have high level of institutional and technical
sustainability for both NorthNet and PAHE network, high level of sustainability at
grassroots level in both Que Phong and Bao Lac. At local institution level (Bao Lac and Que
Phong PCCs), Que Phong has greater level of sustainability. The project has limited level of
policy sustainability.
Lessons learnt and Recommendations: Six lessons learnt and five recommendations,
specifically on Right Based Approach (RBA), network strengthening, documentation and
advocacy are as elaborated in the main report.
vii
1. Introduction
Ethnic minorities are among the poorest people in Vietnam, and the poverty gap between them
and the Kinh majority is growing. Poverty of ethnic minority people in Vietnam is not only limited
to food security and economics, but also access to, amongst others, health care, education,
hygienic water, infrastructure, and fragmentation of social and cultural life. The Government of
Vietnam has been implementing a series of national programs and policies to address inequities
and support the well-being and development of ethnic minority communities. However impacts to
date have been minor. Programs lack the grassroots participation of ethnic minority people in
decision-making, and monitoring of government implementation is limited. Viable civil society
networks could represent EM people in influencing provincial authorities including peoples
councils to adopt more effective and participative community consultation approaches,
advocating for improvements in policy and practice at all levels of government, and ensuring EM
are meaningfully involved in government decision-making, planning and monitoring.
In order to contribute to a representative and capable civil society that influences policy and
practice for the benefit of poor, remote ethnic minorities in Vietnam, CARE has worked in
partnership with Center for Creative Initiatives in Health and Population (CCIHP) and Cao Bang
Community Development Centre (DECEN) to implement the Project Improving voice through
effective network (IVEN) from March 2013 to February 2016.
To assess achievements against project objectives, outcomes and capture lessons learned, a
project final evaluation was conducted in February - March 2016. Results of this evaluation are
presented in this report.
2. Project background
IVEN project aims to strengthen institutional capacity of NorthNet and PAHE to ensure poverty
reduction and health equity for ethnic minorities through strategic policy dialogue.
The Overall Objective of IVEN project is: To contribute to a representative and capable
civil society that influences policy and practice for the benefit of poor, remote ethnic
minorities in Vietnam.
The Specific Objective is: Strengthened institutional capacity of civil society networks to
ensure poverty reduction and health equity for ethnic minorities through strategic policy
dialogue.
CCIHP and DECEN is the key implementing partners for this project. CCIHP hosts the Partnership
for Action in Health Equity Network (PAHE) and DECEN hosts the Network of Northern
Mountainous Civil Society Organizations for Sustainable Community Development in Vietnam
(NorthNet).
The two civil society networks are supported to effectively represent the voice of marginalized
ethnic minority (EM) and advocate for their right to (i) quality EM development, poverty reduction
and related support programs and (ii) equitable access to basic services, in this case health care.
The strengthened, more unified and more capable civil society networks will link the local-level
1
situation of EM with the policy and planning processes at district, provincial and national levels as
required for lasting change IVEN has the following expected results:
Expected Result 1: Two (2) networks of CSOs have improved institutional capacity to
represent ethnic minorities in poverty and health issues
Expected Result 2: Two (2) networks of CSOs implement strategic advocacy plans and
engage in policy dialogue with government stakeholders in target sectors
Expected Result 3: Research and documentation of good practice in target sectors is used
as evidence for policy advocacy
Expected Result 4: Two (2) small-scale demonstration models for improving local
governance and participation of ethnic minorities in decision making are implemented and
documented.
These four Expected Results (ER) address the need to demonstrate that innovative participative
approaches at the local level, if well documented and fortified with quality research, can be
transformed into evidence to support effective advocacy at the district, provincial and national
levels in Vietnam. The ER also reveal the necessity for civil society networks to build their
institutional capacity to better represent the EM voice; to understand the considerable benefits of
network members working closely together for greater effectiveness; to be able to identify priority
issues, then develop a strong and well-targeted advocacy plan; to carry out research to support
that plan; and to successfully engage in policy dialogue with relevant government and other
stakeholders at all levels.
CARE supports capacity building for the two networks. This includes institutional arrangements,
leadership/human resources, knowledge management, information & communication, and
accountability to members. The capacity building process will enable NorthNet and PAHE to more
effectively function as unified networks with a shared vision, to better represent marginalised EM,
and to achieve concrete results for inclusive policy and development decision-making.
Advocacy capacity is built through developing advocacy strategic plan, research and effectively
engage policy dialogue. These will enable PAHE and NorthNet to galvanize support from their
member organisations and affiliates around their common needs, and to jointly raise the EM voice
when issues are identifiedboth locally and at the national level.
At the local level, in Bao Lac district, Cao Bang province and Que Phong district, Nghe An province,
the networks will implement strategic small-scale demonstration models, seeking to improve local
governance and participation of ethnic minorities in GoV poverty reduction programs and
reproductive health service delivery. The research and models are a means for the networks to
strengthen links with grassroots, and improve understanding of their needs and priorities, so that
EM voice can be accurately represented in policy dialogues at both local and national levels. The
models serve to inform and inspire the practice of other civil society organizations and networks.
The documented project results and approaches including network strengthening process,
advocacy approach, Bao Lac and Que Phong models in the poverty reduction and health equity will
serve as learning material and inspiration for the Network members, CSOs and other Actors at the
provincial and national levels. The capacity development process is replicated by other CSOs and
CSO networks throughout Vietnam as a specific contribution to a representative and capable civil
2
society that influences policy and practice for the benefit of poor, remote ethnic minorities in
Vietnam (Overall Objective of the project).
The project will apply innovative methods to involve communities, the peoples councils and
relevant provincial departments in consultation, policy planning and monitoring for more
equitable development outcomes. These include rights- based approach with a focus on
empowering local communities, building capacity of local partners, gender mainstreaming,
womens empowerment, anti-discrimination, building on previous efforts and synergies with other
initiatives to maximize projects efficiency and impact.
The below diagram presents the above description of IVEN project:
Figure 1: IVEN project desired

Source: Designed by evaluation consultant based on project document
3. Evaluation objective
The main purpose of the final evaluation, as defined by the TOR, is To assess the outcomes,
effectiveness, relevance, efficiency, sustainability and impact of IVEN project and to generate
lessons learnt and recommendations for learning and sharing among network members and for
advocacy and future program development.
To meet this Objective, the evaluation has applied five criteria for assessment: relevance,
efficiency, effectiveness, impacts, and sustainability through a number of key questions as the
Table 1 bellow.
Table 1: Key questions for the Evaluation

Evaluation Criteria
Key Questions
Effectiveness
The extent to which the
development
interventions
objectives were achieved, or are
expected to be achieved, taking into
account their relative importance.
Has the project achieved its objective and four expected results? To
what extent?
Relevance
The extent to which the objectives
of a development intervention are
consistent
with
beneficiaries
requirement, country needs global
priorities and partners and donors
policies.
What are the relevance and added value of different project

approaches and methodologies?
How and why the project and tools influenced the achievement of
results?
Does the project
group/population?
fulfil
the
needs
of
the
target
How much is the project aligned with donors policies and

strategies?
How much is it aligned with relevant country policies and
strategies?
How project relevance to 2 Networks vision/mission
Efficiency
Are four project results achieved at an acceptable cost, compared
A measure of how economically with alternative approaches to accomplishing the same objectives?
resources/inputs (funds, expertise,
Are relevant resources from the project available according to
time, etc.) are converted to results
project design and plan to ensure the efficiency?
Sustainability
The continuation of benefits from a
development intervention after
major development assistance has
been completed; the probability of
continued long-term benefits
Is the activity/project approach likely to continue after donor

funding? (technically and financially)
Impact
Positive and negative, primary and
secondary long term effects
produced
by
development
intervention, directly or indirectly,
intended or unintended.
What are positive and negative impacts/changes of the project/

based on 4 expected results? What are most significant changes
does the project brought?
What are positive and negative factors determining the

sustainability of the project and how these factors are addressed?
How 2 networks to be sustainable without support from
project/project ended.
What is the attribution/contribution to achievement

development/project goal by CARE and its partners?
of
With support from project, how 2 networks change about their

capacity, institution and advocacy achievement?
4. Evaluation methodology
Approach
The evaluation applied a participatory approach with careful consideration of the utility of the
following principles:
Judgments should be made relative to context (the evaluation will draw conclusions and
identify trends taking into consideration the role of and interplay with context);
Strong utility focus (user engagement) in planning and implementation of evaluation.
Using/building on previous studies and evaluation.
Attention to equality and rights and gender equity in all aspects of the evaluation.
Methodology & Tools

The following methodologies were applied:
Desk reviewed relevant documents including project documents, project progress reports,
and technical reports.
Groups and individual interviews of CARE project implementation team, project

partners/network members, local partners and beneficiaries for deeper analysis based on
five criteria of the evaluation. The interviews has been be conducted in form of semistructure interview.
Participatory workshop: Conducted a participatory workshop with combined

methodologies including presentation, groups discussion and plenary analysis/discussion.
Gender sensitive in selecting interviewees and analysis.
Analytical framework
The analytical framework followed the below model of Project monitoring and evaluation from EU
M&E guideline1 (see Figure 2 below). The final evaluation focused on outcomes, effectiveness,
relevance, sustainability and impact at Objective, Results, Strategy while efficiency were analyzed
at level of inputs and outputs.
Figure 2: Summary of Analytical framework

1
Guidance document on Monitoring and Evaluation European Cohesion fund Concept and recommendation
European Union 2015.
Sampling
Given the limited time and resources, the sampling has been taken into account several issues
such as representatives of different project stakeholders, time and financial resource available,
methodologies applied etc. The evaluation team have met, discussion and interview of total 52
people including CARE and partner staff, NorthNet and PAHE members, local authorities and
beneficiaries. The list of participants participated is in Annex 2 and the detailed methodology is in
Annex 3.
5. Major findings
5.1. Relevance
IVEN project is extremely relevant to EU strategy and programs focuses. The European
Commission Communication Strategy The roots of democracy and sustainable development:
Europe's engagement with Civil Society in external relations2 and more specifically, the EU CSO
Roadmap 20143, that provides the basis for a common and dynamic EU strategic framework for
EUs engagement with civil society in Viet Nam, have given specific priority by the EU Member
States and the EU Delegation including:
Promote an improved enabling environment for civil society organizations in Viet Nam:
The EU will support dialogue between the government, civil society actors, the private
sector and the general public to build trust and understanding of the positive contribution
of civil society in Viet Nam's development.
Promote a meaningful and structured participation of CSOs in domestic policies: The EU

will ensure that in new bilateral and thematic programmes and sector interventions, CSOs
are mainstreamed so as to ensure their participation as partners in delivering services and
in policy making. The EU will continue to support CSOs to meaningfully engage with
government at national and provincial level in providing policy recommendations, in
monitoring policy implementation as well as to establish networks/coalitions for enhanced
policy impact.
Strengthening CSOs' capacity to perform their roles more effectively: Capacity building for
civil society is critical given the current enabling environment and actual operations of
CSOs. The EU will support CSOs across a broad range of areas related to internal
governance, sustainability and registration, capacities for improved service delivery to
the most vulnerable and marginalized groups of society, capacities for advocacy and
policy engagement, as well as capacities for increased integration in regional and
international CSO networks.
IVEN project fully responded to those priorities in terms of strengthening institutional capacity of
NorthNet and PAHE networks of CSOs, supporting their advocacy/dialogue with local and national
authorities, building their capacities for improved health service delivery (in Que Phong) and
2
3
http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=COM:2012:0492:FIN:EN:PDF
http://eeas.europa.eu/delegations/vietnam/documents/press_corner/2014/20141110_civil_society_en.pdf
promoting voice of people in poverty reduction (in Bao Lac), to the most vulnerable and
marginalized groups (poor EM communities and EM women).
The project is very relevant to Vietnam poverty reduction context: EMs still are among the most
disadvantaged, have low voice/low level of participation in Vietnam and the need to continue
supporting their poverty reduction and participation for 2016-2020. According to the poverty
review in 20154 by MOLISA, Vietnam has total 1,442,261 poor households, of which, 663,563
households belong to EMs, accounting for 46.66 % of the total poor households in Vietnam at the
end of 2014. In 64 poorest districts, EMs account for 83.18 % of total households, but EM poor
households account for 92.99 % of the total poor households.
Resolution 765 of the National Assembly clearly set out strategic directions for poverty reduction
in Vietnam for 2016 2020 that needs to concentrate resources for supporting the most
vulnerable group priority must be given to support the ethnic minority in special difficult
communes and villages. Report of National Assembly on poverty reduction in 20146 confirmed
that poverty reduction policies and programs planning and implementation by provincial and
district government remains inadequate, mostly non-participative and inequitable there is
limited bottom-up involvement and it set out strategic direction to promoting decentralization
and participation as "complete decentralization of tasks and specific powers to the local level;
reform administrative procedures to enable local poor people and community to participate in
poverty reduction policy; promote democracy, openness and transparency; capacity building of
local authorities and officers for poverty alleviation. These confirm that IVEN project is
implemented strongly in line with current and future context of poverty reduction of Vietnam, by
focusing on poverty reduction of EM and promoting voice, rights and participation of EM people.
The project was assessed as relevant to the needs of NorthNet and PAHE network members.
Members of NorthNet and PAHE indicated that the project designed and implemented are
relevant to their needs, bringing positive changes in their staff and institutional capacity, especially
related to networking and advocacy capacity. More detailed information about impacts of the
project on the two networks is elaborated in latter sections of the report.
The project are highly appreciated by local EM people in terms of support building their
confidence, creating space for speaking out, and dialoguing with local authorities. These already
led to improve their livelihoods in Bao Lac and better access to maternity health services in Que
Phong.
The project are well received by local authorities (Commune and District People Councils) and
Government public health services (Commune and District Clinic Centres, and village health
workers). Great changes have been made to their capacity in terms of shifting their practice to be
more responsive to local EM voice and bringing this to decision-making processes at higher level in
areas of poverty reduction investment and maternal health services.
MOLISA, Decision 1294/QD-LDTBXH approving results of poverty review in Vietnam, dated 10 September 2015.
National Assembly, Resolution Number: 76/2014/QH13, Promoting poverty reduction to 2020.
6
UBTVQH - Number: 660 / BC-UBTVQH13, Report the results of monitoring "The implementation of policies and laws
on poverty reduction, the period from 2005 to 2012. May 19, 2014.
5
The official mechanism that the IVEN project chose for channelling the voice of the people - the
People Council (PCC) system - was assessed as extremely relevant. In Vietnam, PCCs have official
mandate to represent the rights and interests of the people and to oversee the implementation of
Government policies and programs, and influence decision making from Government (see Figure 3
below).
Figure 3: Local Government, People Councils and People Power relationships

Source: Nghe An Peoples Council Manual7
At time of the project design, there has been a tendency from the State to delete PCCs system at
District level. In addition, at that time, the power of PCCs were relatively weak due to lack of a
strong legal frame work for monitoring local Governments policy and programs. However, the
Revised Law on organizing the local government dated 19 June 2015 confirmed the continuation
of PCCs system at District level. The oversight role of PCCs has also become more important with
much stronger legal mandate by a new Law on National Assembly and People Council Monitoring
which was issued in November 20, 2015. This provides PPCs with more space for monitoring
local poverty reduction programs and providing feedbacks of people to local agencies.
These changes illustrate that IVEN projects focus on enabling voice of the people through PCCs
system is very relevant and lessoned learnt regarding to this aspect will be valued to existing and
future context of Vietnam.
Positive changes in right-holders and duty-bearers, which will be elaborated in the next sections,
confirm that Rights Based Approach (RBA) as well as other approaches applied by the project
such as capacity building, gender equality and anti-discrimination are relevant to local context
and EM poor people in remote areas and can create positive impact in both long terms and short
terms.
5.2. Effectiveness
Overall assessment is that project was implemented successfully, achieved most their target
outputs and outcomes (19/24 targets fully achieved and 5/24 to be achieved). However, several
opportunities have not been taken by the project in order to have higher level of impacts and
sustainability.
Nghe An Peoples Council, Improving the Participation and Voice of Ethnic Minorities Project funded by CARE Vietnam
and Irish Aid, Peoples Council Manual, Nghe An 2012.
Achievements of Results 1: Two (2) networks of CSOs have improved institutional capacity to
represent ethnic minorities in poverty and health issues.
Key achievements of Results 1 are summarized in Table 2.
Table 2: Key achievements of Results 18
#
1
Indicators
Baseline data
Achievement at the end of the project
At least 80% of CSO members

are
more
satisfied
with
representation of their views by
the networks compared to
baseline.
Coordination
and
representation
in
the
networks are scored at
below average (less than
10/25 point) in both
network's
capacity
assessments.
90% of NorthNet and PAHE members satisfied

with representation
of
their
view.
Coordination and representation in two
networks were scored at high level (18.75/25
point) at the end of the project.
The documented process of

successfully strengthening CSO
networks and the advocacy
results they achieved are widely
disseminated.
No documentation of the
advocacy work was made
by both networks.
The process of successfully strengthening CSO

networks and the advocacy results they
achieved were documented disseminated late
at the end of the project. .
Capacity development plans

have successfully supported the
implementation of the Action,
and action-learning habits have
been
established in the
network.
No comprehensive capacity
development plan was
available in both networks.
The 17 organizations in PAHE

and
NorthNet
networks
regularly share information
about their advocacy activities
and are better regarded by their
EM constituency compared to
baseline.
The two networks now

included
17
members
working together in their
joint advocacy efforts. Two
network did not reach out
to their EM constituency in
the name of the network,
but in their individual
capacity.
The
two
organisations
which
conducted
the
demonstration are well
recognised by local people
and authorities9.
Achieved the target indicator.
To be achieved the target indicator

Capacity development plans have successfully
supported the implementation of the Action,
and action-learning habits have been
established in the networks.
The 12 organizations of NorthNet and 5
organizations of PAHE networks regularly
shared information about their advocacy
activities. But limited information sharing
between the two networks. Both two
organisations (DECEND and CCIHP) who
responsible for implementation models in
Quy Phong and Bao Lac are better regarded
and well recognised by local EM constituency.
Achieved the target indicator, assumption
based on observation in Bao Lac and Que
Phong regarding to CSOs were better
10
regarded by their EM constituency .
NorthNet was originally established in July, 2011 comprising of 9 CSO organization members, of
which one Centre (ADC Centre) is under Thai Nguyen University. Members of NorthNet work in
the mountainous provinces in the Northern of Vietnam including Cao Bang, Ha Giang, Yen Bai,
Dien Bien, Phu Tho and Hoa Binh. Most of the network members focuses on poverty reduction for
8
Note that the project has revised log-frame and indicators at end of Year 2, submission to EC together with Year 2 Progress Report.
Note that no baseline information for this indicator. This information comes from the Mid-term evaluation.
Due to limitation of time and resource, the final evaluation team only visited Bao Lac and Que Phong sites, no visit was conducted to
other operational areas of all NorthNet and PAHE members to observe their EM constituencys assessment.
9
10
ethnic minority such as livelihood improvement, capacity building, forest planting/protection,

water and irrigation supports etc. The network has established a Coordination Board chaired by
the Director of DECEN. In February 2016, NorthNet consist of 12 members (3 new members joined
during time of the IVEN project).
Before IVEN project, PAHE has been a group of individuals representing different organizations
(about 30 organizations) sharing the same interest in health equity. At that time, PAHE was not
considered as a formal network and did not have jointly agreed operating regulations. Thus, the
relationship between its members was unclear, causing difficulties to PAHE in coordination. At the
end of IVEN project (in February 2016), PAHE had formal setting its structure including 5 members
(all in Hanoi and one belong to Hanoi Medical University), networks logo, vision, mission and all
internal governance mechanism.
The capacity building process for both Networks was stated by a participatory institutional
capacity assessment, capacity building plan development and followed by different types of
interventions for strengthening Institutional and advocacy capacity. Capacity building process for
NorthNet has started since the end of Year 1, but PAHE is late, started at around end of Year 2.
Great improvements were made by the IVEN project to capacity of the networks. In the area of
internal governance system, IVEN project was assessed by the two network members to have left
a good impact on network internal systems capacity, and created a solid foundation for further
development of the two networks. Significant increase in capacity of the two networks to more
effectively function as unified networks with a shared vision, planning and coordination
mechanism in place with better representation of their network members. All internal governance
regulations such as sharing and learning, decision making, internal and external communication
are available and with strong commitments of the members to follow. 90% of interviewed
NorthNet and PAHE members were satisfied with representation of their view. Coordination and
representation in the two networks on average at the end of the project were scored at high level
(18.75/25 point at the end of the project in comparison to 10/25 point of the baseline).
For both two networks, IVEN project have made a great help for the staff of network members to
understand the considerable benefits of networking such as working closely together for greater
effectiveness, to be able to identify common interests and priority issues, and better represent
marginalised EMs.
Specifically, for NorthNet, good coordination
mechanism is in place and committed to follow
by all the members. For example, each
organization member pertains to the network
as a means of supplement the advantages from
each other. While DECEN is responsible for
overall coordination of the whole network,
Rural Development Service Centre (RDSC), for
instance, take proactive role of coordinating the
research and capacity building activities.
Similarly, Agricultural Development Centre
10
We learnt a lot from IVEN project, about

approaches, methods to do consultation meeting
with EM through forum model. This is very good
model. We changed a lot. Before the project, we
were not clear about why we need to join a
network. We thought it wastes of time and
resources. Now we realized it is very important:
information, learning, sharing, and collective
action...
Mr Trong, HADEVA-Vice Director
(NorthNet member)
(ADC) take coordination lead in climate resilient livelihood interventions, and the Centre for
Sustainable Community Development of Mountainous Community (SUDECOM) assists others in
NorthNet in data collection and good practice documentation.
Significant increases in capacity of NorthNet member staff has been obtained, including:
Better access to information needed for their organization development.
Research capacity.
Networking, policy analysis and advocacy planning capacity.
Methodology to work with EM and promoting EMs participation.
Proposal writing.
The IVEN project has already created good impact on the capacity of NorthNet members. Different
collaborations between members of NorthNet have been made based on their interest, such as
between SODECOM and CDSH, among ADC, SUDECOM and CMD for join-project designing, joinsharing and learning. IVEN network model and Bao Lac forum model have been replicated by some
members (DECEND, ADC, SUDECOM and HADEVA) in more than 7 small projects in the Northern
mountain of Vietnam and created good impact on the lives of ethnic minority people.
Specifically, for PAHE, even the capacity building
process was implemented late due to several The biggest change of PAHE is all
reason11, members of PAHE reported that good institutional mechanism in place, including
changes in their capacity especially in areas of coordination and external communication
internal governance of the network, recognition mechanism..., and strategic advocacy
of networking value, sharing and learning, planning capacity...
external relation and strategic advocacy
Mr Minh, CCIHP-Vice Director
planning. For example, Centre of Community
(PAHE member)
Research and Development (CCRD), a member
of PAHE network with the facilitation of CCIHP in PAHE network, are also very active in IVEN
project implementation in Nghe An. They all maintain frequent exchanges professional issues and
interacting each other in health care services under the umbrella of PAHE, especially in improving
the quality of services and applying the rights-based approach in health care services for the
remote ethnic minorities. Members of PAHE reported that they benefited much through the name
of PAHE as it has been known as an active network struggling for equal access to health care
services for all, especially for ethnic minority women. They also expressed their interests in
advocacy activities at the national level as the network has successfully brought the voices of
different members to influence the policy makers in health care sectors.
IVEN network model, advocacy approach and Que Phong model (on maternal health service
access) have been replicated in several join-project and join-proposals of all 5 organizations under
the PAHE network.
Both NorthNet and PAHE were proactive to communicate with other organizations those may be
interested in health equity for remote ethnic minorities and promoting the voice of ethnic
11
See explanation at the end of this section
11
minorities through policy dialogue forum. So far, NorthNet has recruited more 3 members that
increased members of both networks up to 17 organization members.
However, capacity of NorthNet is still limited in areas of strategic information sharing and external
communication/external linkages that are important elements of advocacy capacity of the
network. Some members of NorthNet, as mentioned above, already replicated Bao Lac model to
their project while others have limited information about the model. The main reasons are that
the sharing and learning events, which have been done through the network meetings, email and
Facebook, did not have a strategic focus on content/objective oriented, but mainly focused on
updating work plan and activities. So learning processes so far more depended on level of active
from individual members than targeting all members. Thematic learning events will be better
approach for NorthNet than combination learning and management/planning meetings.
There have been not much changes in NorthNet capacity in areas of external relation as reported
by NorthNet members. Limited linkages between NorthNet and other stakeholders especially at
national level. The main reason is that all members of NorthNet locate in the remote areas of the
Northern Mountain of Vietnam and limited opportunities for them to meet others, to join
different meetings, workshops and forum at national level while. PAHE is in much better position
in terms of external linkages to national stakeholders because all members of PAHE is in Hanoi.
More specific and innovative capacity building approach is needed for NorthNet as well as other
isolated CSOs in general regarding this aspect.
The process of documentation of successfully strengthening NorthNet and PAHE networks and the
advocacy results they achieved were done and disseminated late at the end of the project. This
limited sharing and learning among network members and limited impact to other CSOs/networks
in Vietnam.
Sharing and learning between the two network members is also weak. Members of NorthNet had
limited information about Que Phong model and the same to PAHE members to Bao Lac model.
Without sharing information, the project missed opportunities to have more value added such as
replication a part of each model to other (e.g. maternal health service monitoring tools from Que
Phong to Bao Lac or forum meeting facilitation process from Bao Lac to Que Phong) and synergy of
effort at higher level for advocacy between two networks.
Reasons for delaying capacity building for PAHE, late documentation and limited sharing and
learning, explained by CARE, partner and network member staff, include:
Restructuring CARE Vietnam: CARE VN have been in a re-structuring process in 2014 and
2015 (during Year 2 of the IVEN project). This includes changes of staff, coordination
mechanism and structure and these led to the delay and changes of technical approach for
IVEN project implementation. The capacity building plan for NorthNet which was already
designed was revisited and adjusted. Capacity building for PAHE and documentation of the
whole project were delayed due to lack of consensus agreement among CARE technical
team.
It was time consuming for PAHE to formulate its operation mechanism and networks
governance including agreement on their formal structure, numbers of membership
12
(reducing from 30 to 5 members) etc. This long process of establishment has caused PAHE
to be legged behind the schedule proposed.
The differences in terms of time for capacity building process between the two networks
(and between Bao Lac and Que Phong models designs and implementation), and late
documentation is also reason for limiting sharing and learning between the two networks.
Achievements of Results 2: Two networks of CSOs implement strategic advocacy plans and
engage in policy dialogue with government stakeholders in target sectors.
#
1
Indicators
Baseline data
Advocacy messages are

based on identification and
analysis of policy and public
investments programs in
the target sectors which are
relevant to ethnic minority
constituencies.
Both networks have no

specific advocacy messages
developed.
Advocacy messages were developed by

NorthNet on promoting EMs indigenous
knowledge and EM access to information on
poverty reduction and by PAHE on health equity
for EM women. The messages were developed
based on identification and analysis of policy
and public investments programs through 4
action researches that reflected respiration of
ethnic minority constituencies.
Network advocacy plans

updated each year based on
member
progress,
achievements and lessons.
No advocacy
available.
plan
was
17 CSOs have developed,

planned and implemented
advocacy activities in line
with a strategic advocacy
plan of the network to raise
EM voice in poverty
reduction
and
health
equity.
North Net had 9 members

working
the
northern
mountains with various EMrelated issues; PAHE had 5
members committed to work
on health equity advocacy.
Peoples Councils have

invited
CSOs
as
representatives of ethnic
minorities to at least 2
consultation meetings for
planning, program and
policy development.
People's Councils in Que

Phong and Bao Lac did not
have much information on
CSOs of the two networks.
PAHE and NorthNet discussed and updated their

plan every network meetings (quarterly) based
on progress, achievements and lessons.
17 CSO members of two networks have
developed, planned and implemented advocacy
activities in line with a strategic advocacy plan
of the network to raise EM voice in poverty
reduction and health equity.
No strategic advocacy plans of

the networks was available.
Both PCCs in Que Phong and Bao Lac are highly
appreciated DECEN and CCIHP and they were
invited to support replication of Bao Lac/Que
Phong models
Both NorthNet and PAHE were developed their advocacy strategies successfully through a series
of meeting and workshops with very active participation from their members. Topics selected for
NorthNet advocacy strategy are 1) Indigenous knowledge in the policy of climate change; 2) Rights
to access to clean water; 3) Gender equity and 4) Right and voice of ethnic minority people to
13
access to poverty reduction. PAHE continued to focus on Health Equity with specific concerns on
maternal health for EM women.
Stakeholders and policy analysis were undertaken by network members as a part of the strategy
formulation process. Both strategies of the two network are available in Year 2 of IVEN project
with good quality of different elements such as advocacy strategy objective, short-term advocacy
(under 2 years) and long-term advocacy (over 2 years), target policy makers group for advocacy,
approach for alliance with others, key messages and clear roles and responsibility of their
members.
Based on the advocacy strategies and relevant opportunities available, NorthNet and PAHE have
fully embarked on implementing its strategic advocacy action plan to raise EM voice in poverty
reduction and health equity. NorthNet initially engaged in policy dialogues and public debates on
two thematic topics: ethnic minority rights of accessing information and pro-poor policy on
promoting indigenous products produced by ethnic minority people and PAHE concentrated on
health system for caring maternal health of EM women.
The advocacy topic ethnic minority rights of accessing information of NorthNet was designed
under a national advocacy on Law on access to information led by People Participation Working
Group (PPWG). Five representatives from NorthNet had participated in an advocacy workshop
organized by PPWG in Hanoi. The workshop is an opportunity for NorthNet to interact with 20
other leaders and activists from different CSOs, also law-making agencies and to update the
process of developing law on access to information in Vietnam. Taking this occasion, NorthNet has
also introduced its advocacy plan on promoting the rights of ethnic minorities in access to
information and the plan has been accepted as a part of the debates and dialogues around the
formulation of this law.
PAHE organize other advocacy workshop in Hanoi and raised discussion on how health system
services and investment should change to be more responsive to EM womens demands. The
discussion involved more than 70 people coming from Ministry of Health, PAHE members, other
CSOs and networks representatives.
The whole process of designing advocacy
strategy and implementing advocacy initiatives The project has made a big change in
has made great impact in advocacy capacity of advocacy capacity of NorthNet members.
the two networks at both network and Before IVEN project, the word advocacy
individual staff member capacity. The whole rarely mentioned in all NorthNet meetings
process of implementing the advocacy and project proposals, but now it become a
strategies discussed and updated their plan regular topic for discussion and all present in
every network meetings (quarterly) based on our project proposals, because people
progress, achievements and lessons. Advocacy realized the important of advocacy in poverty
issues become regular topics on meeting reduction and sustainable development...
agenda of NorthNet and PAHE, and this is a big
Mr Son, ADC Director
difference in comparison to the situation before
(NorthNet member)
IVEN project. During time of IVEN project
implementation, both NorthNet and PAHE members were invited to different consultation
14
meetings, mostly at the provincial level, depending on their relevant activities implementing in
collaboration with the provincial authorities. Some members, especially PAHE with their
advantages of professional expertise and closer link to national level policy makers were also
invited to the consultation on health care service reform at the national level.
However, there is still some gaps in advocacy capacity of the networks, especially for NorthNet
such as in areas of strategic information exchange and external linkages to national level as
mentioned in previous section.
At local level, PAHE and NorthNet designed and implemented successfully Bao Lac and Que Phong
models. PCCs in Que Phong and Bao Lac are highly appreciated DECEN and CCIHP and they were
invited to support replication of Bao Lac/Que Phong models. The documentation of 2 models
documented and shared to local authorities for replication purpose. However, due to lack of
strategic advocacy plan at local level for replication of Que Phong and Bao Lac, therefore
opportunities to maximize the project impact has not been taken. Some more details are provided
in the Section 5.2.4. Achievements of Results 4: Two (2) small-scale demonstration models for
improving local governance and participation of ethnic minorities in decision making are
implemented and documented.
Achievements of Results 3: Research and documentation of good practice in target sectors is

used as evidence for policy advocacy.
#
1
Indicators
Baseline data
At least 4 research topics are

identified, developed into a
methodology, implemented
and documented of which
two in year one.
No research topics are

identified by the networks.
4 research topics are identified, developed into

a methodology, implemented by NorthNet and
PAHE and results were documented in year
two and year three.
At least 4 research activities

have been completed in
collaboration
with
consultants/Universities, and
findings have been used to
forge effective advocacy
messages
No research activity has

been completed by the
networks.
The results of at least 4

research
exercise
are
disseminated among network
members and used as
supporting evidence for a
strategic advocacy initiative
No research results from the

networks
has
been
disseminated
among
network members.

4 research activities have been completed in
collaboration with Thai Nguyen and Hanoi
Medical Universities, and findings have been
used to forge effective advocacy messages.
The results of 4 research exercise are

disseminated among network members and
used as supporting evidence for a strategic
advocacy initiatives.
Based on the advocacy strategies and relevant opportunities available, NorthNet and PAHE
members have decided to conduct researches. The purpose of this activity is to collect information
15
that are directly informed by advocacy objectives of the two networks. In addition, this will
practically build capacity for network members. Four research topics were identified that are:
Indigenous knowledge in the policy of climate change
Right and voice of ethnic minority people to access to poverty reduction.
Health Equity with specific concern on maternal health for EM women.
Health Equity with specific concern on health service system
The two network members have undertaken a comprehensive process to design research
framework, research methodology, capacity building for the research team (staff member of the
networks) and coordination mechanism among network members. The researches have
implemented successfully by NorthNet and PAHE in 7 mountainous provinces that are Cao Bang,
Bac Kan, Yen Bai, Thai Nguyen, Hoa Binh, Nghe An, Kon Tum.
Results of research were widely shared among networks members and developed into follow up
action plan and advocacy messages to serve advocacy activities as description in Section 5.2.2.
As reported by members of networks, conducting research is great approach for building research
capacity of the network members, especially for the NorthNet members. Many of them were not
experienced with research before. Together with advocacy, research capacity for representing EM
voice is a key achievement of IVEN project that mentioned in all discussions and interviews of the
network members, especially for NorthNet.
The main gaps of Results 3 are limited sharing research results between two networks due to
differences in terms of time to conduct researches. In addition, the researches of NorthNet are
not closely link to evident of Bao Lac model. Main reason for this is lack of a deep analysis and a
monitoring system at outcome level to collect information of the model (see Section 5.2.4).
Achievements of Results 4: Two (2) small-scale demonstration models for improving local
governance and participation of ethnic minorities in decision making are implemented and
documented.
Table 5: Key achievements of Results 4 for both Bao Lac and Que Phong Models
#
1
Indicators
Baseline data
EM report change in attitude of

60 leaders, staff and members
from 6 commune Peoples
Councils and mass organizations
Leaders, staff and members

from
district
and
6
commune Peoples Councils
and mass organizations
were limitedly aware of the
importance of peoples
voice
in
participatory
approach
monitoring
investment program.
Great change obtained in attitude and

practice of more than 70 leaders, staff and
members from district and 6 commune
Peoples Councils and mass organizations on
the importance of EM peoples voice in
participatory approach monitoring investment
program, health services and LCC system.
16
#
1
Indicators
Baseline data
Bao Lac: 3 EM Forums in Bao Lac

agree bi-annually on practical
results for EM of key
government poverty reduction
programs.
No
such
feedback
mechanism existed.
3 EM forums in Bao Lac agreed annually on

practical results for EM of key government
poverty reduction programs.
Bao Lac: Commune Monitoring

Boards follow progress with biannually agreed results for EM
of key government poverty
reduction programs, and take
action
towards
relevant
authorities when delays are
noticed.
No
such
feedback
mechanism existed.

While CMB seemed not a visible institution in
the commune, the members of Commune
People's Committee and People Council as
well as random commune staff follow
progress with annually agreed results for EM
of key government poverty reduction
programs, and take action towards relevant
authorities when delays are noticed.
Bao
Lac:
PC
discuss
institutionalization
(resource
allocation) of EM Forum and
CBM in year 3
EM forum not available

before the project for
discussion.
District and Commune People Councils in Bao

Lac already asked for support replication and
institutionalization of EM Forum in Year 3.
EM forum in 3 project commune initially
institutionalized in PCC, fatherland front
system.
Que Phong: The health equity

framework has helped to
identify key barriers to access
and utilization of reproductive
health services in 3 Que Phong
communes in year 1
The
health
equity
framework has not been
used in Que Phong to
identify key barriers to
access and utilization of
reproductive
health
services.
The health equity framework has helped to

identify key barriers to access and utilization
of reproductive health services in 3 Que
Phong communes in year 3.
Que Phong: District health staff

collaborate with PAHE to
overcome barriers to access and
utilization
of
reproductive
health services by EM
Not
yet
collaboration
between District health
staff and PAHE before
project regarding to access
and
utilization
of
reproductive
health
services by EM
District health staff had strong collaboration

with PAHE to overcome barriers to access and
utilization of reproductive health services by
EM.
Great Improvement of access to
maternal health services for EM women
obtained in all villages of 3 project communes.
Que Phong model on EM

services was not available
before the project.
District health staff continued to present

progress with EM access and utilization of
services in district monitoring meetings in
year 3 and partly replication of Que Phong
model into all other 11 communes in Que
Phong district.

continue to present progress
with EM access and utilization of
services in district monitoring
meetings in year 3
A comprehensive participatory process were undertaken to design Bao Lac and Que Phong models
in Year 2. People participated including staff from CARE, DECEN/NorthNet, CCIHP/PAHE, local
stakeholders (District and Commune PCCs and health services) and EM representatives. By the
17
end of Year 2, EM forum model in Bao Lac and Heal Equity model in Que Phong were
accomplished.
EM forum model in Bao Lac include 39 EM representatives of the 3 communes (each village
nominated two representatives including one male and one female) who are in charge of
organizing village meetings to gather residents opinions and/or feedback on program
implementation in their communities. Following a preparatory meeting in which the
representatives of each village present their villages voice and common issues, the commune
peoples committees organize an official forum to be attended by village representatives,
chairman of Commune Peoples Committee, representatives of the local departments, Commune
Peoples Council and relevant agencies of the district. At the forum, the issues consolidated from
the preparatory meeting are presented for Commune Peoples Committees to response. Higher
level issues are submitted to District Peoples Committee.
Figure 4: EM forum model in Bao Lac

Source: IVEN projects document
The Health Equity Model in Que Phong also promote a feedback mechanism from the people on
the quality of health services to the local authorities. The model created a channel of feedback and
dialogue through a monitoring group including staff from District and Commune PCCs and Health
services who implement an evidence-based participatory monitoring activity that allowed directly
dialogue with the people. Methods of collecting feedback from ethnic minorities are diversified
including a simple tool (Maternal Health Monitoring Tool MHMT) to collect the information.
Through this activity, the PCCs and Health services will obtained information related to peoples
feedback on health service to be feed into a dialogue at the end of the year with Health
Department at commune and district levels as well as with other departments.
Other initiatives under this model include a communication packet in forms of IT technology on
Health Equity, gender equity and rights of the people; and a sub-model of mobility services to
18
provide maternal health service for EM women in isolated villages. Figure 5 below presents the
Health Equity Model in Que Phong.
Figure 5: Health Equity model in Que Phong

Source: IVEN projects document
From late of Year 2 and fully functional in Year

3, the two models in Bao Lac and Que Phong This is great project. We are now very
have been implemented very successfully in confident to do monitoring work and
terms of strengthening EM voice in decision consultation with EM people. The biggest
making processes, by creating space for a changes of EM representatives is significantly
monitoring watchdog mechanism. In Bao increased in level of confident to speak out,
Lac model, great changes were obtained in and know how to organize a village
and preparing
capacity
of
EM
male
and
female consultation meeting,
representatives, who were much more meeting minutes, and understand policy...,
confidant to voice out. Feedback and dialogue we need to do this for all other communes....
mechanisms between poor EMs and their
Ms Phan, Hung Dao Commune PCC
representatives were developed and functional.
Bao Lac District
Big changes of local commune people council
staff in terms of their capacity to facilitate a bottom-up approach to support people raising their
voice to influence local authoritys decision. In 2015, there has been total of more than 40 issues
and feedbacks raised by EM people were responded by CPCs. Evidence of changes in livelihood of
the people in three project communes in Bao Lac were obtained by positive changes in poverty
reduction program investment practice. For example, positive changes in livelihood of poor EM
people and communities by supporting electricity infrastructure set up for poor and isolated EM
households from local authority, change in supporting health insurance for EM people, changes in
the way of implementing poverty reduction policy under Decision 102 12 on support inputs for
agriculture production for EM poor people.
Informally, the Bao Lac model was institutionalized in existing commune structure with different
setting up. For example, in Hung Dao, it keeps the same model as designed by the project with
linkages with PCC commune system. In Hung Thinh commune, it fully integrates with commune
12
Decision No 102/2009 / QD-TTg on Policies to support directly to the poor people households in difficult areas
19
PCC system and in Khach Xuan commune, it mainstreams into Fatherland Front system. However,
there is not yet any official decision to ensure the sustainably of this institutionalization.
Great changes were made by the Que Phong model in three main areas:
1) Increased knowledge and awareness of local EM people on maternal health, rights to
voice and gender equity by the use of various traditional EM role-play for
communication. The soft communication packet was put in a USB that can be used by
television set at EM households. Ranking by EM women in a village during the final
evaluation show that level of awareness of local EM people on maternal health, rights
to voice and gender equity increased from zero point/10 to 8/10 at the end of the
project (for both man and women).
2) Much better access to local health services including for EM women in isolated villages
in three project communes by capable local health services and staff at all levels
(village, commune and district) and application of a mobile-health-services. Results of
discussion with EM women in a project village indicate that almost 100 % targeted
women in normal village and isolated village have used maternal health services
while this figure before the project was under 10%.
3) Improved capacity and mechanism of monitoring for communal and district PCCs with a
simple Maternal Health Monitoring Tool (MHMT) in maternal health sector. All district
PCCs staff is highly appreciated the tool. With capacity building including equipping
with this tool, PCC in Que Phong, the first time so far, have undertaken their monitoring
in health sector which they could not do before. PCCs in Que Phong strongly indicated
that they will continue monitoring with the tool after the project and planned to
develop similar tools for other areas such as infrastructure and education.
Great improvement were reported by EM
women in visited village on women maternal This tool is new to us. This is great. This is
health (and their babies) in three project the first time People Council in Que Phong
communes.
The
three
above can do monitoring Health sector. Before we
results/approach/models were already spread could not do monitoring health activities
crossing all other 11 communes in Que Phong because we did not have technical
district by District and Commune PCCs and capacity...now we know how to do it...we will
health services without any pushing from the apply this tool for all other communes...it is
project. It is estimated that at least 20,000 easy, no cost, and we plan to develop similar
people benefited from other communes in Que tools for other area, such as infrastructure
Phong district. The success of Que Phong and education...
model in a short time, besides the participatory
Mr Hung, Vice Head of Que Phong district PC
approach similar to Bao Lac, are likely due to a
combination between RBA and friendly service delivery, using simple tools for monitoring and
local language role-play for communication and a narrow focus on a specific sector.
However, due to the success of both Bao Lac and Que Phong model mainly achieved in Year 3, the
documentations of the two model are finishing late at the end of the project (during time of the
final evaluation). Bao Lac and Que Phong models are excellent evident of how RBA works and
20
creates impact on the lives of poor EM at local level in Vietnam. A deeper analysis and
documentation of two models should be conducted for learning and future works. The leaning
from this analysis should include how different integration models in Bao Lac works, the difference
in responds from the local authorities to issues/feedbacks raised by EM men and raised by EM
women in Bao Lac, what makes Que Phong model successful and replication by local people
themselves, what value of RBA and its impact on the lives of poor EM people in the context of
Vietnam in a short term and long term and so on.
Without deep analysis and late documentation, there have been limited strategic sharing and
learning between to networks on these models. And there has not yet been made sufficient effort
for advocating at local level to officially institutionalize Bao Lac and Que Phong models into the
existing system to ensure lasting changes in the lives of local EM people.
Achievements of the Specific Objective: Strengthened institutional capacity of civil society
networks to poverty reduction and health equity for ethnic minorities through strategic policy
dialogue".
Table 6: Key Achievement of the Specific Objective
#
1
Indicators
Baseline data
"Minimum 10000 EM
people in the two target
districts benefit directly
from local level network
activities including the
demonstration models
(i.e. improved access to
poverty
reduction
program benefits and
reproductive
health
services)
No need baseline data

because the network
activities
and
were not available
before the project.
There are more than 50,000 EM people in the two target

districts benefited directly from local level network
activities including the demonstration models (about 7700
people in three communes in Bao Lac, more than 20,000
people of 3 communes in Que Phong and estimated more
than 20,000 people in other communes in Que Phong
benefited from replication of communication packet on
health equity).
Influential
EM
individuals have joined
the
CSO
network
members to assist in
addressing poverty and
health issues
No
Influential
EM
individuals have joined
the
CSO
network
members to assist in
addressing poverty and
health issues.
No EM individual formally joined the NorthNet and PAHE

network or other CSO members. However, both DECEN
and CCIHP have built strong relationship with 76 EM
representatives in Bao Lac and Que Phong and the two
network planned to keep communication and information
exchange with them even after the project to address
poverty and health issues.
Targeted
Peoples
Councils have shifted
their practice in line
with at least one of the
strategic
network
advocacy initiatives"

because the strategic
network
advocacy
initiatives were not
available before the
project.
Targeted Peoples Councils (at commune and district

levels) have already shifted their practice including
provision of information needed for EM on poverty
reduction (in Bao Lac) and practical application of
participatory monitoring maternal health sector in Que
Phong. This is in line with advocacy initiatives of NorthNet
(improving access to information for EM) and PAHE
(improving health equity for EM).
21
IVEN project is assessed very successful in achieving the Specific Objective of the project. There are more
than 50,000 EM people in the two target districts who benefited directly from local level network activities
including the demonstration models, five times more than in the project design (10,000 people). Targeted
Peoples Councils (at commune and district levels) have already shifted their practice including provision of
information needed for EM on poverty reduction (in Bao Lac) and practical application of participatory
monitoring of maternal health sector (in Que Phong). Influential EM individuals have not joined the
networks, however, both DECEN and CCIHP have built strong relationship with 76 EM representatives in
Bao Lac and Que Phong and the two networks planned to keep communication and information exchange
with them even after the project to continue addressing poverty and health issues.
Achievements of Overall Objective: To contribute to a representative and capable civil society

that influences policy and practice for the benefit of poor, remote ethnic minorities in Vietnam.
Table 7: Key Achievement of the Overall Objective
#
1
Indicators
Baseline data
"Examples of CSO networks

using learning materials
developed by this Action to
build
capacity
for
representation of EM voice
and
leading
effective
advocacy

because
learning
materials developed by
this Action were not
available before the
project.
Due to late documentation of the project so no

examples of CSO networks using learning materials
developed by this Action to build capacity for
representation of EM voice and leading effective
advocacy. There may be some others learned from
research presentation and advocacy message in
advocacy workshops. CARE VN and partners planned
to organize sharing event and disseminate learning
materials to others in April, 2016.
To be achieved the target indicator.
Two models for monitoring

government
public
investment programs, and
for inclusive access to
health services inspire
concerted CSO network
action across Vietnam

because project models
were not available before
the project.
CSO network relationships

for
research
with
Universities is exemplary
for others in Vietnam
No example of CSO
network relationships for
research with Universities
to share with others
before project.
Due to late documentation of the project, Bao Lac

and Que Phong models have been disseminated late
at the time of the evaluation so limited impact on
concerted CSO network action across Vietnam.
Not yet any learning material distribution as

exemplary for others in Vietnam. CARE VN and
partners planned to organize sharing event and
disseminate learning materials to others in April,
2016.
The National Assembly

Committee
on
Ethnic
Minority Affairs promotes
advocacy messages and/or
demonstration
models
developed
under
this
Action."

because
advocacy
messages
and/or
demonstration
models
developed under this
Action were not available
before project.
22
The Committee for Ethnic Minority Affairs (CEMA)

promoted advocacy plan proposed by NorthNet and
collaborated with NorthNet and PPWG to support
implementation. The advocacy process (on Law of
information access) was not finished at the end of
the project.
As shown in the Table 7, IVEN project achieved the Overall Objective but not at a high level.
Reason for that mainly due to weak documentation, sharing and dissemination as discussion in
several previous sections of the report. During time of the final evaluation, CARE Vietnam and
partners expressed strong plans and commitment to do this in April 2016 to ensure better impact
of IVEN project at national level.
5.3. Efficiency
IVEN project was assessed as high level of financial efficiency. Financial resource available for
project implementation and project created all the desired outputs and more number of outputs
in some areas. The average cost per actual beneficiaries is five times lower than in the project
design as Table 8 below.
Table 8. Financial efficiency Financial Input per deliver outputs
#
Designed Tangible Outputs and Budget

Capacity built for two (2) networks of CSOs
17 CSOs have developed, planned

implemented advocacy activities.
2
3
Delivered Outputs and Budget

Capacity built for two (2) networks of CSOs
and
17 CSOs have developed, planned and implemented

advocacy activities.
4 research activities have been completed
4 research activities have been completed
Two small-scale demonstration models are

implemented.
Two small-scale demonstration models were implemented.
10,000 EM people in the two target districts

benefit directly from local level network
activities including the demonstration models

districts benefited directly from local level network activities
including the demonstration models (about 7700 people in
three communes in Bao Lac, more than 20,000 people of 3
communes in Que Phong and estimated more than 20,000
people in other communes in Que Phong benefited from
replication of communication packet on health equity).
Total project budget of EUR. Forecast cost per

one EM beneficiary is 625,000 EUR/10,000 = 62.5
(EUR per beneficiaries).
Total project expenditure of EUR. Actual cost per one EM

beneficiary is 625,000 EUR13/50,000 = 12.5 (EUR per
beneficiaries).
Project equipment and facilities are available for project implementation. However, significant
delay of some main results (such as capacity for PAHE network, documentation and dissemination
of lessoned learnt) caused some inefficient use of project resources to achieve maximum level of
efficiency.
5.4. Impact
As project design, the following types of impact are under scope of the final evaluation:
Economic/livelihood impact: Very good economic/livelihood/health impacts at local level,

especially in Que Phong. Low level of impact at national level.
Social impact: Very good social impact by practically applying gender integration and
none-discrimination approach in the project. Evidence obtained show great changes in
13
Expenditure rate is 100 %. However, due to fluctuation of exchange rate at different time of fund transfer, total
expenditure may slightly different from this figure. See more correct figure in the final financial report.
23
behaviour and practice of communities, local authorities and service providers to promote
EM voice and participation. Local EMs were empowered, women in particular, to voice
their issues. Local language and traditional role-play style were promoted and practiced to
contribute to reduce stigmatisation. Overcoming stigmatisation is an essential step in
linking grassroots voice to policy.
Policy impact: Limited level of policy impact. Some changes in policy implementation were
obtained in Bao Lac. Opportunities to have better policy impact at local level have not been
taken. National advocacy have not yet finished to see if any attribution from IVEN project
to the new policy/law at national level.
5.5. Sustainability
Overall assessment, the project have high level of institutional and technical sustainability for both
NN and PAHE network, high level of sustainability at grassroots level in both Que Phong and Bao
Lac. At local institution level (Bao Lac and Que Phong PCCs), Que Phong has greater level of
sustainability. The project has limited level of policy sustainability.
5.6. Project approach and methodology
As project design, the following approach and methodologies are under scope of the final
evaluation:
Rights Based Approach: Excellent adoption of RBA at local grass-root level. Limited
strategic adoption of RBA at higher level.
Capacity Building: Excellent capacity building approach for individual staff of network
members and internal governance of networks. Great capacity building approach for
people at grassroots level, especially on building confidence to voice out.
Gender Equality: Good adoption of gender integration in practice: male/female EM

representatives, facilitation of process for enabling voice of female EM at grassroots level,
health topic selected specifically benefit vulnerable women. Comprehensive gender equity
awareness raising and behaviour change obtained in both EM men and women, and local
stakeholders in Que Phong by adoption of local language - traditional style role play in
communication strategy.
Anti-discrimination: Good adoption by practicing anti-discrimination approach at

grassroots level through promoting EM language in both Bao Lac and Que Phong and
respecting EM voice.
Monitoring and Evaluation: Good monitoring at level of the project outputs. Need to
improve M&E at outcome tracking at both project level and grassroots level to
immediately disseminate for learning and management, especially on gender/women
empowerment and none-discrimination.
Synergy of Effort: Good synergy of effort within CARE VN program and with other
programs and initiatives, especially on aligning with others for advocacy implementation.
For example, IVEN project has maintained close linkages and synergies in actions with
other CAREs projects in Vietnam, for example with Civil Action for Socio-economic
24
Inclusion (CASI), which is also currently supporting and strengthening CSOs in Vietnam, the
Ethnic Minority Women Empowerment program (EMWE). Synergy effort with others
typically is the alliance with People Participation Working Group (PPWG) for advocacy
implementation.
6. Lessons learnt
The followings are main lessoned leant from IVEN project that will help to have better work on
similar project:
RBA works well and is effective for poor and isolated EM in Vietnam including creating
impact on their livelihood in short and long terms. It is likely that RBA will have better
impact and sustainability of outcomes when applied in a specific sector and combined with
relevant service delivery.
Documentation, sharing, learning, dissemination, linking and synergy of efforts are core
elements and pre-condition to ensure the successful RBA and advocacy at high level.
RBA required a stronger system of M&E and research/analysis for tracking its
outcome/impact as evidence for learning and scaling up as well as synergy for advocacy.
In a RBA project, specific and simple tools generate great help for scaling up and
sustainability in the context of Vietnam where local agencies has limited capacity to
monitor local investment/programs.
Improvement of isolated CSOs/network in sharing/learning and external linkages and

information access are challenges. Need more innovative approach for isolated
CSO/network to build their capacity on sharing/learning and external linkages.
In Vietnam, channelling the voice of poor EM people through PCC system is likely much
more efficient and relevant than other system (such as PCs or mass organization),
especially under the New Law of PCC on monitoring government program.
7. Recommendations and conclusions

Overall conclusion is that IVEN project designed and implementation is very relevant to local
social, economic and political context. The project was implemented successfully, achieved most
their target outputs and outcomes and have high level of finical efficiency, sustainability and
impact. However, several opportunities have not been taken by the project in order to have
maximum level of impacts and sustainability.
The followings are some main recommendations to CARE Vietnam and Partner to follow up IVEN
project as well as improving organizational system:
Bao Lac and Que Phong models proved very successful and local PCCs are willing to scale
up. CARE VN and partners should mobilize resource to following up to support this
25
initiative, not only in Bao Lac and Que Phong, but similar localities in Cao Bang, Nghe An
and other provinces.
Que Phong PCCs highly appreciate the MHMT tool and planned to develop similar tools for
other sectors. CARE VN and partners should seek resource to support in forms of an
institutional strengthening project for PCC system in Vietnam. This is valuable especially
under the new Law of PCC monitoring.
CARE VN and partner should have deeper analysis and documentation of Bao Lac and Que
Phong models. The leaning from this analysis should include how different integration
models in Bao Lac works, the difference in responds from the local authorities to
issues/feedbacks raised by EM men and women in Bao Lac, what makes Que Phong model
successful and replication by local people themselves, what value of RBA and its impact on
the lives of poor EM people in the context of Vietnam in a short term and long term and so
on.
Based on deeper analysis of Bao Lac and Que Phong models, CARE VN and partners should
develop a practical guideline for gender integration and non-discrimination in a RBA
project. This should include how to use local language, traditional role-play for promoting
gender equity and none-discrimination, as well as tracking responds from decision makers
to issues raised by male and female, especially at local grassroots level and roles of CARE
staff/partner in the whole tracking process.
CARE VN and partners should focus on strengthening a learning system. This should include
capacity to do snapshot research/tracking outcomes and evident, capacity for strategic
sharing, linking, documentation and dissemination. These are pre-conditions to ensure
synergy at high level for the successful of RBA and advocacy.
26
8. Annexes
Annex 1: Project Achievements against target indicators
Intervention logic
Overall objectives:
To contribute to a
representative and
capable civil society
that influences policy
and practice for the
benefit of poor,
remote ethnic
minorities in Vietnam
Objectively verifiable
indicators of achievement
Examples of CSO networks
using learning materials
developed by this Action to
build capacity for
representation of EM voice and
leading effective advocacy
Baseline information

because learning materials
developed by this Action were
not available before the
project.
Due to late documentation of the project so no examples of

CSO networks using learning materials developed by this
Action to build capacity for representation of EM voice and
leading effective advocacy. There may be some others learned
from research presentation and advocacy message in advocacy
workshops. CARE VN and partners planned to organize sharing
event and disseminate learning materials to others in April,
2016.
Sources and means of

verification of final evaluation
Interview project staff and
partners, network members.
Project reports/Midterm
evaluation report.
Documents/materials
developed by the project

Two models for monitoring
government public investment
programs, and for inclusive
access to health services inspire
concerted CSO network action
across Vietnam
CSO network relationships for
research with Universities is
exemplary for others in
Vietnam

because project models were
not available before the
project.
Due to late documentation of the project, Bao Lac and Que

Phong models have been disseminated lat at the time of the
evaluation so limited impact on concerted CSO network action
across Vietnam.
No example of CSO network

relationships for research
with Universities to share with
others before project.
Not yet any learning material distribution as exemplary for

others in Vietnam. CARE VN and partners planned to organize
sharing event and disseminate learning materials to others in
April, 2016.
The National Assembly

Committee on Ethnic Minority
Affairs promotes advocacy
messages and/or
developed under this Action.

because advocacy messages
and/or demonstration models
developed under this Action
were not available before
project.
The Committee for Ethnic Minority Affairs (CEMA) promoted

advocacy plan proposed by NorthNet and collaborated with
NorthNet and PPWG to support implementation. The advocacy
process (on Law of information access) was not finished at the
end of the project.
27

evaluation report.
Documents/materials
evaluation report. Materials
evaluation report.
Documents/materials
Intervention logic
Specific Objectives:
Strengthened
institutional capacity
of civil society
networks to poverty
reduction and health
equity for ethnic
minorities through
strategic policy
dialogue
Minimum 10000 EM people in
the two target districts benefit
directly from local level
network activities including the
demonstration models (i.e.
improved access to poverty
reduction program benefits and
reproductive health services)
Influential EM individuals have
joined the CSO network
members to assist in addressing
poverty and health issues

because the network activities
and demonstration models
were not available before the
project.

districts benefited directly from local level network activities
including the demonstration models (about 7700 people in
three communes in Bao Lac, more than 20,000 people of 3
communes in Que Phong and estimated more than 20,000
people in other communes in Que Phong benefited from
replication of communication packet on health equity).

local partners, network
members, local authorities
and beneficiaries.
Project reports
Midterm evaluation report.

No Influential EM individuals
have joined the CSO network
members
to
assist
in
addressing poverty and health
issues
No EM individual formally joined the NorthNet and PAHE

network or other CSO members. However, both DECEN and
CCIHP
has built strong relationship with 76 EM
representatives in Bao Lac and Que Phong and the two
network planned to keep communication and information
exchange with them even after the project to address poverty
and health issues.

and beneficiaries.
Project reports

Targeted Peoples Councils
have shifted their practice in
line with at least one of the
strategic network advocacy
initiatives

because the strategic network
advocacy initiatives were not
available before the project.
Targeted Peoples Councils (at commune and district levels)

have already shifted their practice including provision of
information needed for EM on poverty reduction (in Bao Lac)
and practical application of participatory monitoring maternal
health sector in Que Phong. This is in line with advocacy
initiatives of NorthNet (improving access to information for
EM) and PAHE (improving health equity for EM).

and beneficiaries.
Project reports

Expected results 1:
Two (2) networks of
CSOs have improved
institutional capacity
At least 80% of CSO members

are more satisfied with
representation of their views by
the networks compared to
baseline
Coordination
and
representation
in
the
networks are scored at below
average (less than 10/25
point) in both network's
90% of NorthNet and PAHE members satisfied with

representation of their view. Coordination and representation
in two networks were scored at high level (18.75/25 point) at
the end of the project.
28

network members.
Midterm evaluation report
Evaluation workshop records.
Intervention logic
to represent ethnic
minorities in poverty
and health issues

capacity assessments.
The documented process of
successfully strengthening CSO
networks and the advocacy
results they achieved are widely
disseminated
No documentation of the
advocacy work was made by
both networks.
Capacity development plans

have successfully supported the
implementation of the Action,
and action-learning habits have
been established in the
network
The 17 organizations in PAHE
and NorthNet networks
regularly share information
about their advocacy activities
and are better regarded by
their EM constituency
compared to baseline
No comprehensive capacity
development
plan
was
available in both networks.
The process of successfully strengthening CSO networks and

the advocacy results they achieved were documented
disseminated late at the end of the project.
Capacity development plans have successfully supported the

implementation of the Action, and action-learning habits have
been established in the networks.
The two networks now

included 17 members working
together in their joint
advocacy
efforts.
Two
network did not reach out to
their EM constituency in the
name of the network, but in
their individual capacity. The
two organisations which
conducted the demonstration
are well recognised by local
people and authorities14.
The 12 organizations of NorthNet and 5 organizations of PAHE

networks regularly shared information about their advocacy
activities. But limited information sharing between the two
networks. Both two organisations (DECEND and CCIHP) who
responsible for implementation models in Quy Phong and Bao
Lac are better regarded and well recognised by local EM
constituency.
Achieved the target indicator, assumption based on
observation in Bao Lac and Que Phong regarding to CSOs were
15
better regarded by their EM constituency .
14

evaluation report.
Documents/materials
evaluation report.
Networks documents.
evaluation report.
Networks documents.
Note that no baseline information for this indicator. This information comes from the Mid-term evaluation.
Due to limitation of time and resource, the final evaluation team only visited Bao Lac and Que Phong sites, no visit was conducted to other operational areas of all NorthNet and PAHE members to
observe their EM constituencys assessment.
15
29
Intervention logic
Expected results 2:
Two (2) networks of
CSOs implement
strategic advocacy
plans and engage in
policy dialogue with
government
stakeholders in target
sectors
Advocacy messages are based
on identification and analysis of
policy and public investments
programs in the target sectors
which are relevant to ethnic
minority constituencies
Both networks have no

specific advocacy messages
developed.
Advocacy messages were developed by NorthNet on

promoting EMs indigenous knowledge and EM access to
information on poverty reduction and by PAHE on health
equity for EM women. The messages were developed based
on identification and analysis of policy and public investments
programs through 4 action researches that reflected
respiration of ethnic minority constituencies.

evaluation report.
Networks documents.

Network advocacy plans
updated each year based on
member progress,
achievements and lessons
No advocacy
available.
plan
was
17 CSOs have developed,

planned and implemented
advocacy activities in line with a
strategic advocacy plan of the
network to raise EM voice in
poverty reduction and health
equity
North Net had 9 members

working
the
northern
mountains with various EMrelated issues; PAHE had 5
members committed to work
on health equity advocacy.
Peoples Councils have invited

CSOs as representatives of
ethnic minorities to at least 2
consultation meetings for
planning, program and policy
development.
People's Councils in Que

Phong and Bao Lac did not
have much information on
CSOs of the two networks.
PAHE and NorthNet discussed and updated their plan every

network meetings (quarterly) based on progress,
achievements and lessons.
17 CSO members of two networks have developed, planned
and implemented advocacy activities in line with a strategic
advocacy plan of the network to raise EM voice in poverty
reduction and health equity.

evaluation report.
evaluation report.
Networks documents.
No strategic advocacy plans of

the networks was available.
Both PCCs in Que Phong and Bao Lac are highly appreciated
DECEN and CCIHP and they were invited to support replication
of Bao Lac/Que Phong models
30

partners, local PCCs, network
members.
evaluation report.
Networks documents.
Intervention logic
Expected results 3:
Research and
documentation of
good practice in target
sectors is used as
evidence for policy
advocacy
Expected results 4:
Two (2) small-scale
for improving local
governance and
participation of ethnic
minorities in decision
making are
implemented and
documented
At least 4 research topics are
identified, developed into a
methodology, implemented
and documented of which two
in year one
At least 4 research activities
have been completed in
collaboration with
consultants/Universities, and
findings have been used to
forge effective advocacy
messages
The results of at least 4
research exercise are
members and used as
supporting evidence for a
strategic advocacy initiative
EM report change in attitude of
60 leaders, staff and members
from 6 commune Peoples
Councils and mass
organizations
Bao Lac: 3 EM Forums in Bao

Lac agree bi-annually on
practical results for EM of key
government poverty reduction
No research topics are

identified by the networks.
4 research topics are identified, developed into a

methodology, implemented by NorthNet and PAHE and results
were documented in year two and year three.
No research activity has been

completed by the networks.
4 research activities have been completed in collaboration

with Thai Nguyen and Hanoi Medical Universities, and findings
have been used to forge effective advocacy messages.
No research results from the

networks
has
been
members.
The results of at least 4 research exercise are disseminated

among network members and used as supporting evidence for
a strategic advocacy initiative
Leaders, staff and members

from district and 6 commune
Peoples Councils and mass
organizations were limitedly
aware of the importance of
peoples voice in participatory
approach
monitoring
investment program.
Great change obtained in attitude and practice of more than

70 leaders, staff and members from district and 6 commune
Peoples Councils and mass organizations on the importance of
EM peoples voice in participatory approach monitoring
investment program, health services and LCC system.
No such feedback mechanism

existed.
3 EM forums in Bao Lac agreed annually on practical results for

EM of key government poverty reduction programs.

evaluation report.
Networks documents.
evaluation report.
Networks documents.

evaluation report.
Networks documents.
Interview project staff, local

authorities, network members
and beneficiaries.
31

partners, local authorities,
network members.
Intervention logic
programs
Bao Lac: Commune Monitoring

Boards follow progress with biannually agreed results for EM
of key government poverty
reduction programs, and take
action towards relevant
authorities when delays are
noticed
Bao Lac: PC discuss
institutionalization (resource
allocation) of EM Forum and
CBM in year 3
No such feedback mechanism

existed.
While CMB seemed not a visible institution in the commune,

the members of Commune People's Committee and People
Council as well as random commune staff follow progress with
annually agreed results for EM of key government poverty
reduction programs, and take action towards relevant
authorities when delays are noticed.

network members.
evaluation report.

EM forum not available
before the project for
discussion.
District and Commune People Councils in Bao Lac already

asked for support replication and institutionalization of EM
Forum in Year 3. EM forum in 3 project commune initially
institutionalized in PCC, fatherland front system.
Que Phong: The health equity

framework has helped to
identify key barriers to access
health services in 3 Que Phong
communes in year 1
collaborate with PHAE to
overcome barriers to access

evaluation report.
The health equity framework

has not been used in Que
Phong to identify key barriers
to access and utilization of
reproductive health services.
The health equity framework has helped to identify key

barriers to access and utilization of reproductive health
services in 3 Que Phong communes in year 3.
Not
yet
collaboration
between District health staff
and PAHE before project
regarding to access and
utilization of reproductive
District health staff had strong collaboration with PAHE to

overcome barriers to access and utilization of reproductive
health services by EM. Great Improvement of access to
maternal health services for EM women obtained in all villages
of 3 project communes.
32

network members.
evaluation report.
network members.
evaluation report.
network members.
evaluation report.
Intervention logic
continue to present progress
with EM access and utilization
of services in district monitoring
meetings in year 3
Que Phong model on EM

services was not available
before the project.
District health staff continued to present progress with EM

access and utilization of services in district monitoring
meetings in year 3 and partly replication of Que Phong model
into all other 11 communes in Que Phong district.
33

network members.
evaluation report.
Annex 2: List of participants participated in the Evaluation

#
I
1.
2.
3.
4.
Name
CARE staff
Le Xuan Hieu
Nguyen Huu Thia
Nguyen Ngoc Trieu
Ha Thi Kim Lien
Organization Position
5.
6.
Morten Fauerby Thomsen

Elizabeth Cowan
II
7.
North-net members
Tran Van Tri
DECEND Director
8.
Hoang Thi Ngoc Anh
DECEND Staff
9.
Le Thi Hong Hiep
SUDECOM Yen Bai
10.
Trn Th Thanh Chung
SUDECOM Director
11.
Trung Yn
CMD Program Manager
12.
Bui Van Hai
CDSH Vice Director
13.
Ho Ngoc Son
ADC Director
14.
Dang Ngoc Quang
RDSC Director
15.
Nguyen Kim Trong
HADEVA- Vice Director
16.
Hoang Thi Tao
Viet Bac Director
IVEN Project manager

IVEN Project officer
M&E, Research Advisor
M&E Specialist
CARE Danmark staff
CARE VN Country
Programs Advisor
34
Remarks
Support the whole process
Participated field trip and other
events
Participated validation meeting
Participated validation meeting
Cao Bang province. Interviewed

and participated evaluation
workshop.
Cao Bang province. Interviewed
workshop.
Yen Bai province. Interviewed
workshop.
workshop.
H Giang province. Interviewed
workshop.
workshop.
Thai Nguyen province.
Interviewed and participated
evaluation workshop.
Phu Tho province. Interviewed
workshop.
Thanh Hoa province.
Bac Kan province. Interviewed
Name
17.
Dinh Thi Huyen
Tay Bac - Vice Director
III
18.
PAHE members
Tran Hung Minh
CCIHP - Director
19.
Pham Kieu Linh
CCIHP - Vice Director
20.
Tran Tien Duc
PAHE - Chairman
21.
IV
22.
Khuat Thu Hong

Bao Lac District
Nguyen Duc Tho
ISDS Director
23.
Nong Chi Kien
24.
Nguyen Tan Dat
25.
Ms. Thu
26.
Mr. Phong
27.
Ms. Phan
28.
Nong Van Qui
29.
Nong Thi Huyen
30.
Hoang Van Ngoc
31.
Cho A Kh
32.
Lng Xun Hng
33.
Bn Mi Man
34.
Ban Qui Son
35.
Nguyen I-et Truc
Bao Lac District People

Council
Bao Lac District Father
Land front
Bao Lac District Ethnic
Minority Department
Hung Dao Commune
People Council
Hung Dao Commune
People Council
Hung Dao Commune
Women Union
Village representative Hung Dao commune
Khnh Xun Commune
People Council
Village representative,
Khnh Xun Commune
Hng Thnh Commune
People Council
Hng Thnh Commune
Hung Dao Commune
People Council
35
Remarks
workshop.
Hoa Binh province. Interviewed
workshop.
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Participated evaluation
workshop.
workshop.
workshop.
workshop.
workshop.
#
36.
Name
Nng Vn Qu
Hng Do Commune
People Council
Hng o Commune.
Remarks
workshop.
workshop.
37.
Hong Van Hung
V
38.
Que Phong District

Lu Vn Hng
Interviewed
Mr. Cuong
Vi Thi Tuyet
Que Phong District People

Council
Que Phong Health Center
Chi Le Commmune Health
Center
Chi Le Commune People
Council
Chi Le Commune People
Council
Chi Le People Council
Commune Health Center
39.
40.
Ms. Chm
Y Phay
41.
Lo Thi Hoa
42.
Mr. Tuan
43.
44.
45.
L Th Lin
46.
Vo Thi Phuong
47.
48.
49.
50.
51.
52.
Vi Thi Xuyet
Vi Thi Cuc
Luong Thi Huong
Luong Thi Ngan
Luong Thi Minh
Luong Thi Tuyen
Villager, Lam village

36
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
workshop.
workshop.
workshop.
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Interviewed
Annex 3: Evaluation Process, Methodologies and Tools

1. Evaluation process
#
Main tasks
Time
Carry out desk review
January
Design protocol, data collection tools in January February 2016
January
Questionnaire information filled by partners
January
Interview CARE IVEN program/project staff in Hanoi
Interview NorthNet and PAHE members
3 February
Conduct evaluation workshop in Hanoi
4 February
Project team provide information on projects

achievement
15 February
Interview PAHE partners in Hanoi
Travel to Bao Lac and consultation/interview local

stakeholders in Bao Lac.
16-18 Feb
10
Travel to Que Phong and consultation/interview local

stakeholders in Bao Lac.
21-25 Feb
11
Process collected data and information
12
Presentation of the preliminary findings to seek

comments from the CARE team and its stakeholders
4 Mar
13
Draft the EoP evaluation report in English for

feedback/comments from CARE and project partners
11-15 Mar
14
Discussion on feedback and comments.
16 Mar
15
Finalize the EoP evaluation report, incorporating

comments and feedback in both English and
Vietnamese.
18 Mar
1-5 February
1-3 Mar
37
2. Methodologies and Tools

The following methodologies were applied:
Desk reviewed relevant documents including project documents, project progress reports, and technical reports.
Groups and individual interviews of CARE project implementation team, project partners/network members, local partners and beneficiaries
for deeper analysis based on five criteria of the evaluation. The interviews has been be conducted in form of semi-structure interview.
Participatory workshop: Conducted a participatory workshop with combined methodologies including presentation, groups discussion and
plenary analysis/discussion.
Gender sensitive in selecting interviewees and analysis.
Framework for interview and discussion as below.

Framework for interview and analysis
A. Key areas of Evaluation
(CI)
Notes: Main source (M) Cross check and Case Interview

Stakeholders Remarks
Evaluation Criteria
CARE, DECEN
CCIHP
Network
members
Local district
stakeholders
Commune
forum
members
CI
Village forum
members/
villagers
CI
Effectiveness
M
CI
CI
The extent to which the development interventions
For all the
Focus on
Focus on
Focus on
Focus on
objectives were achieved, or are expected to be achieved,
results,
Results 1-2-3,
result 4 and
result 4 and
result 4 and
taking into account their relative importance.
strategies and strategies and link to others; link to others; link to others;
Guiding Key Questions
methodologies methodologies
and
and
and
Has the project achieved its objective and four expected
methodologies methodologies methodologies
results? To what extent?
How and why the project and tools influenced the
achievement of results?
38
Evaluation Criteria
CARE, DECEN
CCIHP
Network
members
Local district
stakeholders
Commune
forum
members
Village forum
members/
villagers
Does the project fulfill the needs of the target?

Group/population?
Relevance
M
M
M
M
M
The extent to which the objectives of a development Focus on the
For all the
For all the
For all the
For all the
intervention are consistent with beneficiaries requirement,
project
results,
results,
results,
results,
country needs global priorities and partners and donors
strategies,
strategies and strategies and strategies and strategies and
policies.
methodologies methodologies methodologies methodologies methodologies
and
What are the relevance and added value of different
assumptions
project approaches and methodologies?
How much is the project aligned with donors policies
and strategies?
How much is it aligned with relevant country policies
and strategies?
How project relevance to 2 Networks vision/mission
Efficiency
M
CI
CI
CI
CI
A measure of how economically resources/inputs (funds,
Focus on
Focus on
Focus on
Focus on
Focus on
expertise, time, etc.) are converted to results
inputs,
inputs,
inputs,
inputs,
inputs,
outputs and
outputs and
outputs and
outputs and
outputs and
Are four project results achieved at an acceptable cost,
compared with alternative approaches to accomplishing
the same objectives?
Are relevant resources from the project available
according to project design and plan to ensure the
39
Evaluation Criteria
CARE, DECEN
CCIHP
Network
members
Local district
stakeholders
Commune
forum
members
Village forum
members/
villagers
Sustainability
The continuation of benefits from a development intervention
after major development assistance has been completed; the
probability of continued long-term benefits
efficiency?
Is the activity/project approach likely to continue after

donor funding? (technically and financially)
What are positive and negative factors determining the

sustainability of the project and how these factors are
addressed?
How 2 networks to be sustainable without support from

project/project ended.
For all the

Focus on
For all the
For all the
For all the
results,
Results 1-2,
results,
results,
results,
strategies and strategies and strategies and strategies and strategies and
Ensuring Sustainability: Financial Sustainability, Institutional

Sustainability, Environmental sustainability
Impact
Positive and negative, primary and secondary long term effects
produced by development intervention, directly or indirectly,
intended or unintended.
CI
What are positive and negative impacts/changes of the

40
CI
Evaluation Criteria
CARE, DECEN
CCIHP
Network
members
Commune
forum
members
Local district
stakeholders
Village forum
members/
villagers
project/ based on 4 expected results? What are most

significant changes does the project brought?
What is the attribution/contribution to achievement of

development/project goal by CARE and its partners?
With support from project, how 2 networks change

about their capacity, institution and advocacy
achievement?
Expected impact: Economic impact, Social impact, Technical

impact, Policy impact, Dissemination Plan and the Possibilities
of Replication of Outcomes
B. Summary of Designed Results, Strategies and Methodologies.
Notes: Main source (M) Cross check and Case interview (CI)
CARE, DECEN
CCIHP
Network
members
Local district
stakeholders
Commune
forum
members
Village
forum
villagers
The Overall Objective is: To contribute to a representative and capable civil society that influences
policy and practice for the benefit of poor, remote ethnic minorities in Vietnam.
CI
CI
CI
The Specific Objective is: Strengthened institutional capacity of civil society networks to ensure
poverty reduction and health equity for ethnic minorities through strategic policy dialogue.
CI
CI
CI
Expected Result 1: Two (2) networks of CSOs have improved institutional capacity to represent
ethnic minorities in poverty and health issues
CI
CI
CI
Evaluation Criteria
41
Commune
forum
members
Village
forum
villagers
CI
CI
CI
CI
CI
CI
Gender equality and social inclusion mainstreaming
CI
CI
Capacity Building
Building on Previous Efforts, Synergies with Other Initiatives
Procedures for monitoring and evaluation
Possible Risks and Their Mitigation Plan
CI
CI
CI
CI
Ensuring Visibility of the Action and that of EU
CI
CI
CI
CI
Evaluation Criteria
CARE, DECEN
CCIHP
Network
members
Local district
stakeholders
Expected Result 2: Two (2) networks of CSOs implement strategic advocacy plans and engage in
policy dialogue with government stakeholders in target sectors
CI
Expected Result 3: Research and documentation of good practice in target sectors is used as
evidence for policy advocacy
Expected Result 4: Two (2) small-scale demonstration models for improving local governance and
participation of ethnic minorities in decision making are implemented and documented
Rights-based approach
42

IVEN Final Evaluation Report en Final 18 April 2016

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

IVEN Final Evaluation Report en Final 18 April 2016

Uploaded by

Copyright:

Available Formats

IMPROVING VOICE THROUGH EFFECTIVE NETWORKS

Project Final Evaluation Report

Hanoi, March 2016

Center for Creative Initiatives in Health and Population

Committee for Ethnic Minority Affairs

Cao Bang Community Development Centre

Improving voice through effective network

Network of Northern Mountainous Civil Society Organizations for

Partnership for Action in Health Equity Network

Civil Society Organization

Ethnic Minority Women

Ethnic Minority Working Group

Socio-Economic Development Plan

Project background .................................................................................................................. 1

Evaluation objective ................................................................................................................. 3

Evaluation methodology .......................................................................................................... 4

Major findings .......................................................................................................................... 6

Lessons learnt ........................................................................................................................ 25

Recommendations and conclusions ....................................................................................... 25

Annex 1: Project Achievements against target indicators .............................................................. 27

Table and Figures

Figure 1: IVEN project desired ..................................................................................................... 3

Table 1: Key questions for the Evaluation .................................................................................... 4

Figure 1: IVEN project desired

Table 1: Key questions for the Evaluation

What are the relevance and added value of different project

How much is the project aligned with donors policies and

Is the activity/project approach likely to continue after donor

What are positive and negative impacts/changes of the project/

What are positive and negative factors determining the

What is the attribution/contribution to achievement

With support from project, how 2 networks change about their

Strong utility focus (user engagement) in planning and implementation of evaluation.

Using/building on previous studies and evaluation.

Methodology & Tools

Groups and individual interviews of CARE project implementation team, project

Participatory workshop: Conducted a participatory workshop with combined

Gender sensitive in selecting interviewees and analysis.

Figure 2: Summary of Analytical framework

Promote a meaningful and structured participation of CSOs in domestic policies: The EU

Figure 3: Local Government, People Councils and People Power relationships

Achievement at the end of the project

At least 80% of CSO members

90% of NorthNet and PAHE members satisfied

The documented process of

The process of successfully strengthening CSO

Capacity development plans

The 17 organizations in PAHE

The two networks now

Achieved the target indicator.

To be achieved the target indicator

ethnic minority such as livelihood improvement, capacity building, forest planting/protection,

We learnt a lot from IVEN project, about

Better access to information needed for their organization development.

Networking, policy analysis and advocacy planning capacity.

Methodology to work with EM and promoting EMs participation.

See explanation at the end of this section

Achievement at the end of the project

Advocacy messages are

Both networks have no

Advocacy messages were developed by

Network advocacy plans

17 CSOs have developed,