Public Disclosure Authorized

The World Bank Implementation Status & Results Report

Vietnam Enhancing Teacher Education Program (P150060)

Vietnam Enhancing Teacher Education Program (P150060)

EAST ASIA AND PACIFIC | Vietnam | Education Global Practice | Requesting Unit: EACVF | Responsible Unit: HEAED
IBRD/IDA | Program-for-Results Financing | FY 2016 | Team Leader(s): Dung Kieu Vo

Seq No: 9 | ARCHIVED on 05-Mar-2021 | ISR45369 | Created by: Hanh Minh Bui on 19-Jan-2021 | Modified by: Dung Kieu Vo on 05-Mar-2021

Program Development Objectives

Public Disclosure Authorized

PDO Table
Program Development Objective (from Program Appraisal Document)
The project development objective is to strengthen teacher training institutions to enhance teacher and principal effectiveness through improved
continuous professional development.

Overall Ratings

Name Previous Rating Current Rating

Progress towards achievement of PDO Moderately Unsatisfactory Moderately Unsatisfactory

Overall Implementation Progress (IP) Moderately Unsatisfactory Moderately Unsatisfactory
Public Disclosure Authorized

Implementation Status and Key Decisions

Program implementation has advanced significantly over the last six months because of progress evidenced by: (i) efforts dedicated by the Ministry
of Education and Training (MOET) and its Program Management Unit (PMU) in implementing remedial actions agreed in the June 2020 mission,
and (ii) enhanced Ministry's ownership of the program with hands-on supervision by the Vice Minister and improved implementation capacity at both
the PMU and the Lead Teacher Training Universities (LTTUs). Specifically, all the LTTUs have fully achieved the 2020 committed Teacher
Education Institution Development Index (TEIDI) scores, 90 percent of teachers and school principals rated Satisfied for school-based continuous
professional development (CPD) support in 2020, and the program disbursement has nearly doubled.
However, the critical challenge as the program advances is to fully achieve the results during the limited time that remains in the program. Intensive
supervision and coordination with provinces by MOET, PMU, and LTTUs on CPD implementation will be instrumental. The Ministry has agreed to
guide provinces and the LTTUs during the national CPD roll-out to ensure consistent performance and full results. In parallel, the LTTUs will further
expedite its capacity development activities to achieve the much more challenging end-line targets and strengthen support to teachers and
principals during the on-line training.
The Bank will continue intensive support to the program implementation at both central and provincial levels.

Data on Financial Performance

Public Disclosure Authorized

Disbursements (by loan)

Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed

P150060 IDA-58780 Effective USD 95.00 95.00 0.00 38.84 58.32 40%

Key Dates (by loan)

Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date

P150060 IDA-58780 Effective 29-Jun-2016 06-Feb-2017 05-Jun-2017 30-Jun-2022 30-Jun-2022

3/5/2021 Page 1 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

DLI Disbursement

Achievement Disbursed amount in Disbursement % for

DLI ID DLI Type Description Coc DLI Amount
Status Coc DLI

Loan: IDA58780-001

DLI2 Regular SYSTEMS ARE IN PLACE XDR 12,860,000.00 Not Achieved 0.00

NO OF CORE TEACHERS
DLI3 Regular XDR 15,670,000.00 Not Achieved 0.00
SELECTED N TRAINED
NO OF CORE TEACHERS
DLI4 Regular XDR 10,010,000.00 Not Achieved 0.00
PROVDING SBCPD
NO OF TEACHERS
DLI5 Regular XDR 10,000,000.00 Not Achieved 0.00
SATISFIED WITH ITC
INSTITUTIONAL Partially
DLI1 Regular XDR 19,260,000.00 10,700,000.00 56 %
CAPACITY OF LTTU Achieved

Program Action Plan

The Recipient shall develop and execute a Capacity Building Plan for the LTTUs to ensure sustainable provision of
Action Description teacher school based continuous professional development support, all in form and substance satisfactory to the
Association.

Source DLI# Responsibility Timing Timing Value Status

Technical Client Due Date 05-Jun-2018 In Progress

Completion Measurement A Capacity Building Plan developed, costed and executed (in cooperation with LTTUs)

Comments The capacity building plan was developed, costed and is being executed in cooperation with LTTUs

The Recipient shall carry out a study – under the terms of reference acceptable to the Association - to identify options
Action Description
and recommendations for financing teacher- continuous professional development.

Source DLI# Responsibility Timing Timing Value Status

Technical Client Due Date 30-Jun-2020 Delayed

Completion Measurement Study validated by MOET

The PMU has advanced this action recently since a consultant was hired to develop the TOR agreed with the Bank in
Comments
December 2020. The TA was agreed to commence in April and complete in December 2021.

The Recipient shall disclose information on the Program’s activities to the public, including financial information
Action Description
throughout the implementation of the Program.

Source DLI# Responsibility Timing Timing Value Status

Other Client Recurrent Continuous In Progress

Completion Measurement Evidence of information disclosure

3/5/2021 Page 2 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

Information on the Program’s activities, including financial information, is disclosed to the public via the ETEP website
Comments and LTTUs' ETEP websites and updated frequently. Information has also been disclosed via consultation meetings
with stakeholders

The Recipient shall maintain a system of receiving, recording and following-up on complaints, including anonymous
Action Description
ones.

Source DLI# Responsibility Timing Timing Value Status

Other Client Recurrent Yearly In Progress

Completion Measurement Log of complaints and reports

No complaints have been received so far. Besides channels established by ETEP PMU and LTTUs, MOET also
Comments
deploys a software to house complaints and denunciations, including those relating to ETEP.

The Recipient shall maintain a database on complaints and denunciations from all the participating agencies and
Action Description
follows up on the resolution of those complaints and denunciations.

Source DLI# Responsibility Timing Timing Value Status

Other Client Recurrent Yearly In Progress

Completion Measurement Database verified

MOET is in charge of maintaining the database. PMU receives every six months LTTUs' reports on complaints and
Comments
denunciations received and consolidates and reports such complaints and denunciations to the Bank/ MOET.

The Recipient shall (a) review LTTUs internal audit capacity; and (b) prepare and execute – or cause to be executed -
Action Description
plans to build the capacity of internal audit function in LTTUs.

Source DLI# Responsibility Timing Timing Value Status

Fiduciary Systems Client Due Date 05-Jun-2019 Delayed

Internal audit capacity assessed and LTTUs capacity building plans developed, costed, approved and executed (in
Completion Measurement
cooperation with LTTUs).

The LTTUs’ internal audit capacity was reviewed, the roadmap of building capacity of internal audit function in the
Comments ETEP PMU and all the LTTUs have been developed and adopted by the LTTUs but the execution of the roadmap has
not started.

Action Description The Recipient shall issue guidance on the performance based budgeting/allocation

Source DLI# Responsibility Timing Timing Value Status

Other Client Recurrent Continuous Completed

Completion Measurement Guidance on the performance based budgeting/ allocation was issued by MOET.

Comments The action was completed. Guidance was issued in POM and Performance Agreement.

3/5/2021 Page 3 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

All proposals for detailed designs, construction supervision and bids for civil works, whether below or above cost
Action Description estimates, shall be evaluated; proposals and bids shall not be rejected only on the basis of minor, non-substantive
deviations.

Source DLI# Responsibility Timing Timing Value Status

Fiduciary Systems Client Recurrent Continuous Completed

Completion Measurement n/a

Comments Compliant as noted in January 2021 Implementation Support Mission.

The Recipient shall design and adopt a mechanism – satisfactory to the Association - to coordinate teacher
Action Description continuous professional development initiatives and activities among teacher education providers and concerned
teacher management department

Source DLI# Responsibility Timing Timing Value Status

Technical Client Due Date 05-Jun-2018 Completed

Issuance of a circular on teacher continuous professional development which includes the regulated coordination
Completion Measurement
mechanism.

Comments Circular 19/2019/TT-BGDDT was issued on November 12, 2019.

At least 60 percent of contracts for consultancies and 85 percent of contracts for works shall be competitively bid
Action Description
annually.

Source DLI# Responsibility Timing Timing Value Status

Fiduciary Systems Client Recurrent Continuous In Progress

Completion Measurement n/a

Comments Compliant, as noted in the January 2021 Implementation Support Mission.

No contract having cost estimate above the thresholds for using DC/SSS method set forth in the national public
Action Description
procurement law and regulation will be awarded on DC/SSS basis.

Source DLI# Responsibility Timing Timing Value Status

Fiduciary Systems Client Recurrent Continuous In Progress

Completion Measurement n/a

Comments Compliant, as noted in January 2021 Implementation Support Mission.

Action Description Firms on the local, national, or Bank debarment list shall not be allowed to participate.

Source DLI# Responsibility Timing Timing Value Status

3/5/2021 Page 4 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

Fiduciary Systems Client Recurrent Continuous In Progress

Completion Measurement n/a

Comments Compliant, as noted in the June 2020 Implementation Support Mission.

The Recipient shall develop a guideline to facilitate meaningful consultation and inform participation of beneficiary
Action Description
principals and teachers, including those from ethnic minorities and vulnerable groups.

Source DLI# Responsibility Timing Timing Value Status

Environmental and Social

Client Due Date 05-Jun-2018 Completed
Systems

Completion Measurement Formal issuance of the guideline

Comments The guideline was formally issued in November 2018.

The above referenced guideline, which will be implemented by LTTUs should fully operationalize the existing
Action Description
Vietnamese legislation with respect to ethnic minorities through a process of free, prior, and informed consultations.

Source DLI# Responsibility Timing Timing Value Status

Environmental and Social

Client Due Date 05-Jun-2018 In Progress
Systems

Completion Measurement n/a

Comments No significant issue was noted in the reporting period.

Action Description The Recipient will prepare an Operational Manual.

Source DLI# Responsibility Timing Timing Value Status

Technical Client Due Date 05-Jun-2017 Completed

Completion Measurement OM agreed by the Bank

Comments This action was completed. The POM will be updated once the program restructuring is completed in March 2021

Action Description The Recipient will execute the Operation according to the Manual.

Source DLI# Responsibility Timing Timing Value Status

Technical Client Recurrent Continuous In Progress

Completion Measurement Implementation Support Missions will review implementation quality

Comments Program is being implemented according to the Operation Manual.

3/5/2021 Page 5 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

Risks

Systematic Operations Risk-rating Tool

Risk Category Rating at Approval Previous Rating Current Rating

Political and Governance -- Low Low

Macroeconomic -- Low Low
Sector Strategies and Policies -- Low Low
Technical Design of Project or Program -- Substantial Moderate
Institutional Capacity for Implementation and
-- Moderate Moderate
Sustainability
Fiduciary -- Moderate Substantial
Environment and Social -- Low Low
Stakeholders -- Low Low
Other -- Moderate --
Overall -- Moderate Moderate

RiskComments
Comments
Fiduciary risk is revised from Moderate to Substantial due to the rating of financial management risk as Substantial, given the following risks:
1. Budget may not be timely and adequately allocated to the program.
2. DLI verification may be delayed, resulting in delayed disbursement.
Program technical design risk is revised from Substantial to Moderate because:
1. Policies have been adopted to guide the coordination required among stakeholders to provide continuous professional development (CPD)
support for teachers.
2. Institutional and implementation arrangement is conducive to policy implementation, which is evident in positive progress towards achieving the
program results.
3. Provinces have mobilized budget to finance the on-line part of the CPD support, which will sustain after the program ends.

Results

PDO Indicators by Objectives / Outcomes

Strengthened teacher education institutions to enhance teacher and principal effectiveness

IN00949809
►Improved performance of the eight Lead Teacher Training Universities to provide CPD as measured by the Teacher Education Institutional
Development Index (Text, Custom)

Baseline Actual (Previous) Actual (Current) End Target

18%-39% increase over
the baseline in 2019
TEIDI score for all
Baseline established for
Value LTTUs, as verified by the
each LTTU
Independent Verification
of LTTUs' 2019 TEIDI
self-assessment reports.
Date 31-Dec-2017 19-Jun-2020
30-59% increase over
15% increase over the
the baseline in 2017, as
baseline in TEIDI
self-assessed by the
score for each LTTU
LTTUs
05-Feb-2021 30-Jun-2022

3/5/2021 Page 6 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

Achieved (75 percent)

The current program end target has already been met by the six LTTUs who continue to receive the
capacity development investment as agreed with the Government in the program restructuring.
There is no result target set for 2020, but all six LTTUs achieved the TEIDI self-assessment scores as
committed in the Performance Agreements. Specific scores by each LTTU: Hanoi LTTU 4.7; Thai Nguyen
Comments
LTTU 4.8; Vinh LTTU: 4.2; Hue LTTU: 4.84; Danang LTTU 4.87; HCMC LTTU: 4.93. The result is yet to be
verified by IVA.
The revised target for this indicator resulting from the program restructuring might not be fully met unless the
LTTUs further expedite their capacity development activities in 2021.
IN00949810
►Number of teachers and principals satisfied with school-based continuous professional development (Number, Custom)

Baseline Actual (Previous) Actual (Current) End Target

Value 0.00 0.00 289,661.00 480,000.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 30-Jun-2022

Achieved (90 percent).
Out of the 359,000 teachers/ principles/ core teachers and principal advisors who took part in the
satisfaction survey on the school based CPD in 2020, 289,661 (or 90 percent) rated Satisfactory vs. 2020
Comments
target 320,000.
The result is yet to be verified by IVA.

Intermediate Results Indicators by Results Areas

Improved capacity of Lead Teacher Training Universities to enhance teacher and principal effectiveness
IN00949941
►Number of LTTUs that sign Performance Agreements with MOET. (Number, Custom)

Baseline Actual (Previous) Actual (Current) End Target

Value 0.00 8.00 8.00 8.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 30-Jun-2022

Comments

Development of teacher and principal training needs assessment system to informed CPD program development
IN00949942
►Number of TEMIS-generated annual reports on CPD needs by DOET. (Number, Custom)

Baseline Actual (Previous) Actual (Current) End Target

Value 0.00 0.00 0.00 45.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 30-Jun-2022

Not achieved
Late guidance on reports using TEMIS has given the provinces less time to enter the teacher performance
assessment data and related verification. Accordingly, no report has been produced by February 5, 2021.
Comments
The 2020 data is being generated using a privately owned TEMIS. The Ministry in-house TEMIS is expected
to be developed, tested, and run by October 2021.

3/5/2021 Page 7 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

School-based and continuous professional development for teachers and principals

IN00949943
►Number of deployed Core Teachers and/or Principal Advisors having completed six or more priority trainin modules (Number, Custom)

Baseline Actual (Previous) Actual (Current) End Target

Value 0.00 0.00 28,036.00 28,600.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 30-Jun-2022

Partially achieved (68 percent).
28,036 core teachers and principal advisors have completed modules 1, 2, and 3 vs. 2020 targets of 20,700
Comments core teachers and principal advisors having completed six modules.
The result is yet to be verified by IVA.

Teachers and principals have access to CPD programs and resources through a ICT based system
IN00949944
►Number of teachers completing all online modules of the CPD program for the new curriculum through the LMS. (Number, Custom)

Baseline Actual (Previous) Actual (Current) End Target

Value 0.00 0.00 194,429.00 640,000.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 30-Jun-2022

Not achieved (16 percent).
194,429 teachers/ principals have completed modules 1, and 2 vs. 2020 target of 480,000 teachers and
school principals have completed all online modules of the CPD program for the new curriculum through the
Comments
Learning Management System LMS.
The result is yet to be verified by IVA.

Disbursement Linked Indicators

DLI_IND_TABLE
►DLI 1 Performance Agreements are signed with the MOET by all eight LTTUs. The PAs include actions that will enhance LTTU institutional
capacity to meet TEIDI targets and that will contribute to meeting DLIs (Output, 27,000,000.00, 100%)

From January to
Baseline Actual (Previous) Actual (Current) December 2021

Value 0.00 8.00 6.00 8.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 --

Achieved (75 percent).
Six out of eight LTTUs have conducted annual TEIDI self-assessments, and the MOET has published the
TEIDI scores on its websites. The TEIDI self -assessments reports are yet to be verified by IVA.
Comments
The number of self-assessment reports has been reduced to 6 as agreed with the Government to reduce the
program scope to realistic activities towards the program closure.

►DLI 2 Systems are in place to: (i) measure whether teachers and principals meet new professional standards; (ii) track and record
evaluations of CPD programs; and (iii) record assessments CPD needs of teach (Output, 18,000,000.00, 0%)

From January to
Baseline Actual (Previous) Actual (Current) December 2021

3/5/2021 Page 8 of 9
 The World Bank Implementation Status & Results Report
Vietnam Enhancing Teacher Education Program (P150060)

Value 0.00 0.00 0.00 45.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 --

Not achieved.
A privately owned TEMIS is in place to report the level of achievement of teachers' new professional standards
and continuous professional development needs. 2020 reports are being generated and released in the first
quarter of 2021, given the delayed guidance on the reporting issued by the Ministry of Education and Training.
Comments
The DLI will be verified in April/May 2021.

►DLI 3 LTTUs train 25,000 Core Teachers and 3,600 Principal Advisors to provide face-to-face school-based CPD to teachers and
principals. (Output, 22,000,000.00, 0%)

From January to
Baseline Actual (Previous) Actual (Current) December 2021

Value 0.00 30,984.00 28,036.00 28,600.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 --

Achieved (98 percent).
24,014 core teachers and 4,022 principal advisors have been trained on modules 1, 2, and 3. The result is yet
Comments
to be verified by IVA.

►DLI 4 25,000 Core Teachers and 3,600 Principal Advisors provide face to-face school-based continuous professional development to
teachers and principals every year. (Output, 14,000,000.00, 0%)

From January to
Baseline Actual (Previous) Actual (Current) December 2021

Value 0.00 0.00 1,659.00 28,600.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 --

Not achieved.
Only 1,515 core teachers and 144 principal advisors have provided school-based CPD to teachers and
Comments
principals vs. the 2020 target of 20,700. The result is yet to be verified by IVA.

►DLI 5 Up to 480,000 teachers and principals are satisfied with their access to ICT-based interactive CPD services every year. (Output,
14,000,000.00, 0%)

From January to
Baseline Actual (Previous) Actual (Current) December 2021

Value 0.00 0.00 289,661.00 480,000.00

Date 30-Jun-2016 19-Jun-2020 05-Feb-2021 --

Achieved (90 percent)
289,661 teachers and principals are satisfied with ICT-based interactive CPD services provided under the
Comments
program vs. 2020 target of 320,000. The result is yet to be verified by IVA.

3/5/2021 Page 9 of 9