Download as pdf or txt
Download as pdf or txt
You are on page 1of 24

Public Disclosure Authorized

INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES


Public Disclosure Authorized

KNOWLEDGE
PACK
Public Disclosure Authorized

EMIS 2.0 : Learning And


Accountability System
Public Disclosure Authorized

Architecture (LASA)

EXPLORE
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

KNOWLEDGE PACK
EMIS 2.0
© 2022 International Bank for Reconstruction and Development / The World Bank
1818 H Street NW, Washington, DC 20433
Telephone: 202-473-1000; Internet: www.worldbank.org
INDEX
INTRODUCTION
License: Creative Commons Attribution CC BY 3.0 IGO

This work is a product of the staff of The World Bank with external contributions. The findings, interpretations,
and conclusions expressed in this work do not necessarily reflect the views of The World Bank, its Board of Motivations
Executive Directors, or the governments they represent. This report was also supported with funding from the WHO WHY Objectives
Global Partnership for Education.

The World Bank does not guarantee the accuracy of the data included in this work. The boundaries, colors,
denominations, and other information shown on any map in this work do not imply any judgment on the Core concept
part of The World Bank concerning the legal status of any territory or the endorsement or acceptance of such EMIS 1.0 and 2.0
boundaries.
Data in education WHAT HOW Time to implement
Some references may appear in this Knowledge Pack to Logos, Products, Brands or Trademarks belonging to Roadmap
EMIS core policy areas
others not affiliated with the World Bank. They belong to their respective owners/ holders and are used for Challenges
illustrative purposes only and do not imply any affiliation with or endorsement by them. The World Bank does
not endorse, prefer or recommend any of these products.
CONCLUSION
Rights and Permissions

The material in this work is subject to copyright. Because The World Bank encourages dissemination of its
TO GO FURTHER
knowledge, this work may be reproduced, in whole or in part, for noncommercial purposes as long as full
attribution to this work is given.
ANNEXES
Glossary
Please cite the work as follows: EdTech Team. 2022. Knowledge Pack : EMIS 2.0 Learning and Accountability
System Architecture (LASA). Washington, D.C.: World Bank Group

Any queries on rights and licenses, including subsidiary rights, should be addressed to World Bank
Publications, The World Bank Group, 1818 H Street NW, Washington, DC 20433, USA; fax: 202-522-2625;
Acknowledgment: The EdTech team wants to thank Agatha Mutheu Gikunda and Joao Pedro Wagner
e-mail: pubrights@worldbank.org
De Azevedo for their great contributions to this KP.
Design : Alejandro Scaff, Sarah Kleinmann
2
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Introduction

What is a KP? About this KP

Knowledge Packages (KPs) are short, EMIS 2.0 is part of a broader EdTech
pragmatic guides on individual topics Program Framework and should always be
within EdTech, meant to provide considered an element of the solution that
sufficient knowledge and understanding includes adequate software, incentives,
so that non-technical stakeholders policies and training.
can make key planning, design, and
This KP focuses on
procurement decisions for education.
• Education Management Information
They can be used as a starting point for Systems (EMIS Systems)
the planning of technology deployment
to improve education, especially with • Enterprise Architecture planning and
education ministries. deployment.
• Data Collection, Quality and Analytics

3
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Introduction

The EMIS 2.0 Learning and Accountability System when the focus is on siloed applications, lots of redundant
Architecture (LASA) Knowledge Pack focuses on guiding ‘innovations’, incongruent data management and archaic
Ministries of Education as they commit to a continuous business processes.
school improvement process that leverages data and
technology, to inform decision-making, which results in
positive outcomes for learners.

The Knowledge Pack presents examples of the problems


faced in various Ministries of Education with respect to
data and technology usage and suggests policy options and
strategies that have been found useful in such situations.

EMIS 2.0 responds to the idea of supporting and


strengthening ‘systems’, rather than further supporting
fragmented efforts of data collection and analytics- which
is far too common and worsens the disconnected decision
making even further. We know that fragmentation occurs

4
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

WHO are the main stakeholders ?

TARGET AUDIENCE FOR THIS KNOWLEDGE PACK

This Knowledge Pack is intended to be useful for any group To illustrate key ideas and recommendations, the Knowledge
or individual with a stake in education and assumes as Pack includes examples of the transformation enabled by the
its primary audience Ministry leadership tasked with effective generation and use of data.
collection and analysis of data for
The identification of specific programs or products in these
accountability and compliance examples is to provide a clearer understanding of innovative
ideas and is not meant as an endorsement.
instruction and learning management

reporting

This Knowledge pack guides stakeholders through the


processes and provides practical steps to drive the
generation and usage of the right educational data at the
right time.

5
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

HOW Motivations | Objectives


WHY is this KP designed ?

MOTIVATIONS : WHY IS THIS OF IMPORTANCE?

Despite all the activity within concern –in most countries there were Many countries have reported an
ministries of education, the capacity no established data governance inability to effectively use data
to produce data vastly outstrips policies in place stipulating how data collected, since the data is not
ability to use it. From research and was stored, managed, modified or mapped to Unique Identifiers
reviews into EMIS activities since 1998, accessed. – The linking of Identities within
there are dozens examples of projects the education system is a critical
improving data collection but failing Lack of inter-operability between implementation component that can
to improve data usage and student Software Applications that produce enable the monitoring and tracking of
outcomes. and consume data across Education the performance of students, teachers,
Agencies has also been highlighted as and management of schools.
Using data can make a significant a significant challenge in maintaining
difference in schools continuous the integrity of the collected data in
improvement efforts, as data enables traditional EMIS systems.
a clear understanding of the gaps
between where the schools are and Whilst many ministries of education
where the schools want to be. gather data, there are typically an
insufficient number of stakeholders
Inconsistency of data across the adequately trained in data quality
various departments (assessments, management and analysis to support
learning management, enrolment) has the usage of this data.
been noted as an area of significant
6
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

HOW Motivations | Objectives


WHY is this KP designed ?

OBJECTIVES OF EMIS 2.0

In order to drive a shift within the is to empower Education Agencies by


Ministry of Education from being an providing them with
efficient generator and collector
of data to an organization that • Best practices and clear processes EMIS2.0 is a broad architecture
translates data into information that • Tools blueprints and checklists that needs to be custom built
guides improvement, a broad effort based on existing legacy systems
and a clear, shared vision is required. that enable them to deploy technology and processes (whether analog
enabled solutions that drive educational or digital or both) as well as
A properly implemented EMIS system objectives with cost-efficiency, reducing the culture and org structure
will ensure that All educators and duplicative expenditures and achieving in place. This Knowledge Pack
policy makers have easy access to better return on investments. is a guide designed to inform
information and knowledge to make technical design for countries,
important decisions that continually based on what already exists
improve teaching and learning across
in-country, what the countries
the country.
vision and ambitions are, and
Once implemented, the EMIS system
should create a Virtuous Cycle of what the country can afford to
data production and data usage that procure and maintain – both cost
drives informed decision making in the and quality.
Ministry of Education.
The Vision of EMIS 2.0 Knowledge Pack
7
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

CORE CONCEPT

An EMIS is

“a system for the collection, integration, processing,


maintenance and dissemination of data and information
to support decision-making, policy-analysis and
formulation, planning, monitoring and management at
all levels of an education system.”

(UNESCO, 2008: 101)

8
Note: For the purpose of this guidebook, the focus is on K-12 Education
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

EMIS 1.0 AND 2.0 Reports


Database
WHAT DOES TRADITIONAL EMIS (AKA EMIS 1.0) PROVIDE?
Governments

Traditional EMIS implementations in most countries are


typically setup as below: Student Information

Key activities involve the periodic one-way transfer Mainly demographic data is collected (gender
of student information from schools to the central and age, enrollment and drop-out rates, some
government, without any feedback loops back to assessment data, and student population
the school. numbers).
1 2

3 4
Data is typically collected manually on paper The data is collected for reporting purposes, and
and transferred to the school system or central there are no analytics or early warning systems
government office, where it is added to the EMIS incorporated into the system to guide decision
database. making and improve student outcomes.

Which results in below average results for the Ministry of Education investment (Source: World Bank EMIS Lessons Learned).
9
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

EMIS 1.0 AND 2.0


WHAT IS THE DIFFERENCE BETWEEN EMIS 1.0 AND EMIS 2.0 ?

10
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

EMIS 1.0 AND 2.0


EMIS 2.0 : END STATE TARGET CAPABILITIES VISUAL ARCHITECTURE

Virtuous Cycle of Data Generation, Consumption and Feedback to inform decisions and drive outcomes
11
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

DATA IN EDUCATION
WHAT IS DATA IN EDUCATION?

Education data is broad and typically When the 4 categories of data are used
DEMOGRAPHICS Data
includes information from multiple together, they can effectively provide
sources to support students and Ministries of Education the information
manage schools. they need to improve student
performance.
There are 4 major categories of data
SCHOOL
that Ministries of Education need to
Processes/
consider collecting, analyzing, and Program PERCEPTIONS
utilizing for decision making: Data Data

1. Demographic Data
2. Perceptions Data (Values and beliefs
of parents, students, and teachers)
3. Student Learning (Assessment Data) STUDENT Learning
4. School Programs and Processes Data
Data.

12
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?
Do students of different ethnicities perceive
DATA IN EDUCATION
• County/District the learning environment differently, and
INTERSECTION OF MULTIPLE • Gender, Drop Out Rates do they score differently on standardized
• Grade Level, Attendance achievement tests in patterns consistent with
MEASURES OF DATA
these perceptions?
• Special Needs, Ethnicity

4.0 1.0
If all subgroups of students are Are groups of Students
represented in the different DEMOGRAPHICS Data
Experiencing Schools
programs offered by the school. Differently?

4 1
• Perceptions of the Learning
• Curriculum SCHOOL
Environment by teachers,
Processes/
• Policies Program ? PERCEPTIONS
parents, learners
• Procedures and Practices Data
Data • Values and Beliefs
3 2

3.0 2.0
What Programs are most What is the Relationship
STUDENT Learning
effective in improving Student Data Between Perceptions and
outcomes? Student Outcomes?

• Assessments
• Teacher Observations
13
Adapted from: Bernhardt, V. L. (2004). Data Analysis for Continuous School Improvement.
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

DATA IN EDUCATION
ASPECTS OF DATA MANAGEMENT UNDER CONSIDERATION IN THIS KP

14
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

DATA IN EDUCATION
THEORY OF CHANGE : DATA AS A LEVER FOR CHANGE
OUTCOMES

The theory of change behind EMIS2.0 design is that a


system implemented using this framework should lead
to a more Robust Culture of Data Use and Results such
as:

1. Improved learning outcomes due to analysis of


assessments and feedback loop between data
generators and consumers.
Levers of
change :
2. Improved Educator Performance due to analysis
of teacher outcomes and feedback loop between
leadership and instructors.

3. Good Management Practices and Satisfaction of


Stakeholders.

4. Reduced IT Total Cost of Ownership within Ministries


of Education due to implementation of interoperable
well governed systems.
15
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Core concept | EMIS 1.0 and 2.0 | Data in education | EMIS core policy areas
HOW
WHAT are the potential solutions?

EMIS CORE POLICY AREAS


4 CRITICAL BUILDING BLOCKS REQUIRED FOR SUCCESSFUL EMIS IMPLEMENTATION IN A COUNTRY

2 This KP
focuses on
items 2 and 3
only
3

16
Source : Figure 1- The four core EMIS policy areas, from Husein Abdul Hamid, SABER-EMIS
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Time to implement | Roadmap | Challenges

HOW to implement next steps ?

WHEN IS THE RIGHT TIME TO IMPLEMENT EMIS 2.0?

17
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Time to implement | Roadmap | Challenges

HOW to implement next steps ?

ARCHITECTURE ROADMAP IMPLEMENTATION PLAN 1/2

It is strongly recommended that countries commit to a multi-year process of building a robust system that enables the creation,
continued analysis and use of data to drive positive outcomes for students. Countries should begin by reviewing the Architecture
Roadmap Implementation plan:

YEAR 1

1. Set up MoE EMIS2.0 Country document the associated sources Appendix F (Data architecture).
Planning Team constituted with data (either existing applications,
the right expertise. Review the manual systems, or future apps), creating 5. Define Application Interoperability
recommended Team setup and Skill Self- inventory of data that exists and data Standards (Appendix J).
Assessment toolkit (Appendix A). that needs to be collected for SDG4 goal
tracking (Appendix C). 6. Develop Data Migration Plan to
2. Conduct a Needs Assessment with move existing Data from old systems to
key stakeholders and document 4. Information Systems (Applications new systems by executing (Appendix G).
project vision: (Appendix B) and Data) Architecture: Review
• Document MoE objectives existing data flow and applications within 7. Technology Architecture : Describe
• Identify and document the list of issues/ the Ministry of Education, (baseline all necessary hardware, software and
scenarios to be addressed architecture) Defining the Ministries data IT infrastructure required to develop
• Map Requirements storage, management and maintenance, and deploy defined system applications
• Develop Solution Concept diagram including logical and physical data models (Appendix H).
and applications (target architecture)
3. Determine the Target SDG4 utilizing guidance and checklists found in
Data Indicators to be tracked and Appendix E (Applications architecture) and
18
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Time to implement | Roadmap | Challenges

HOW to implement next steps ?

ARCHITECTURE ROADMAP IMPLEMENTATION PLAN 2/2

(END OF YEAR 1) YEAR 2 YEAR 3 YEAR 4

8. Define Risk Mitigation 1. Select Vendors for Each 1. Implement Country 1. Continue Rollout.
Plans: Identify and Document selected Capability. Wide Digital Skills Training
Risks associated with Centres for teachers and
implementation of EMIS2.0 in 2. Select Pilot Schools for principles.
MoE and document mitigation Ministry of Education to test
strategies (Appendix O). initial deployment. 2. Kick-off Country-wide
implementation.
3. Train EMIS2.0 Team on
9.Define Country Wide Data Analytics (Appendix K).
Student / Teacher Identifier
Requirements (Appendix I). 4. Document the test
results (User Acceptance
10. Review UIS EMIS Buyers Tests).
Guide found here.

11.Prepare RFP.

19
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Time to implement | Roadmap | Challenges

HOW to implement next steps ?

EMIS 2.0 IMPLEMENTATION CHALLENGES AND COMMON BARRIERS

Project leads should review this checklist, which is designed to assist implementation teams avoid some of these challenges
(Appendix P).

1 2 3
Lack of a clearly defined and Stakeholders from across Whilst deploying EMIS
well communicated MoE other relevant Ministries infrastructural projects , MoE
vision that fits within the (including Ministry responsible teams often do not create
broader country vision with for issuance of unique student and establish clear roadmaps
respect to digitization of Identifier numbers, Ministry outlining the planned
education processes. of ICT responsible for Data progression from the current
Governance and management to the future state, nor align
policies) are often not on the criteria to determine
consulted or incorporated the priority of projects to
early on into the planning cycle launch. As a result, unrealistic
, which discourages broad timelines and inadequate
acceptance for MoE strategies resources are allocated for
and hinders future alignment. deployment, resulting in
outcomes that do not match
stakeholder expectations.

20
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

HOW
Conclusion
WHAT

WHO WHY
As Ministries of Education begin to deploy new This knowledge pack offers a blueprint to map and
software and hardware technology across the align educational objectives, strategies, roles and
Ministry as well as in schools, investments in responsibilities, data and technology.
people and processes will ensure that the
Ministry is able to continue to meet educational
goals and stakeholder expectations.

This knowledge pack has examined the Similar to other complex organizations, education
components and processes necessary to agencies must establish efficient and cost-effective
WHAT develop and effectively deploy EMIS systems structures to collect, retain and share data in
HOW
within the Ministry and suggested an architectural pursuit of their mission and goals.
road-map that countries can consider as a guide
as they plan their implementation. Countries
should flexibly adapt the proposed schedule for
the architectural roadmap, to suit their needs.

21
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

To go further
CLOUD OF KPs R E L AT E D S O U R C E S
AI/ML Devices
Cloud
Adaptive
Learning
Connectivity
For further resources refer to the
Digital Infrastructure
Digital identity BE DATA Annexes
Data visualization
DRIVEN ENGAGE the NRENs
ECOSYSTEM Procurement
Ecosystem Startups
Data collection EMIS

AssistiveTechnologies
LMS
LEARNER
DESIGN and
Mobile based
S T AY C O N N E C T E D
Computer based
ACT AT SCALE, Digital
ASK WHY? FOR ALL Assessment
Literacies Follow us on Twitter
Digital Content

EMPOWERED
TEACHERS Subscribe to our podcast channel
Teachers Competencies
Spotify & Anchor

More updates on Medium

Subscribe to our EduTech Newsletter

EdTech website
OTHER EXISTING
RELATED KPs

LMS Ecosystems Procurement


22
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Glossary
HOW
Annexes
WHAT

GLOSSARY

ACRONYM Definition

EMIS Education Management Information System. An EMIS can be defined as 'a system for the collection, integration, processing,
maintenance and dissemination of data and information to support
API Application Programming Interface

EA Enterprise Architecture (EA) is the practice of analyzing, designing, planning and implementing enterprise analysis to successfully
execute on business strategies
HR MIS Human Resources Management Information System

SDG Sustainable Development Goals. Sustainable Development Goal 4 is about quality education and is among the 17 Sustainable
Development Goals established by the United Nations in September 2015.
LASA Learning and Accountability System Architecture

SABER Systems Approach for Better Education Results-Education Management Information.

ISCED International Standard Classification of Education (ISCED 2011) provides a comprehensive framework for organizing education programs
and qualification
TOGAF The Open Group Architecture Framework

23
INTRODUCTION WHO WHY WHAT HOW CONCLUSION ANNEXES

Supported with funding from

You might also like