Professional Documents
Culture Documents
P21 - 2 Trends Reading Achievement
P21 - 2 Trends Reading Achievement
Data collected across the PIRLS 2021 countries to examine the impact of COVID-19
on students’ learning and their reading achievement at the end of fourth grade is
somewhat limited. The situation in each country and how the pandemic was handled
was monitored and documented to the extent possible, while ensuring that the PIRLS
assessment remained largely unchanged. Among these efforts, PIRLS 2021 reports
from school principals are valuable and describe the extent of school closures.
Exhibit 3 in About PIRLS 2021 shows how closures varied from country to country as
did the responses to school closures in terms of providing out-of-school learning
opportunities. Parents’ reports about the impact of the pandemic on their children’s
learning also varied across countries (Exhibit 4 in About PIRLS 2021), although
parents reported that two-thirds of their children were negatively impacted in their
learning to some degree.
For the 35 countries and three benchmarking entities that met the requirement for
comparable trend data across two cycles or more, the results are presented in
Exhibits 2.1.1 and 2.1.2. Exhibit 2.1.1 presents graphical representations of the
differences in average reading achievement between PIRLS assessments. The data
in Exhibit 2.1.2 provides the details documenting the changes in average
achievement between specific assessments.
This exhibit displays changes in achievement for the countries and benchmarking participants that assessed fourth grade students at the end of the school
year and have comparable data from previous PIRLS assessments. Exhibit 2.1.2 provides details, including statistical significance. See Appendix A for
country participation in previous assessments.
472
544 462
540 541
538
529 530
527
440
547 552
550 547
506
500 540
497 532
525 494
511
511
559
545 543
553 540
494 537
544
535
559 558
554 553
552
546 547
539 539
330
568 548
566 525
522 520 541
539 537
514
549 511
524
457
573
571 569
564 541
428 530
421
414 413
528 510
551 554
548 547 546
546 545
541 541
537
536
527
559
480 390 480 The trend line from 2001 to 2016 is for
students in their fourth year of schooling.
429
418 541
565
528
549 520
391
581 587
320
542
530
528
522 520 521
288 513 513
502
Sweden Turkiye
2001 2006 2011 2016 2021 2001 2006 2011 2016 2021
600 520
496
561
555
549
542 544
449
500 420
Benchmarking Participants
560 558
612
548
539
535 598
This exhibit reports differences in achievement across assessment years for the countries and benchmarking participants that assessed fourth grade students at
the end of the school year and have comparable data from previous PIRLS assessments. Read across the row to determine if the difference in performance
between years is statistically significant. Symbols indicate if the row year is significantly higher () or significantly lower () than the performance in the column
year. See Appendix A for country participation in previous PIRLS assessments.
The prevalence of downward trends in 2021 compared to 2016 also influenced the
trends between 2021 and the previous cycles, complicating the picture of long-term
trends. Singapore was the only country that showed steady improvement with each
of the five PIRLS assessments. Slovenia posted improvements across the first four
consecutive assessments until the recent decline in 2021. However, in general, the
15 countries that have comparable data across four or five assessments since 2001
have had their “ups and downs.”
The trend results for the 14 countries that needed to delay the assessment of the
fourth grade cohort until the beginning of the fifth grade are shown in Exhibit 2.2.1
(trend plots) and Exhibit 2.2.2 (differences in average achievement between the
assessment cycles). The results show that 6 of the 13 countries with data from PIRLS
2016 had higher achievement in 2021 than in 2016. As explained previously (see
earlier subsection: Impacts of Modifying the Assessment Schedule on Students’
Achievement), the high level of achievement for these countries in PIRLS 2021 may
be partly due to the advantage of collecting data on somewhat older students (half a
This exhibit displays changes in achievement for the countries and benchmarking participants that assessed the fourth grade cohort at the beginning of the fifth
grade school year and have data from previous PIRLS assessments. Students in previous assessments were assessed at the end of the fourth year of schooling.
Exhibit 2.2.2 provides details, including statistical significance. See Appendix A for country participation in previous assessments.
Prior to COVID-19 pandemic During COVID-19 pandemic and at least 4 months older
494
458 488 488
446 557
553 471
577 536
554 567
551
543 539 552
539
504
358
558
552
548
545 543
541
537
528 528
310
44
Exhibit 2.2.1: Trend Plots of Average Reading Achievement
Delayed Assessment of Fourth Grade Cohort at the Beginning of Fifth Grade
(Continued)
This exhibit displays changes in achievement for the countries and benchmarking participants that assessed the fourth grade cohort at the beginning of the fifth
grade school year and have data from previous PIRLS assessments. Students in previous assessments were assessed at the end of the fourth year of schooling.
Exhibit 2.2.2 provides details, including statistical significance. See Appendix A for country participation in previous assessments.
Prior to COVID-19 pandemic During COVID-19 pandemic and at least 4 months older
485
449
565 566
558
430 430
442
425
510 600
483
556 548
549
542
450 540
439
410 500
Benchmarking Participants
551 440
547
515
537 538 424
533
414
476
45
Exhibit 2.2.2: Differences in Average Reading Achievement Across Assessment Years
Delayed Assessment of Fourth Grade Cohort at the Beginning of Fifth Grade
This exhibit reports differences in achievement across assessment years for the countries and benchmarking participants that assessed the fourth grade cohort at
the beginning of the fifth grade school year and have data from previous PIRLS assessments. Read across the row to determine if the difference in performance
between years is statistically significant. Symbols indicate if the row year is significantly higher () or significantly lower () than the performance in the column
year. Students in previous assessments were assessed at the end of the fourth year of schooling. See Appendix A for country participation in previous PIRLS
assessments.
(Continued)
Average Scale Differences Between Years
Country Reading Achievement Distribution
Score 2016 2011 2006 2001
Benchmarking Participants
Quebec, Canada
≡ 2021 551 (2.7) 4 13 18 14
≡ 2016 547 (2.8) 10 15 10
2011 538 (2.2) 5 0
2006 533 (2.7) -4
2001 537 (3.0)
Abu Dhabi, UAE
2021 440 (3.5) 25 15
2016 414 (4.7) -10
2011 424 (4.7)
Dubai, UAE
2 2021 552 (1.5) 37 76
2016 515 (1.9) 39
2011 476 (2.0)
100 200 300 400 500 600 700 800
Average from more recent year significantly higher
Percentiles of Performance
Average from more recent year significantly lower 5th 25th 75th 95th
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed fourth grade students at the end of
the school year and have comparable data from previous assessments. See Appendix A for country participation in previous assessments.
Girls Boys Prior to COVID-19 pandemic
During COVID-19 pandemic
479*
555* 543* 544*
549* 470*
537*
533*
536* 538 466
533 450*
534 525 456
532 523
519
432
550* 562*
558* 559*
509* 548*
544 502* 503*
530* 499* 539*
504 544
515* 497 538 537
492 533
520 489
524
507
563* 515*
561* 549* 549*
506*
551* 543* 541
555 506
542* 542
538 538
546
531
537
482
529
49
Exhibit 2.3: Trend Plots of Average Reading Achievement by Gender
Assessed Fourth Grade Students at the End of the School Year
⋈ Assessed one year later than originally scheduled – six year trend from PIRLS 2016
(Continued)
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed fourth grade students at the end of
the school year and have comparable data from previous assessments. See Appendix A for country participation in previous assessments.
Girls Boys Prior to COVID-19 pandemic
During COVID-19 pandemic
370
564* 566*
563* 562*
560*
553* 554* 549*
545* 553
349* 551
548
539 541 541 540
533
530
312
500 300 500
551*
578* 577* 545* 545* 543*
531*
527*
522 544 532*
558* 521*
515* 537
533 532
558 520 518
555 516
507 507 516
541
50
Exhibit 2.3: Trend Plots of Average Reading Achievement by Gender
Assessed Fourth Grade Students at the End of the School Year
⋈ Assessed one year later than originally scheduled – six year trend from PIRLS 2016
(Continued)
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed fourth grade students at the end of
the school year and have comparable data from previous assessments. See Appendix A for country participation in previous assessments.
562*
555*
552* 551* 550*
549*
545* 546
543 541*
548 540*
545 547
544 543 543 534*
540 540
537
534
531
521
570*
542* 544* 452* 453* 454*
541*
533* 531* 547*
548
520 521 431 432
429
516
512 512 531
548*
574*
395 517
540
371
360 510 480
51
Exhibit 2.3: Trend Plots of Average Reading Achievement by Gender
Assessed Fourth Grade Students at the End of the School Year
⋈ Assessed one year later than originally scheduled – six year trend from PIRLS 2016
(Continued)
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed fourth grade students at the end of
the school year and have comparable data from previous assessments. See Appendix A for country participation in previous assessments.
522
510 510 516 480
552*
539* 317*
532* 529* 532*
533 522
515 516
512* 523 524
520
512 295
511 511 511
491
260
470 250 470
Sweden Turkiye
2001 2006 2011 2016 2021 2001 2006 2011 2016 2021
600 520
505*
572*
563*
559* 488
549* 551*
550 459*
548
541
535 536
440
500 420
52
Exhibit 2.3: Trend Plots of Average Reading Achievement by Gender
Assessed Fourth Grade Students at the End of the School Year
⋈ Assessed one year later than originally scheduled – six year trend from PIRLS 2016
(Continued)
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed fourth grade students at the end of
the school year and have comparable data from previous assessments. See Appendix A for country participation in previous assessments.
Benchmarking Participants
531 593
529
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed the fourth grade cohort at the
beginning of the fifth grade school year and have data from previous PIRLS assessments. Students in previous assessments were assessed at the end of the
fourth year of schooling. See Appendix A for country participation in previous assessments.
Girls Boys Prior to COVID-19 pandemic
During COVID-19 pandemic and at least 4 months older
483*
506*
468* 499* 498*
560* 562*
480*
551 483
477 479
546
434 463
424
583* 542*
561* 572*
554 572
550* 559* 531
547* 547*
512*
561
548 548
536 544
532 532
495
372*
566*
563*
556* 558*
553* 552*
546* 356
542*
549 537*
542 344
538 326*
534 535
530 528
520
514
55
Exhibit 2.4: Trend Plots of Average Reading Achievement by Gender
Delayed Assessment of Fourth Grade Cohort at the Beginning of Fifth Grade
(Continued)
This exhibit displays changes in achievement for girls and boys in each country and benchmarking participant that assessed the fourth grade cohort at the
beginning of the fifth grade school year and have data from previous PIRLS assessments. Students in previous assessments were assessed at the end of the
fourth year of schooling. See Appendix A for country participation in previous assessments.
Girls Boys Prior to COVID-19 pandemic
During COVID-19 pandemic and at least 4 months older
464* 464*
456*
578* 476
574*
460*
567*
441*
428
555 553
550
424 402
399
411
510 400 380
510 600
497*
562*
465* 553*
551* 551
468
545*
452* 551
545 544
533 535
436
425
410 500
Benchmarking Participants
457* 547
556*
552* 442* 522*
435*
544* 544*
539*
546
542
509
530 531 422
527
483*
406
396
470
490 380 460
56