Professional Documents
Culture Documents
GR 4 Literacy Test PIRLS 2011
GR 4 Literacy Test PIRLS 2011
GR 4 Literacy Test PIRLS 2011
LITERACY ITEMS
This book contains the released Progress in International Reading Literacy Study
(PIRLS) 2011 grade 4 reading assessment items. This is not a complete set of all PIRLS
2011 assessment items because some items are kept confidential so that they may be
used in subsequent cycles of PIRLS to measure trends.
TIMSS and PIRLS are copyrighted and are registered trademarks of IEA. Released items from
TIMSS andPIRLS assessments are for non-commercial, educational, and research purposes only.
Translated versions of items remain the intellectual property of IEA. Although the items are in the
public domain, please print an acknowledgement of the source, including the year and name of the
assessment you are using. If you publish any part of the released items from PIRLS 2011, please use
thefollowingacknowledgement:
SOURCE: PIRLS 2011 Assessment. Copyright 2013 International Association for the Evaluation of
Educational Achievement (IEA). Publisher: TIMSS & PIRLS International Study Center, Lynch School
of Education, Boston College, Chestnut Hill, MA and International Association for the Evaluation of
Educational Achievement (IEA), IEA Secretariat, Amsterdam, the Netherlands.
38332.0513.86070412
USERS GUIDE
This book contains PIRLS 2011 released passages
and items for grade 4. Following the passage, each
item appears on a single page, on which is provided
information about the items classification and about
international student performance on the item. The
items appear in the passage order, as shown in the
index on the next page.
Information about
itemclassification
Take a look at the first item on page 6. Across the
top are three boxes which identify the passage,
its reading purpose (the specific topic assessed
within that subject matter), and its comprehension
process (the cognitive or thinking process
assessed). For this item, the passage is The Giant
Tooth Mystery, the reading purpose is acquire and
use information, and the comprehension process is
focus on and retrieve explicitly-stated information.
Below the row of boxes and above a boxed-in area
ofthe page is the item label. For this item, it is
Item 1: What is a fossil. Below the boxed-in area is
the variable name, which is more commonly used
to identify each item than the item label.
Correct answers are shown beneath each item.
The correct answer for multiple-choice items is
simply a letter code. For example, in the item
R0321G01M on page 6, the letter code C is the
correct answer. The correct answers for write-in
or open-ended items are explained in a scoring
guide. For example, the item 2: Why people believed
ingiants (page 7) provides an example of a scoring
guide, indicating the general nature of correct and
incorrect responses. In some cases, partial credit may
be awarded and these items will provide guidelines
for fully correct, partially correct, and incorrect
38332.0513.86070412
ITEM INDEX
Passage
Level Page
Giant Tooth
R031G01M
R031G02C
R031G03M
R031G04C
R031G05M
R031G06M
R031G07M
R031G08C
R031G09M
R031G10C
R031G11M
R031G12C
R031G13C
R031G14M
What is a fossil
Why people believed in giants
Where Palissy found fossils
What was Palissys new idea
Why Palissy was imprisoned
Who found the fossil tooth
What made the tooth puzzling
Tooth from diff. types (DERIVED)
Why Gideon took tooth to a museum
Why seeing tooth was important
What Gideon used
Purpose of two Iguanodon pictures
How Iguanodon looked (DERIVED)
What discovery proved Gideon wrong
Intermediate (475)
High (550)
High (550)
Advanced (625)
Advanced (625)
High (550)
High (550)
Above Advanced
High (550)
Advanced (625)
High (550)
Above Advanced
Advanced (625)
Advanced (625)
6
7
9
10
12
13
14
15
18
19
21
22
24
27
Enemy Pie
R031P01M
R031P02C
R031P03C
R031P04M
R031P05C
R031P06C
R031P07C
R031P08M
R031P09C
R031P10M
R031P11M
R031P12M
R031P13M
R031P14C
R031P15C
R031P16C
High (550)
Intermediate (475)
Intermediate (475)
Advanced (625)
Advanced (625)
Intermediate (475)
High (550)
Intermediate (475)
Intermediate (475)
Intermediate (475)
High (550)
High (550)
Intermediate (475)
High (550)
Advanced (625)
Advanced (625)
32
33
35
37
38
40
42
44
45
47
48
49
50
51
53
55
38332.0513.86070412
ITEM INDEX
Passage
Level
Page
Intermediate (475)
Intermediate (475)
Advanced (625)
High (550)
Intermediate (475)
Intermediate (475)
High (550)
High (550)
High (550)
High (550)
High (550)
High (550)
59
60
62
64
65
66
67
68
70
71
72
74
Low (400)
High (550)
Intermediate (475)
Intermediate (475)
High (550)
High (550)
High (550)
Advanced (625)
Above Advanced
High (550)
High (550)
Advanced (625)
84
85
86
87
88
90
91
93
94
96
98
99
Day Hiking
R021N01M
R021N02C
R021N03C
R021N04M
R021N05M
R021N06M
R021N07M
R021N08C
R021N09M
R021N10M
R021N11C
R021N12C
38332.0513.86070412
The
The Giant
Giant Tooth
Tooth Mystery
Mystery
The
GIANT Tooth
Mystery
Long ago, people who found huge fossils did not know what they were.
Some thought the big bones came from large animals that they had seen or
read about, such as hippos or elephants. But some of the bones people found
were too big to have come from even the biggest hippo or elephant. These
enormous bones led some people to believe in giants.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Gideon Mantell could tell that the pieces of rock attached to the tooth
were very old. He knew that it was the kind of rock where reptile fossils
were found. Could the tooth have belonged to a giant, plant-eating reptile
that chewed its food? A type of reptile that no longer lived on earth?
Gideon Mantell was really puzzled by the big tooth. No reptile that he
knew about chewed its food. Reptiles gulped their food, and so their teeth
didnt become worn down. It was a mystery.
Gideon Mantell took the tooth to a museum in London and showed it
to other scientists. No one agreed with Gideon Mantell that it might be the
tooth of a gigantic reptile.
Gideon Mantell tried to find a reptile that had a tooth that looked like
the giant tooth. For a long time, he found nothing. Then one day he met
a scientist who was studying iguanas. An iguana is a large plant-eating
reptile found in Central and South America. It can grow to be more than
five feet long. The scientist showed Gideon Mantell an iguana tooth. At last!
Here was the tooth of a living reptile that looked like the mystery tooth.
Only the fossil tooth was much, much bigger.
Iguana
A life-sized
drawing of an
iguanas tooth
from Gideon Mantells
notebook
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Passage
Reading Purpose
Comprehension Process of
the Task
Focus on and Retrieve Explicitly
Stated Information
Overall Percent Correct
Percent
correct
What is a fossil?
Education system
A.
B.
C.
D.
Netherlands
Italy
Hong Kong-CHN
Sweden
Spain
Finland
Slovenia
Israel
Chinese Taipei-CHN
Croatia
United States
Germany
Hungary
England-GBR
Northern Ireland-GBR
Georgia
Russian Federation
Canada
Australia
Ireland
Austria
Lithuania
Portugal
Romania
Bulgaria
New Zealand
Norway
Denmark
Czech Republic
International average
Singapore
Slovak Republic
Poland
Indonesia
Belgium (French)-BEL
France
Malta
United Arab Emirates
Qatar
Trinidad and Tobago
Azerbaijan
Iran, Islamic Rep. of
Colombia
Saudi Arabia
Oman
Morocco
95
92
92
90
90
89
87
87
86
85
85
85
83
83
82
82
82
82
82
82
81
81
80
80
80
76
76
76
75
75
75
73
68
68
67
64
64
63
58
56
52
52
51
49
45
42
Benchmarking
education system
Percent
correct
Correct Response:
Andalusia-ESP
Florida-USA
Alberta-CAN
Ontario-CAN
Quebec-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
93
89
87
83
78
73
68
58
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Passage
Reading Purpose
Comprehension Process of
the Task
According to the article, why did some people long ago believe in
giants?
SCORING
1 - Acceptable Response
The response demonstrates understanding that people long ago believed in giants because
they found huge bones/skeletons/fossils.
Examples:
They found bones too big to belong to something they knew.
They found giant bones that were too big to be from the biggest hippo.
They found really big bones.
0 - Unacceptable Response
The response does not demonstrate understanding that people long ago believe in giants
because they found huge bones/skeletons/fossils.
Examples:
Giants are really big.
They found dinosaur bones.
They found things that must belong to giants.
Education system
Percent
correct
Singapore
Chinese Taipei-CHN
Hong Kong-CHN
Netherlands
Sweden
Germany
Portugal
Russian Federation
England-GBR
Northern Ireland-GBR
Ireland
Israel
Slovenia
Denmark
Austria
Bulgaria
Slovak Republic
Czech Republic
Italy
New Zealand
Croatia
Australia
Spain
Canada
Hungary
Malta
France
International average
Norway
Georgia
Finland
United States
Saudi Arabia
Poland
Trinidad and Tobago
Qatar
Indonesia
Romania
Belgium (French)-BEL
United Arab Emirates
Iran, Islamic Rep. of
Azerbaijan
Colombia
Lithuania
Oman
Morocco
81
77
76
75
67
67
64
64
63
62
62
61
61
61
61
60
60
60
59
59
58
58
57
57
56
55
53
53
51
50
48
45
44
43
43
42
41
41
38
36
35
35
29
29
28
26
Benchmarking
education system
Percent
correct
Ontario-CAN
Alberta-CAN
Maltese-MLT
Andalusia-ESP
Florida-USA
Dubai-UAE
Quebec-CAN
Abu Dhabi-UAE
61
58
52
52
51
49
45
32
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Passage
Reading Purpose
Comprehension Process of
the Task
Focus on and Retrieve Explicitly
Stated Information
Overall Percent Correct
Percent
correct
Education system
A.
on the cliffs
B.
in the clay
C.
by a river
D.
on a path
Croatia
Hong Kong-CHN
Singapore
Ireland
Finland
Northern Ireland-GBR
Portugal
United States
Denmark
Russian Federation
Germany
Slovenia
England-GBR
Czech Republic
Italy
Sweden
Chinese Taipei-CHN
Canada
Austria
Hungary
Israel
Netherlands
Iran, Islamic Rep. of
Romania
New Zealand
Bulgaria
Australia
Norway
International average
Malta
Lithuania
Poland
Slovak Republic
Azerbaijan
Spain
France
Georgia
United Arab Emirates
Trinidad and Tobago
Qatar
Saudi Arabia
Belgium (French)-BEL
Oman
Colombia
Indonesia
Morocco
87
86
83
83
83
82
79
78
78
77
77
77
77
77
76
76
76
75
75
74
74
73
73
72
72
71
71
71
71
70
70
70
69
68
65
65
63
62
61
60
60
60
54
51
50
27
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Alberta-CAN
Ontario-CAN
Quebec-CAN
Dubai-UAE
Andalusia-ESP
Maltese-MLT
Abu Dhabi-UAE
81
80
76
74
72
69
65
58
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Passage
Reading Purpose
Comprehension Process of
the Task
Education system
SCORING
1 - Acceptable Response
The response demonstrates understanding that Palissys new idea was that some fossils
belonged to animals that no longer lived on earth, had completely disappeared, or were extinct.
Examples:
Fossils could be from extinct animals.
Some belonged to creatures no longer living on earth.
His idea was that some animals completely disappeared!
0 - Unacceptable Response
The response does not demonstrate understanding of Palissys new idea. It might relate to
Palissys idea that fossils once belonged to living creatures, or may state a fact about Palissys
work.
Examples:
Fossils were from the remains of living creatures.
Reptiles were extinct.
He found fossils in his clay.
Percent
correct
Hong Kong-CHN
Chinese Taipei-CHN
Russian Federation
Singapore
Hungary
Czech Republic
Finland
Slovak Republic
Northern Ireland-GBR
Azerbaijan
England-GBR
Italy
Germany
Israel
Croatia
Bulgaria
Ireland
Slovenia
Canada
International average
Iran, Islamic Rep. of
Netherlands
United States
Portugal
Sweden
Denmark
Romania
Australia
Lithuania
Qatar
Saudi Arabia
Austria
Georgia
Malta
New Zealand
Norway
France
United Arab Emirates
Oman
Trinidad and Tobago
Poland
Spain
Morocco
Belgium (French)-BEL
Indonesia
Colombia
60
55
44
42
40
39
38
29
29
29
28
28
28
28
28
27
26
26
25
25
24
24
24
23
23
21
21
21
21
19
19
18
18
17
17
17
17
16
15
15
14
12
12
11
11
9
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Quebec-CAN
Dubai-UAE
Abu Dhabi-UAE
Andalusia-ESP
Maltese-MLT
27
25
23
23
21
13
12
10
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
10
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
11
Passage
Reading Purpose
B.
C.
D.
Education system
Correct Response:
Comprehension Process of
the Task
Percent
correct
Chinese Taipei-CHN
Denmark
Hong Kong-CHN
Finland
Italy
Netherlands
Ireland
Czech Republic
Portugal
Singapore
England-GBR
Hungary
United States
Northern Ireland-GBR
Bulgaria
Sweden
Canada
Slovak Republic
Israel
Austria
New Zealand
Russian Federation
Australia
Croatia
Spain
International average
Germany
Georgia
Romania
Poland
Norway
Iran, Islamic Rep. of
Lithuania
France
United Arab Emirates
Malta
Belgium (French)-BEL
Saudi Arabia
Azerbaijan
Indonesia
Qatar
Oman
Slovenia
Trinidad and Tobago
Morocco
Colombia
70
68
66
66
66
66
65
63
63
61
61
60
60
59
59
58
58
58
57
57
57
56
55
55
54
54
53
52
52
51
49
49
49
48
48
45
45
44
44
42
42
40
39
38
35
32
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Ontario-CAN
Andalusia-ESP
Alberta-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
66
59
59
56
56
51
48
45
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
12
Passage
Reading Purpose
Bernard Palissy
B.
C.
Richard Owen
D.
Gideon Mantell
Education system
Correct Response:
Comprehension Process of
the Task
Percent
correct
Russian Federation
Ireland
Hong Kong-CHN
Croatia
Singapore
Lithuania
Northern Ireland-GBR
Czech Republic
Slovak Republic
Italy
Denmark
Bulgaria
Germany
Finland
Chinese Taipei-CHN
England-GBR
Canada
Austria
France
United States
Malta
Sweden
New Zealand
Australia
Portugal
Poland
Hungary
Israel
International average
Slovenia
Spain
Belgium (French)-BEL
Norway
Netherlands
Trinidad and Tobago
Romania
Georgia
Azerbaijan
United Arab Emirates
Colombia
Qatar
Indonesia
Iran, Islamic Rep. of
Saudi Arabia
Oman
Morocco
87
85
84
83
82
81
81
81
79
78
78
77
77
76
76
75
74
73
73
73
73
72
70
69
68
68
68
68
68
67
67
66
66
65
65
64
59
55
52
51
48
44
42
40
37
29
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Ontario-CAN
Maltese-MLT
Alberta-CAN
Andalusia-ESP
Dubai-UAE
Abu Dhabi-UAE
77
76
72
71
71
68
64
47
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
13
Passage
Reading Purpose
B.
C.
D.
Correct Response:
What did Gideon Mantell know about reptiles that made the fossil
tooth puzzling?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Croatia
Ireland
Czech Republic
Finland
Northern Ireland-GBR
Hungary
Russian Federation
England-GBR
United States
Italy
Denmark
Singapore
Lithuania
Slovak Republic
Slovenia
Bulgaria
Hong Kong-CHN
Azerbaijan
Netherlands
Canada
Iran, Islamic Rep. of
New Zealand
Germany
Spain
Sweden
Australia
Austria
International average
Israel
Romania
Belgium (French)-BEL
Georgia
France
Norway
Trinidad and Tobago
Chinese Taipei-CHN
Portugal
Malta
United Arab Emirates
Qatar
Poland
Colombia
Saudi Arabia
Oman
Indonesia
Morocco
74
73
72
72
71
70
70
69
69
69
68
68
67
65
65
64
63
62
61
61
60
59
59
58
58
58
58
57
57
56
56
55
53
52
51
51
51
46
42
40
39
38
35
30
29
24
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Quebec-CAN
Maltese-MLT
Abu Dhabi-UAE
73
67
64
62
54
46
42
36
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
14
Passage
Reading Purpose
Comprehension Process of
the Task
A plant eater
A giant creature
A
A reptile
B
SCORING
1 - Acceptable Response
Each of the two parts of this item will be scored separately in its own 1-point coding block.
Type of animal
A giant creature
The response identifies the large size of the fossil tooth (as big as
an elephants tooth).
A reptile
0 - Unacceptable Response
Type of animal
A giant creature
A reptile
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
15
Education system
Percent
correct
Singapore
Canada
Northern Ireland-GBR
Russian Federation
Portugal
England
Israel
United States
New Zealand
Czech Republic
Italy
Finland
Australia
Ireland
Denmark
Hungary
Romania
Bulgaria
Croatia
Poland
Germany
Lithuania
Slovak Republic
Netherlands
Sweden
International average
Spain
Slovenia
Austria
France
Belgium (French)-BEL
Qatar
Norway
Malta
Chinese Taipei-CHN
Georgia
United Arab Emirates
Trinidad and Tobago
Hong Kong-CHN
Colombia
Iran, Islamic Rep. of
Azerbaijan
Indonesia
Oman
Saudi Arabia
Morocco
23
22
20
19
19
19
18
18
18
17
17
17
17
16
15
14
13
13
13
13
13
12
12
12
12
12
11
11
10
9
9
8
7
7
7
7
5
5
5
4
3
3
3
3
2
#
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Quebec-CAN
Dubai-UAE
Andalusia-ESP
Maltese-MLT
Abu Dhabi-UAE
Rounds to zero.
22
21
20
19
10
10
5
4
Student Responses
Correct Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
16
Student Responses
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
17
Passage
Reading Purpose
Comprehension Process of
the Task
Make Straightforward Inferences
Overall Percent Correct
Percent
correct
Education system
A.
B.
C.
D.
Hong Kong-CHN
Chinese Taipei-CHN
Singapore
Italy
Finland
Russian Federation
Sweden
Portugal
Czech Republic
Ireland
Slovenia
England-GBR
Northern Ireland-GBR
Lithuania
Israel
Slovak Republic
France
Croatia
Hungary
Spain
Germany
United States
Austria
Belgium (French)-BEL
Canada
Bulgaria
Denmark
International average
Romania
Australia
Netherlands
Azerbaijan
Norway
New Zealand
Malta
Poland
Georgia
Trinidad and Tobago
Iran, Islamic Rep. of
United Arab Emirates
Qatar
Saudi Arabia
Colombia
Indonesia
Oman
Morocco
80
79
75
74
73
72
69
67
66
66
65
64
64
64
63
63
63
63
62
61
61
61
61
60
60
58
58
58
56
55
55
54
52
52
52
51
51
47
46
46
43
42
36
35
31
26
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Andalusia-ESP
Quebec-CAN
Ontario-CAN
Alberta-CAN
Dubai-UAE
Abu Dhabi-UAE
Maltese-MLT
64
64
63
59
54
54
43
41
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
18
Passage
Reading Purpose
Comprehension Process of
the Task
SCORING
1 - Acceptable Response
The response demonstrates understanding that the iguana tooth provided evidence that
supported Gideon Mantells theory that the fossil tooth might have belonged to a giant reptile.
-OR The response demonstrates a more general understanding that the iguana tooth looked like
the fossil tooth.
Examples:
The iguana tooth showed his fossil could be from a reptile.
The tooth proved he was right.
He could see that they loked the same.
0 - Unacceptable Response
The response does not demonstrate understanding of the significance of the iguana tooth.
Examples:
He wanted to be famous.
He thought it would be interesting to see an iguanas tooth.
Education system
Percent
correct
Italy
Czech Republic
Germany
Singapore
United States
Finland
Denmark
Bulgaria
Canada
Portugal
England-GBR
Northern Ireland-GBR
Israel
Netherlands
Hungary
Russian Federation
Slovak Republic
New Zealand
Croatia
Ireland
Slovenia
Australia
Romania
International average
Sweden
Austria
Hong Kong-CHN
France
Spain
Georgia
Malta
Chinese Taipei-CHN
Norway
Belgium (French)-BEL
Iran, Islamic Rep. of
Colombia
Qatar
Trinidad and Tobago
Azerbaijan
Poland
Lithuania
Indonesia
United Arab Emirates
Saudi Arabia
Oman
Morocco
57
56
56
52
51
50
47
46
46
46
46
45
42
42
42
40
40
40
39
39
37
37
37
34
33
32
30
30
30
29
28
28
27
26
24
23
22
19
19
18
18
17
16
12
11
1
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Quebec-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
58
49
48
46
29
25
18
14
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
19
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
20
Passage
Reading Purpose
What did Gideon Mantell use when trying to figure out what the
Iguanodon looked like?
A.
bones he collected
B.
C.
pictures in books
D.
Correct Response:
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Russian Federation
Chinese Taipei-CHN
Singapore
Finland
Czech Republic
Denmark
Netherlands
Austria
England-GBR
Northern Ireland-GBR
Bulgaria
Germany
Hungary
Italy
Sweden
Romania
Slovak Republic
Ireland
Israel
United States
Lithuania
Portugal
International average
Canada
Croatia
Australia
New Zealand
Slovenia
Spain
Poland
France
Azerbaijan
Malta
Norway
Iran, Islamic Rep. of
Indonesia
Qatar
Belgium (French)-BEL
Georgia
Saudi Arabia
United Arab Emirates
Trinidad and Tobago
Oman
Morocco
Colombia
83
82
80
69
68
68
66
66
64
64
63
63
63
63
62
62
62
61
61
60
59
58
57
57
57
57
56
55
55
55
54
54
53
51
51
51
49
48
48
46
44
41
41
38
33
29
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
62
59
55
54
53
47
47
40
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
21
Passage
Reading Purpose
Comprehension Process of
the Task
Look at the two pictures of the Iguanodon. What do they help you
to understand?
SCORING
2 - Complete Comprehension
The response demonstrates understanding that the pictures show the changes in scientific
ideas, or that the pictures show different peoples ideas about the Iguanodon. -OR The response indicates that the pictures illustrate the mistakes that Gideon Mantell or other
people might have made.
1 - Partial Comprehension
The response demonstrates a more general understanding that the Iguanodons looked
different in the two pictures. -OR The response describes a difference between the two pictures without reference to changes in
scientific ideas or what different people might have believed. -OR The response provides an explicit reference to one of the pictures without reference to changes
in scientific ideas or what different people might have believed.
0 - No Comprehension
The response does not demonstrate understanding of the purpose of the illustrations. The
response may describe a specific feature from one of the pictures, or give a description of what
the illustrations have in common. -OR-
The response may provide an inaccurate interpretation that the Iguanodon itself changed in
appearance over time, rather than peoples ideas.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
22
Education system
Percent
correct
England-GBR
Russian Federation
United States
Denmark
Ireland
Italy
Northern Ireland-GBR
Canada
Australia
Slovenia
Sweden
Hong Kong-CHN
Israel
Poland
Germany
Portugal
Singapore
Croatia
Finland
New Zealand
France
Chinese Taipei-CHN
Netherlands
International average
Bulgaria
Austria
Slovak Republic
Lithuania
Czech Republic
Hungary
Belgium (French)-BEL
Romania
Norway
Oman
Spain
United Arab Emirates
Malta
Indonesia
Qatar
Trinidad and Tobago
Georgia
Colombia
Iran, Islamic Rep. of
Azerbaijan
Saudi Arabia
Morocco
21
19
18
17
16
16
16
15
15
14
14
14
13
13
12
12
12
12
12
12
11
11
11
10
10
9
8
8
8
8
7
6
6
6
5
5
5
4
4
4
3
2
2
1
1
0
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Dubai-UAE
Andalusia-ESP
Abu Dhabi-UAE
Maltese-MLT
22
15
15
14
8
4
4
4
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
23
Passage
Reading Purpose
Comprehension Process of
the Task
SCORING
1 - Acceptable Response
Each of the three parts of this item will be scored separately in its own 1-point coding block.
What Gideon Mantell thought the
Iguanodon looked like
0 - Unacceptable Response
What Gideon Mantell thought the
Iguanodon looked like
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
24
Education system
Percent
correct
Hong Kong-CHN
Singapore
Chinese Taipei-CHN
Finland
Russian Federation
England-GBR
Sweden
Northern Ireland-GBR
Denmark
United States
Ireland
Croatia
Portugal
Canada
Netherlands
Hungary
New Zealand
Italy
Australia
Czech Republic
Germany
Bulgaria
Israel
Slovenia
Lithuania
International average
Austria
France
Slovak Republic
Belgium (French)-BEL
Romania
Poland
Spain
Norway
Malta
Georgia
Qatar
United Arab Emirates
Trinidad and Tobago
Saudi Arabia
Oman
Indonesia
Iran, Islamic Rep. of
Azerbaijan
Colombia
Morocco
62
57
53
48
47
46
44
44
44
44
44
42
42
42
42
41
40
40
40
39
38
37
36
33
32
32
31
31
30
29
27
26
26
23
22
17
15
14
13
10
8
7
7
6
6
2
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Ontario-CAN
Alberta-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
47
42
42
40
25
22
14
12
Student Responses
Correct Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
25
Student Responses
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
26
Passage
Reading Purpose
B.
scientific drawings
C.
living Iguanodons
D.
whole skeletons
Correct Response:
What were found that showed Gideon was wrong about what the
Iguanodon looked like?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Finland
Hong Kong-CHN
Germany
Russian Federation
Denmark
Netherlands
Slovenia
Hungary
Portugal
Italy
Austria
Bulgaria
Sweden
Czech Republic
Northern Ireland-GBR
United States
England-GBR
Chinese Taipei-CHN
Spain
Ireland
Singapore
Australia
Canada
Romania
Israel
Poland
Norway
International average
New Zealand
Slovak Republic
Croatia
France
Belgium (French)-BEL
Georgia
Lithuania
Malta
Azerbaijan
Iran, Islamic Rep. of
Colombia
Qatar
United Arab Emirates
Saudi Arabia
Oman
Trinidad and Tobago
Morocco
Indonesia
74
68
67
67
67
66
64
64
63
62
62
60
60
59
58
58
58
57
57
57
56
56
55
53
53
53
53
52
52
52
49
48
48
44
43
41
40
39
37
35
34
32
31
29
29
20
Benchmarking
education system
Percent
correct
Florida-USA
Andalusia-ESP
Alberta-CAN
Ontario-CAN
Quebec-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
60
57
55
54
52
42
37
35
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
27
Passage
Reading Purpose
B.
scientific drawings
C.
living Iguanodons
D.
whole skeletons
Correct Response:
What were found that showed Gideon was wrong about what the
Iguanodon looked like?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Finland
Hong Kong-CHN
Germany
Russian Federation
Denmark
Netherlands
Slovenia
Hungary
Portugal
Italy
Austria
Bulgaria
Sweden
Czech Republic
Northern Ireland-GBR
United States
England-GBR
Chinese Taipei-CHN
Spain
Ireland
Singapore
Australia
Canada
Romania
Israel
Poland
Norway
International average
New Zealand
Slovak Republic
Croatia
France
Belgium (French)-BEL
Georgia
Lithuania
Malta
Azerbaijan
Iran, Islamic Rep. of
Colombia
Qatar
United Arab Emirates
Saudi Arabia
Oman
Trinidad and Tobago
Morocco
Indonesia
74
68
67
67
67
66
64
64
63
62
62
60
60
59
58
58
58
57
57
57
56
56
55
53
53
53
53
52
52
52
49
48
48
44
43
41
40
39
37
35
34
32
31
29
29
20
Benchmarking
education system
Percent
correct
Florida-USA
Andalusia-ESP
Alberta-CAN
Ontario-CAN
Quebec-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
60
57
55
54
52
42
37
35
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
27
Enemy Pie
Enemy Pie
by Derek Munson
illustrated by Tara Calahan King
It was a perfect summer until Jeremy Ross moved in right next door to
my best friend Stanley. I did not like Jeremy. He had a party and I wasnt
even invited. But my best friend Stanley was.
I never had an enemy until Jeremy moved into the neighborhood. Dad
told me that when he was
my age, he had enemies, too.
But he knew of a way to get
rid of them.
Dad pulled a worn-out
scrap of paper from a recipe
book.
Enemy Pie, he said,
satisfied.
You may be wondering
what exactly is in Enemy
Pie. Dad said the recipe was
so secret, he couldnt even
tell me. I begged him to tell
me somethinganything.
I will tell you this, Tom, he said to me. Enemy Pie is the fastest
known way to get rid of enemies.
This got me thinking. What kinds of disgusting things would I put into
Enemy Pie? I brought Dad earthworms and rocks, but he gave them right
back.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
28
Enemy Pie
I went outside to play. All the while, I listened to the sounds of my dad
in the kitchen. This could be a great summer after all.
I tried to imagine how horrible Enemy Pie must smell. But I smelled
something really good. As far as I could tell, it was coming from our
kitchen. I was confused.
I went inside to ask Dad what was wrong. Enemy Pie shouldnt smell
this good. But Dad was smart. If it smelled bad, your enemy would never
eat it, he said. I could tell hed made this pie before.
The oven buzzer rang. Dad put on oven mitts and pulled out the pie. It
looked good enough to eat! I was beginning to understand.
But still, I wasnt sure how this Enemy Pie worked. What exactly did it
do to enemies? Maybe it made their hair fall out, or their breath stinky. I
asked Dad, but he was no help.
While the pie cooled, Dad filled me in on my job.
He whispered. In order for it to work, you need to spend a day with
your enemy. Even worse, you have to be nice to him. Its not easy. But
thats the only way that Enemy Pie can work. Are you sure you want to do
this?
Of course I was.
All I had to do was spend one day with Jeremy, then hed be out of my
life. I rode my bike to his house and knocked on the door.
When Jeremy opened the
door, he seemed surprised.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
29
Enemy Pie
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
30
Enemy Pie
If its so bad, Jeremy asked, then why has your dad already eaten
half of it?
Sure enough, Dad was eating Enemy Pie.
Good stuff, Dad mumbled. I sat there watching them eat. Neither one
of them was losing any hair! It seemed safe, so I took a tiny taste. It was
delicious!
After dessert, Jeremy invited me to come over to his house the next
morning.
As for Enemy Pie, I still dont know how to make it. I still wonder if
enemies really do hate it or if their hair falls out or their breath turns
bad. But I dont know if Ill ever get an answer, because I just lost my best
enemy.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
31
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
Education system
A.
Jeremy
B.
Dad
C.
Stanley
D.
Tom
United States
Bulgaria
Canada
Croatia
Ireland
Northern Ireland-GBR
England-GBR
Italy
Slovak Republic
Denmark
Singapore
Russian Federation
Slovenia
Georgia
France
Poland
Australia
Czech Republic
Portugal
Belgium (French)-BEL
Finland
Israel
New Zealand
Hungary
Lithuania
Spain
Netherlands
Germany
Romania
International average
Azerbaijan
Austria
Malta
Sweden
Chinese Taipei-CHN
Hong Kong-CHN
Trinidad and Tobago
Colombia
Iran, Islamic Rep. of
Norway
United Arab Emirates
Qatar
Saudi Arabia
Oman
Morocco
Indonesia
88
86
86
85
85
84
84
83
82
82
81
81
80
80
80
80
80
79
79
79
78
78
78
77
74
74
74
74
73
71
70
67
67
65
64
62
56
54
53
51
48
46
45
36
35
33
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Ontario-CAN
Quebec-CAN
Alberta-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
93
86
86
81
73
68
60
43
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
32
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
At the beginning of the story, why did Tom think Jeremy was his
enemy?
SCORING
1 - Acceptable Response
The response shows understanding that Tom considered Jeremy his enemy either because
Jeremy did not invite him to his party, or because Jeremy invited Toms best friend Stanley and
not him. -OR The response shows understanding that Tom was afraid that Jeremy would take his place as
Stanleys best friend.
Examples:
Tom was not invited to Jeremys party.
Jeremy invited his friend to the party, but did not invite Tom.
Tom was jealous of him moving in next to Stanley.
0 - Unacceptable Response
The response does not show understanding of why Tom considered Jeremy his enemy.
The response may repeat words from the question, or may provide a vague response that
acknowledges that Jeremy moved in next door to Stanley or invited him to his party without
showing understanding of the consequence.
Education system
Percent
correct
Singapore
Ireland
Denmark
Sweden
Canada
United States
Chinese Taipei-CHN
Northern Ireland-GBR
Hong Kong-CHN
Portugal
New Zealand
Georgia
Czech Republic
Croatia
Netherlands
Australia
Russian Federation
Poland
Israel
Germany
Finland
Italy
Slovak Republic
Slovenia
England-GBR
France
Azerbaijan
Hungary
International average
Austria
Belgium (French)-BEL
Spain
Lithuania
Bulgaria
Romania
Norway
Trinidad and Tobago
Malta
Colombia
Saudi Arabia
Qatar
Iran, Islamic Rep. of
United Arab Emirates
Indonesia
Oman
Morocco
87
86
84
84
83
83
82
81
81
80
79
79
79
78
78
77
77
76
76
75
75
74
74
74
73
72
71
71
70
69
68
68
65
64
63
63
62
59
59
56
52
52
51
45
43
42
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Abu Dhabi-UAE
Maltese-MLT
87
83
82
81
70
60
47
41
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
33
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
34
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
SCORING
1 - Acceptable Response
The response identifies either (earth)worms or rocks as an ingredient.
0 - Unacceptable Response
The response does not provide either of the ingredients listed above. The response may
provide a vague description without mention of a specific ingredient, may name an incorrect
ingredient alongside a correct response, or may describe what would happen to someone who
ate the pie.
Examples:
rocks and dirt
worms and raspberries
disgusting things
Education system
Percent
correct
Russian Federation
Ireland
Singapore
Hong Kong-CHN
Netherlands
Germany
England-GBR
United States
Canada
Sweden
Italy
Spain
Northern Ireland-GBR
Croatia
Finland
New Zealand
Australia
France
Czech Republic
Portugal
Belgium (French)-BEL
Chinese Taipei-CHN
Austria
Denmark
Poland
Slovak Republic
Hungary
Israel
Slovenia
International average
Bulgaria
Romania
Malta
Norway
Indonesia
Lithuania
Trinidad and Tobago
Colombia
Azerbaijan
Saudi Arabia
Georgia
Qatar
United Arab Emirates
Iran, Islamic Rep. of
Oman
Morocco
90
83
83
82
82
81
81
81
81
80
80
79
79
79
79
78
78
78
77
77
76
75
73
72
72
72
70
69
69
67
66
64
60
59
58
57
56
52
51
44
40
39
39
36
33
27
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Andalusia-ESP
Ontario-CAN
Alberta-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
84
83
81
79
78
51
47
34
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
35
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
36
Passage
Reading Purpose
ENEMY PIE
Literary Experience
Comprehension Process of
the Task
Interpret and Integrate
Ideas and Information
Find the part of the story next to the picture of a piece of pie:
Why did Tom think it could be a great summer after all?
A.
B.
C.
D.
Correct Response:
Education system
Percent
correct
Singapore
Netherlands
Northern Ireland-GBR
Ireland
Russian Federation
Finland
United States
Australia
England-GBR
Israel
Hungary
Canada
Lithuania
Slovenia
Croatia
Germany
New Zealand
Hong Kong-CHN
Italy
France
Sweden
Poland
Portugal
Denmark
Romania
International average
Norway
Spain
Bulgaria
Trinidad and Tobago
Austria
Malta
Czech Republic
Georgia
Belgium (French)-BEL
Slovak Republic
Chinese Taipei-CHN
Iran, Islamic Rep. of
Azerbaijan
Colombia
United Arab Emirates
Indonesia
Morocco
Qatar
Saudi Arabia
Oman
60
60
60
59
57
56
55
54
54
54
53
53
52
48
48
47
46
46
45
44
44
44
44
43
42
42
40
39
39
37
36
36
36
35
35
34
33
29
29
29
26
25
25
24
21
17
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
58
57
53
47
39
39
35
24
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
37
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
How did Tom feel when he first smelled Enemy Pie? Explain why
he felt this way.
SCORING
2 - Complete Comprehension
The response shows understanding that Tom was confused because he thought Enemy Pie
was supposed to smell bad, or that Tom was surprised because the pie his dad made (actually)
smelled good.
Examples:
confused because he thought it was made with disgusting things
He didnt understand. It should taste horrible.
1 - Partial Comprehension
The response shows understanding that Tom was confused or surprised when he smelled
Enemy Pie for the first time, but does not explain why. -OR-
The response explains that Enemy Pie didnt smell the way he thought it would without
providing the feeling.
0 - No Comprehension
The response does not provide either the appropriate feeling or an explanation.
Education system
Percent
correct
Singapore
Northern Ireland-GBR
Ireland
England-GBR
Croatia
United States
Italy
Canada
Hong Kong-CHN
New Zealand
Sweden
Lithuania
Israel
Finland
Netherlands
Australia
Hungary
Russian Federation
Portugal
Slovenia
Spain
Slovak Republic
International average
Malta
Bulgaria
Germany
Romania
Poland
Chinese Taipei-CHN
Denmark
France
Trinidad and Tobago
Georgia
Czech Republic
Saudi Arabia
Azerbaijan
Austria
Iran, Islamic Rep. of
Colombia
United Arab Emirates
Qatar
Oman
Belgium (French)-BEL
Norway
Indonesia
Morocco
54
51
49
49
48
48
46
44
40
38
37
37
36
35
35
35
34
33
33
32
31
30
29
29
28
28
28
25
24
24
23
21
19
19
18
18
18
16
15
13
12
12
10
8
7
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
Not applicable.
51
49
45
35
26
23
20
10
38
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
39
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
What did Tom think could happen when his enemy ate Enemy Pie?
Write one thing.
SCORING
1 - Acceptable Response
The response identifies one of the consequences of eating Enemy Pie from the list below.
- His hair would fall out.
- His breath would stink.
- He would go away.
- Something bad would happen./He would get sick (or die).
0 - Unacceptable Response
The response does not provide any of the words or phrases in the list above. The response
may repeat words from the question.
Examples:
He might like it.
He would become his friend.
Nothing would happen.
Education system
Percent
correct
Ireland
Czech Republic
Russian Federation
Northern Ireland-GBR
Hungary
Sweden
Croatia
Hong Kong-CHN
United States
Slovak Republic
Italy
England-GBR
Finland
Germany
Chinese Taipei-CHN
Lithuania
Canada
Singapore
Portugal
Netherlands
Denmark
Poland
Austria
Spain
Israel
Belgium (French)-BEL
Slovenia
Australia
New Zealand
Norway
International average
Bulgaria
Georgia
France
Romania
Colombia
Azerbaijan
Malta
Trinidad and Tobago
Iran, Islamic Rep. of
United Arab Emirates
Saudi Arabia
Qatar
Indonesia
Oman
Morocco
88
88
86
86
85
84
84
84
83
83
83
83
81
81
81
81
80
80
80
79
78
78
78
77
77
77
77
74
74
72
71
71
70
69
66
60
58
58
54
49
45
44
43
43
21
17
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
88
83
82
81
78
57
54
41
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
40
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
41
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
What were the two things Toms dad told Tom to do for Enemy Pie
to work?
SCORING
2 - Complete Comprehension
The response identifies both actions that make Enemy Pie work: 1) spending the day with his
enemy and 2) being nice to him.
Examples:
be nice to his enemy for a whole day
be nice and play with him for a day
spend the whole day with Jeremy and be nice
1 - Partial Comprehension
The response provides one action that Tom was told to do by his Dad.
Examples:
be nice
spend the day with him
play and be nice
0 - No Comprehension
The response does not provide an accurate action that Tom was told to do by his Dad.
Examples:
play with him (Please note that this is not one of the things Toms dad told him to do and is too
vague to be considered as a paraphrase of either spending the day or being nice.)
stop being enemies (Please note that Toms dad did not tell him to stop being enemies with
Jeremy, nor did he tell him to be his friend.)
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
42
Education system
Percent
correct
Hong Kong-CHN
Singapore
Chinese Taipei-CHN
Croatia
Portugal
Czech Republic
Lithuania
Hungary
Russian Federation
Germany
Slovenia
Finland
United States
Canada
Slovak Republic
Spain
Netherlands
Ireland
Northern Ireland-GBR
Bulgaria
Israel
Poland
Sweden
Austria
Italy
England-GBR
Australia
International average
New Zealand
Denmark
France
Belgium (French)-BEL
Romania
Norway
Malta
Azerbaijan
Georgia
Trinidad and Tobago
Indonesia
Saudi Arabia
Iran, Islamic Rep. of
United Arab Emirates
Qatar
Colombia
Oman
Morocco
73
71
71
63
62
62
62
61
61
59
58
57
55
53
53
53
53
52
52
51
50
50
50
49
49
48
47
46
45
45
43
43
42
36
35
33
32
31
30
26
25
25
23
20
15
7
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Quebec-CAN
Alberta-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
64
53
52
50
49
33
33
21
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
43
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
Education system
A.
B.
C.
D.
Netherlands
Finland
Denmark
Lithuania
United States
Germany
Sweden
Russian Federation
Ireland
Northern Ireland-GBR
Croatia
Hungary
Israel
Singapore
Norway
Canada
Portugal
Czech Republic
Bulgaria
Italy
Hong Kong-CHN
Austria
New Zealand
Australia
England-GBR
Chinese Taipei-CHN
International average
Romania
Slovak Republic
Slovenia
Poland
France
Belgium (French)-BEL
Azerbaijan
Malta
Spain
Trinidad and Tobago
Colombia
United Arab Emirates
Saudi Arabia
Qatar
Iran, Islamic Rep. of
Georgia
Indonesia
Oman
Morocco
90
88
88
87
86
85
83
83
83
82
82
82
81
80
80
78
78
78
77
76
76
75
74
73
72
71
71
71
71
70
70
69
68
66
64
62
60
60
54
52
51
49
49
45
45
29
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Alberta-CAN
Ontario-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
92
80
80
75
65
62
60
52
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
44
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
SCORING
1 - Acceptable Response
The response shows understanding that Tom had a positive experience with Jeremy. The
response may indicate that he enjoyed spending time with Jeremy, that Jeremy wasnt as bad
as Tom expected, or that they had become friends.
Examples:
He was actually having fun with Jeremy.
They were getting along.
Jeremy wasnt so bad after all.
Education system
Netherlands
Finland
Russian Federation
Northern Ireland-GBR
Ireland
United States
Canada
Germany
Denmark
England-GBR
Australia
Hungary
Slovak Republic
Lithuania
Austria
Singapore
Czech Republic
New Zealand
Portugal
Poland
Croatia
Belgium (French)-BEL
Italy
Norway
France
Spain
Bulgaria
Hong Kong-CHN
Israel
International average
Sweden
Romania
Georgia
Malta
Chinese Taipei-CHN
Trinidad and Tobago
Colombia
Saudi Arabia
United Arab Emirates
Qatar
Indonesia
Iran, Islamic Rep. of
Azerbaijan
Oman
Morocco
Slovenia
88
87
86
86
86
86
83
83
83
83
81
81
81
79
78
77
77
77
76
76
73
73
72
71
71
70
69
69
68
66
64
64
60
56
54
49
42
42
35
34
33
31
24
21
9
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
0 - Unacceptable Response
The response does not accurately describe what surprised Tom.
Examples:
Tom was surprised.
Jeremy was going to eat the Enemy Pie.
Percent
correct
Not applicable.
88
84
83
78
69
51
46
30
45
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
46
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
At dinner, why did Tom begin to think he and his dad should
forget about Enemy Pie?
A.
B.
C.
D.
Correct Response:
Education system
Percent
correct
Northern Ireland-GBR
Netherlands
Finland
Ireland
Russian Federation
England-GBR
United States
Canada
Czech Republic
Denmark
Germany
Sweden
Lithuania
Italy
Hungary
Slovak Republic
Singapore
Australia
Spain
Poland
New Zealand
Austria
Bulgaria
Norway
Portugal
France
Hong Kong-CHN
Slovenia
Israel
Chinese Taipei-CHN
International average
Belgium (French)-BEL
Croatia
Romania
Trinidad and Tobago
Georgia
Malta
Azerbaijan
Colombia
Iran, Islamic Rep. of
United Arab Emirates
Saudi Arabia
Indonesia
Qatar
Morocco
Oman
94
93
92
92
91
89
89
89
89
88
88
87
86
86
85
85
85
85
84
84
83
83
83
83
82
82
81
80
78
78
76
76
76
72
65
65
63
63
55
53
51
50
49
49
39
37
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Quebec-CAN
Alberta-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
91
88
87
86
85
65
54
45
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
47
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
How was Tom feeling when Dad passed the piece of Enemy Pie to
Jeremy?
A.
alarmed
B.
satisfied
C.
surprised
D.
confused
Correct Response:
Education system
Percent
correct
Finland
Croatia
Sweden
Denmark
France
Slovenia
United States
Northern Ireland-GBR
Israel
Russian Federation
Canada
Ireland
England-GBR
Bulgaria
Australia
Azerbaijan
Hungary
Singapore
Italy
Hong Kong-CHN
Norway
New Zealand
Belgium (French)-BEL
Germany
Spain
Poland
Czech Republic
Chinese Taipei-CHN
Slovak Republic
Romania
Austria
Netherlands
International average
Portugal
Iran, Islamic Rep. of
Colombia
Lithuania
Georgia
Trinidad and Tobago
Malta
Qatar
United Arab Emirates
Saudi Arabia
Oman
Indonesia
Morocco
91
84
84
84
81
80
79
79
78
78
77
76
76
76
75
74
73
73
71
71
71
69
68
68
68
68
67
66
65
65
64
64
64
60
59
57
52
50
39
39
34
31
29
23
23
21
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Andalusia-ESP
Alberta-CAN
Quebec-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
85
80
75
74
70
65
42
27
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
48
Passage
Reading Purpose
ENEMY PIE
Literary Experience
Comprehension Process of
the Task
Interpret and Integrate Ideas
and Information
Overall Percent Correct
Percent
correct
Education system
A.
B.
It tasted disgusting.
C.
D.
United States
Finland
Netherlands
Russian Federation
Czech Republic
Hong Kong-CHN
Slovenia
Germany
Canada
Poland
Slovak Republic
Northern Ireland-GBR
Italy
Denmark
England-GBR
Israel
Austria
Hungary
Singapore
Ireland
Bulgaria
Sweden
Australia
Spain
Chinese Taipei-CHN
Croatia
New Zealand
International average
Portugal
Norway
Romania
Belgium (French)-BEL
Georgia
France
Iran, Islamic Rep. of
Azerbaijan
Malta
Lithuania
Colombia
Trinidad and Tobago
United Arab Emirates
Qatar
Saudi Arabia
Oman
Indonesia
Morocco
79
77
77
73
73
71
70
70
69
68
68
67
67
66
65
65
65
64
64
64
64
63
62
60
59
58
56
56
55
53
53
52
47
46
45
45
39
37
37
36
30
29
27
23
20
20
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Quebec-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
81
72
71
60
59
43
38
26
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
49
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
Education system
B.
C.
D.
Correct Response:
Percent
correct
Hong Kong-CHN
Finland
Germany
Slovenia
Netherlands
Chinese Taipei-CHN
Russian Federation
Singapore
Ireland
Croatia
England-GBR
Czech Republic
Northern Ireland-GBR
Portugal
Denmark
United States
Canada
Hungary
Belgium (French)-BEL
Sweden
Lithuania
Austria
Australia
France
Israel
Bulgaria
Italy
Romania
Poland
Slovak Republic
New Zealand
International average
Spain
Azerbaijan
Georgia
Malta
Colombia
Saudi Arabia
Trinidad and Tobago
Indonesia
Iran, Islamic Rep. of
United Arab Emirates
Norway
Qatar
Oman
Morocco
95
94
92
92
91
91
91
91
90
90
90
89
89
89
89
88
87
86
86
86
86
85
85
84
84
83
83
82
82
81
81
79
78
70
70
67
64
64
64
59
58
56
55
50
37
35
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Ontario-CAN
Alberta-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
90
89
85
83
81
67
65
52
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
50
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
Use what you have read to explain why Toms dad really made
Enemy Pie.
SCORING
1 - Acceptable Response
The response demonstrates understanding that Toms dads plan for Enemy Pie was for Tom
and Jeremy to become friends
Examples:
to make them be friends and not enemies
He wanted them to be friends.
to get them to play together and to make them friends
0 - Unacceptable Response
The response does not provide an appropriate explanation for why Toms dad really made
Enemy Pie. The response may indicate that Toms dad wanted the boys to spend time together
without specific reference to the intended outcome, or it may refer generally to Tom having no
enemies without reference to Tom and Jeremys relationship.
Examples:
He made Tom play with Jeremy.
So they would get to know each other.
Education system
Percent
correct
Russian Federation
Hong Kong-CHN
Finland
Chinese Taipei-CHN
Germany
United States
Sweden
Italy
Northern Ireland-GBR
Hungary
Poland
Croatia
Canada
Ireland
Denmark
Netherlands
England-GBR
Portugal
Israel
Bulgaria
Slovak Republic
Singapore
Slovenia
New Zealand
Czech Republic
Spain
Australia
Romania
Georgia
International average
Austria
Lithuania
France
Belgium (French)-BEL
Iran, Islamic Rep. of
Norway
Azerbaijan
Trinidad and Tobago
Malta
Qatar
Colombia
United Arab Emirates
Saudi Arabia
Indonesia
Oman
Morocco
75
73
71
69
64
63
63
62
62
62
62
61
61
61
60
59
59
58
58
57
57
57
56
56
56
55
53
52
50
50
49
47
46
46
45
43
36
31
29
25
25
22
15
12
10
4
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Quebec-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
67
66
62
52
51
33
28
18
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
51
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
52
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
SCORING
2 - Complete Comprehension
The response describes one plausible character trait of Toms dad that is central to his role
in the story (e.g., helpful, caring, nice, good, smart, clever, tricky, secretive). In addition, the
response provides one example of Toms dads actions that is evidence of the character trait.
Examples:
He was caring because he wanted to help his son make friends.
He was smart in how he found a way for the boys to like each other.
1 - Partial Comprehension
The response provides one plausible character trait of Toms dad that is central to his role in
the story (e.g., helpful, caring, smart, clever, tricky, secretive). Traits may be expressed as a
longer description, rather than as a single word.
0 - No Comprehension
The response does not provide an appropriate description of Toms dads character. The
response may provide a general character trait of Toms dad that is not supported by the text,
or a vague description that demonstrates limited comprehension of the story without further
textual support. -OR The response may provide an example of Toms dads actions without providing a character
trait.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
53
Education system
Percent
correct
Singapore
United States
Northern Ireland-GBR
Hong Kong-CHN
Russian Federation
Canada
England-GBR
Ireland
Chinese Taipei-CHN
Israel
Portugal
New Zealand
Bulgaria
Hungary
Croatia
Romania
Spain
Czech Republic
Italy
International average
Sweden
Slovak Republic
Iran, Islamic Rep. of
Lithuania
Denmark
Finland
Australia
Georgia
Azerbaijan
Germany
Malta
France
Norway
Netherlands
Trinidad and Tobago
Austria
United Arab Emirates
Qatar
Colombia
Poland
Belgium (French)-BEL
Saudi Arabia
Slovenia
Oman
Indonesia
Morocco
51
50
48
45
43
43
41
41
38
34
34
33
32
31
28
28
27
27
26
24
24
24
24
22
22
22
22
21
20
19
17
17
17
15
14
13
12
11
11
10
9
9
9
6
5
0
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Andalusia-ESP
Quebec-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
54
54
39
27
23
22
16
8
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
54
Passage
Reading Purpose
Comprehension Process of
the Task
ENEMY PIE
Literary Experience
Education system
SCORING
1 - Acceptable Response
The response provides an evaluation of the main message or theme of the story that
acknowledges the importance of giving a relationship the chance to grow before deciding
whether someone is your friend, or indicates that it is possible to change how you feel about
someone.
Examples:
Dont judge someone before you know them.
You can make friends if you give it a chance.
Your enemy can become your friend.
0 - Unacceptable Response
The response does not provide a plausible evaluation of the main message or theme of
the story. The response may provide a main message that is too general, or may refer to a
message that is not central to the story.
Examples:
Be nice to everyone.
You shouldnt have enemies. (Please note that this is an inacurate generalization of the main
message.)
Dont eat Enemy Pie.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
55
Percent
correct
Germany
United States
Sweden
Denmark
Ireland
Norway
Canada
England-GBR
Finland
Hong Kong-CHN
Italy
Slovak Republic
Northern Ireland-GBR
Bulgaria
Israel
Hungary
Singapore
Netherlands
Austria
Czech Republic
Croatia
Portugal
Romania
Slovenia
Australia
International average
New Zealand
Poland
Russian Federation
Trinidad and Tobago
Georgia
Malta
Chinese Taipei-CHN
Lithuania
France
Saudi Arabia
Belgium (French)-BEL
Indonesia
Spain
Qatar
Colombia
United Arab Emirates
Azerbaijan
Iran, Islamic Rep. of
Oman
Morocco
60
49
49
46
45
43
43
42
41
40
39
39
38
38
38
36
36
35
35
35
34
34
32
32
32
30
30
29
28
27
26
26
22
22
22
20
19
16
16
15
14
13
12
9
8
1
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Maltese-MLT
Andalusia-ESP
Dubai-UAE
Abu Dhabi-UAE
54
46
39
36
19
16
15
11
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
56
Discover the
Fun of Day
Hiking
Looking for something fun and interesting
to do at home or on holiday?
Most of all, dont forget to have fun on your
hike. Enjoy being outdoors. Look at all
the interesting things around you. Learn
to identify new places, plants, and animals.
Appreciate the beauty of the land and nature,
and get good healthy exercise too!
PIRLS67
12345ABCDE
Lookout Hill
A Hike Full of Adventures
Old Rock
Fort
Picnic
Area
Lookout
Hill
Station
Choose which
route to take!
Use one of our suggestions, or make up
a route of your own.
Bird
Sanctuary
Map Key
Route Name
Bird Walk
Lookout
Station Hike
Frog Creek
Trail
Lookout Hill
Circle
Route
Time
Level
Description
2 hours
Easy,
Loop around the bird
Wheelchair sanctuary
access
2 to 2.5 hours Hard
Climb Lookout Hill and
each way
see the view
3 hours
Medium
Hike to Frog Creek
Picnic Area
5 hours
Medium
Passage
Reading Purpose
DAY HIKING
Comprehension Process of
the Task
Make Straightforward Inferences
Overall Percent Correct
Percent
correct
What is the main message the leaflet gave you about hiking?
Education system
A.
B.
C.
D.
Chinese Taipei-CHN
Russian Federation
Netherlands
Hong Kong-CHN
Croatia
Denmark
Finland
United States
Germany
Singapore
Portugal
England-GBR
Northern Ireland-GBR
Australia
Lithuania
Ireland
Sweden
Iran, Islamic Rep. of
Canada
Bulgaria
Austria
New Zealand
Israel
International average
Slovak Republic
Poland
Spain
Italy
Belgium (French)-BEL
France
Georgia
Azerbaijan
Malta
Czech Republic
Norway
Romania
Slovenia
Hungary
Trinidad and Tobago
Indonesia
United Arab Emirates
Qatar
Colombia
Oman
Saudi Arabia
Morocco
92
91
91
91
90
90
89
87
87
86
85
84
84
84
83
83
83
83
82
81
80
80
80
76
76
76
75
75
75
73
73
72
71
71
71
69
69
68
64
60
58
58
57
49
48
47
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Alberta-CAN
Ontario-CAN
Quebec-CAN
Maltese-MLT
Andalusia-ESP
Dubai-UAE
Abu Dhabi-UAE
89
83
82
79
78
75
67
56
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
59
Passage
Reading Purpose
Comprehension Process of
the Task
DAY HIKING
Give two interesting things the leaflet said you might see
on a day hike.
1.
2.
SCORING
1 - Acceptable Response
The response lists two sights as mentioned in the text. See the list below for appropriate sights.
Examples: Plants/Nature, Birds/ Animals/ Wildlife/ Nature, Caves, Waterfalls, Hidden valleys,
Forts, Remains of buildings, Any of the locations on the map (e.g., lookout station, picnic area,
frog creek), Beautiful places, New places, Spectacular views
0 - Unacceptable Response
The response lists fewer than two sights as mentioned in the text. The response may be vague
or inappropriate.
Examples:
New and exciting things.
First aid kit and new things.
Education system
Percent
correct
Hong Kong-CHN
Singapore
Netherlands
Russian Federation
Slovak Republic
Finland
United States
Northern Ireland-GBR
Poland
Germany
England-GBR
Australia
Ireland
Hungary
Croatia
Israel
Czech Republic
Portugal
Bulgaria
New Zealand
Denmark
Austria
Malta
Slovenia
International average
Chinese Taipei-CHN
France
Italy
Trinidad and Tobago
Belgium (French)-BEL
Georgia
Canada
Lithuania
Sweden
Spain
Norway
Romania
Saudi Arabia
United Arab Emirates
Indonesia
Oman
Azerbaijan
Colombia
Qatar
Iran, Islamic Rep. of
Morocco
92
86
85
84
81
78
78
77
77
76
75
75
74
73
73
73
72
72
72
68
66
66
64
64
63
63
63
63
62
62
62
60
59
58
57
55
52
48
43
40
35
35
34
34
27
22
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Ontario-CAN
Dubai-UAE
Alberta-CAN
Andalusia-ESP
Maltese-MLT
Abu Dhabi-UAE
81
68
60
55
55
52
44
37
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
60
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
61
Passage
Reading Purpose
Comprehension Process of
the Task
DAY HIKING
What are two things the leaflet told you to keep in mind when you
are hiking in a group?
1.
2.
SCORING
2 - Complete Comprehension
The response states two suggestions for hiking in a group; one about the ability and the other
about the interests of the group members.
Examples of Ability:
Everyone should be able to do it.
Go only as fast as the slowest person in the group.
Examples of Interest:
Choose a hike that suits everybody. [interest]
It should be fun and interesting for everyone.
1 - Partial Comprehension
The response states only one suggestion for hiking in a group that takes into account either the
ability or the interests of the group members.
0 - No Comprehension
The response does not provide an accurate or acceptable suggestion for hiking in a group. It
may provide a general suggestion for hiking not specific to being in a group, or a suggestion
about being in a group that does not come from the leaflet.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
62
Education system
Percent
correct
Finland
England-GBR
Denmark
Russian Federation
Hong Kong-CHN
Singapore
Northern Ireland-GBR
Ireland
Israel
Australia
United States
Canada
New Zealand
Portugal
Slovenia
Slovak Republic
Romania
Malta
Germany
Poland
International average
Hungary
Netherlands
Croatia
Bulgaria
Spain
Trinidad and Tobago
Italy
United Arab Emirates
Belgium (French)-BEL
Czech Republic
Sweden
Austria
Chinese Taipei-CHN
Lithuania
France
Georgia
Iran, Islamic Rep. of
Norway
Morocco
Oman
Azerbaijan
Indonesia
Qatar
Saudi Arabia
Colombia
21
19
19
18
18
18
18
16
15
15
15
13
13
12
12
11
11
11
11
11
10
10
10
10
9
9
9
9
8
8
7
7
7
7
7
6
5
5
5
5
5
5
4
4
4
2
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Dubai-UAE
Quebec-CAN
Andalusia-ESP
Abu Dhabi-UAE
Maltese-MLT
15
15
12
10
8
8
7
6
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
63
Passage
Reading Purpose
DAY HIKING
B.
C.
Packing Checklist
D.
Correct Response:
Which section of the leaflet told you to wear the right clothes
for the weather?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Chinese Taipei-CHN
Germany
Singapore
Russian Federation
United States
Israel
Croatia
Finland
Denmark
Italy
Canada
Sweden
Hungary
Austria
Norway
Portugal
Slovenia
Czech Republic
Netherlands
England-GBR
Slovak Republic
Northern Ireland-GBR
Lithuania
International average
Ireland
Azerbaijan
Australia
Malta
New Zealand
Saudi Arabia
France
Trinidad and Tobago
Belgium (French)-BEL
Bulgaria
Poland
United Arab Emirates
Romania
Qatar
Iran, Islamic Rep. of
Oman
Spain
Georgia
Indonesia
Colombia
Morocco
85
73
71
71
69
69
68
67
66
65
64
64
63
62
61
61
60
60
60
59
59
58
58
57
55
55
54
54
53
52
50
50
50
50
50
49
47
46
44
43
42
40
38
27
26
23
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Quebec-CAN
Alberta-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
Andalusia-ESP
69
67
62
59
53
51
44
35
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
64
Passage
Reading Purpose
DAY HIKING
B.
C.
in case of blisters
D.
for a friend
Correct Response:
5.
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Finland
Netherlands
Chinese Taipei-CHN
Singapore
United States
Croatia
Sweden
Russian Federation
Northern Ireland-GBR
Denmark
Canada
Ireland
England-GBR
Slovak Republic
Czech Republic
Italy
France
Portugal
Bulgaria
Lithuania
Belgium (French)-BEL
Spain
Norway
Australia
Germany
Austria
Poland
New Zealand
Israel
Slovenia
International average
Malta
Hungary
Romania
Trinidad and Tobago
Georgia
Azerbaijan
Iran, Islamic Rep. of
United Arab Emirates
Indonesia
Saudi Arabia
Qatar
Colombia
Oman
Morocco
98
96
95
95
95
95
94
94
94
94
93
93
93
92
91
91
91
91
91
90
90
90
90
90
90
90
89
88
88
88
87
84
82
80
79
76
75
73
72
68
66
62
60
57
51
34
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
95
94
93
92
91
79
78
63
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
65
Passage
Reading Purpose
DAY HIKING
B.
C.
D.
Correct Response:
6.
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Chinese Taipei-CHN
Finland
Northern Ireland-GBR
Singapore
Netherlands
United States
England-GBR
Sweden
Ireland
Canada
Croatia
Italy
Australia
Russian Federation
Denmark
Israel
France
New Zealand
Lithuania
Germany
Spain
Hungary
Czech Republic
Slovak Republic
Portugal
Austria
Bulgaria
International average
Belgium (French)-BEL
Norway
Slovenia
Poland
Malta
Trinidad and Tobago
Romania
Georgia
Saudi Arabia
Iran, Islamic Rep. of
United Arab Emirates
Qatar
Azerbaijan
Indonesia
Colombia
Oman
Morocco
90
89
89
89
89
88
87
86
86
85
84
83
83
82
82
81
80
80
80
80
79
79
78
77
76
76
76
76
74
73
73
72
69
69
68
67
65
61
59
58
50
50
49
46
45
24
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
87
85
85
81
79
69
64
51
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
66
Passage
Reading Purpose
DAY HIKING
start early
B.
C.
pace yourself
D.
Correct Response:
7.
Comprehension Process of
the Task
Education system
Percent
correct
Netherlands
Chinese Taipei-CHN
Croatia
Finland
Russian Federation
Denmark
Czech Republic
Poland
Bulgaria
Sweden
Portugal
Austria
Slovak Republic
Israel
France
Singapore
Belgium (French)-BEL
United States
Italy
Canada
Hungary
Spain
Hong Kong-CHN
Lithuania
New Zealand
Romania
Northern Ireland-GBR
International average
Georgia
England-GBR
Slovenia
Australia
Ireland
Azerbaijan
Germany
Colombia
Iran, Islamic Rep. of
United Arab Emirates
Indonesia
Malta
Saudi Arabia
Qatar
Norway
Trinidad and Tobago
Oman
Morocco
86
84
83
83
82
82
80
78
78
77
74
74
74
72
72
71
71
70
69
69
68
67
66
65
64
62
62
62
62
62
60
59
59
58
57
49
47
43
40
39
37
36
36
35
26
18
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Ontario-CAN
Alberta-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
78
70
68
65
62
59
50
41
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
67
Passage
Reading Purpose
Comprehension Process of
the Task
DAY HIKING
8.
SCORING
1 - Acceptable Response
The response demonstrates understanding that someone can help you in case something
happens (e.g., you get into trouble or lost) and you dont return on time.
Examples:
Because if you are not back in time someone will know there is something wrong and will find
help.
In case you get lost.
0 - Unacceptable Response
The response may provide a reason that does not show an understanding of the potential
danger if the hiker does not return on time (lost or in trouble), or it may provide an inaccurate or
inappropriate reason.
Examples:
So they will know when you will return.
So they know where you are.
So they will know you are not lost
Education system
Percent
correct
Singapore
Finland
Austria
Netherlands
Chinese Taipei-CHN
Russian Federation
Northern Ireland-GBR
Croatia
Denmark
Bulgaria
Hong Kong-CHN
Israel
England-GBR
Portugal
United States
Italy
France
Germany
Canada
Ireland
Australia
Slovak Republic
Hungary
New Zealand
Sweden
Czech Republic
Spain
International average
Slovenia
Lithuania
Malta
Belgium (French)-BEL
Georgia
Poland
Trinidad and Tobago
Romania
Iran, Islamic Rep. of
Norway
United Arab Emirates
Saudi Arabia
Azerbaijan
Qatar
Colombia
Oman
Indonesia
Morocco
74
72
72
72
70
70
70
69
69
69
69
68
68
67
67
66
66
66
65
64
61
61
61
60
60
59
59
58
58
57
56
56
55
54
53
51
50
46
44
43
41
40
34
33
31
14
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Quebec-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
71
67
66
65
57
55
48
36
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
68
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
69
Passage
Reading Purpose
DAY HIKING
Bird Walk
B.
C.
D.
Correct Response:
9.
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Singapore
Chinese Taipei-CHN
Finland
Denmark
England-GBR
Germany
Netherlands
United States
Austria
Norway
Northern Ireland-GBR
Sweden
Portugal
Ireland
Australia
Czech Republic
Russian Federation
Canada
France
New Zealand
Slovenia
Belgium (French)-BEL
Bulgaria
Croatia
Poland
International average
Hungary
Spain
Israel
Lithuania
Slovak Republic
Italy
Malta
United Arab Emirates
Romania
Indonesia
Trinidad and Tobago
Qatar
Georgia
Iran, Islamic Rep. of
Colombia
Oman
Azerbaijan
Saudi Arabia
Morocco
91
89
88
88
88
87
86
86
86
85
84
84
82
82
82
82
82
81
81
80
79
75
75
74
74
72
72
72
71
71
71
69
68
68
60
59
59
57
54
51
50
49
49
40
38
22
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Ontario-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
83
83
82
76
72
72
59
57
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
70
Passage
Reading Purpose
DAY HIKING
B.
C.
D.
Correct Response:
10.
Comprehension Process of
the Task
Education system
Percent
correct
Croatia
Czech Republic
Slovak Republic
Russian Federation
New Zealand
Portugal
United States
Singapore
Netherlands
Georgia
Ireland
Hungary
Indonesia
Denmark
Finland
Australia
Romania
Israel
Canada
Spain
Northern Ireland-GBR
Lithuania
Hong Kong-CHN
England-GBR
Germany
International average
Italy
Colombia
Chinese Taipei-CHN
France
Norway
Bulgaria
Austria
Malta
Slovenia
Poland
Sweden
Trinidad and Tobago
Belgium (French)-BEL
United Arab Emirates
Qatar
Azerbaijan
Iran, Islamic Rep. of
Oman
Saudi Arabia
Morocco
90
84
82
76
72
72
70
70
70
70
69
69
69
69
68
67
66
66
65
65
64
63
62
62
62
60
60
59
59
58
57
57
55
55
49
48
47
47
46
46
44
43
42
40
37
28
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
69
68
66
66
61
57
54
43
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
71
Passage
Reading Purpose
Comprehension Process of
the Task
DAY HIKING
What are two things you can learn by studying the map key?
1.
2.
SCORING
2 - Complete Comprehension
The response includes any two pieces of information that can be learned by studying the map
key, either specific or general, as listed below.
- time it takes for each hike
- the difficulty level of each hike
- symbols for each trail (route to take/which way to go/where it is)
- a description of each hike
- which hike is right for me/the best place to go
- which is shortest, longest, or most challenging (or any specific facts about a particular hike
from the table)
1 - Partial Comprehension
The response includes only one thing that can be learned by studying the map key, either
specific or general, as listed above.
0 - No Comprehension
The response does not include any accurate or relevant information that can be learned by
studying the map key, either specific or general.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
72
Education system
Percent
correct
Denmark
United States
England-GBR
Northern Ireland-GBR
Netherlands
Portugal
Hong Kong-CHN
Canada
Chinese Taipei-CHN
Ireland
New Zealand
Norway
Russian Federation
Czech Republic
Singapore
Israel
Germany
Sweden
Finland
Slovak Republic
Lithuania
Poland
Italy
Australia
Slovenia
Hungary
France
International average
Spain
Malta
Austria
Bulgaria
Belgium (French)-BEL
Trinidad and Tobago
Croatia
Romania
Georgia
United Arab Emirates
Saudi Arabia
Qatar
Indonesia
Oman
Azerbaijan
Colombia
Iran, Islamic Rep. of
Morocco
86
83
83
82
81
79
78
75
74
73
73
72
71
71
70
70
69
68
66
66
64
64
63
62
62
62
61
59
59
58
54
52
51
49
49
47
43
43
43
41
33
32
30
27
17
14
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Andalusia-ESP
Quebec-CAN
Dubai-UAE
Abu Dhabi-UAE
Maltese-MLT
87
81
79
62
59
48
42
23
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
73
Passage
Reading Purpose
Comprehension Process of
the Task
DAY HIKING
Use the map of Lookout Hill and the map key to plan a hike.
Check which route you would choose.
_________ Bird Walk
_________ Lookout Station Hike
_________ Frog Creek Trail
_________ Lookout Hill Circle
Give two reasons from the leaflet why you chose this route.
1.
2.
SCORING
2 - Complete Comprehension
The response indicates the selection of a route and provides two reasons related to the text for
choosing the route. Note that the reasons must be appropriate for the chosen route or routes
(e.g., I like wildlife would not be appropriate for the Lookout Station). Reasons may refer
specifically to the text in the map key or may refer to features of the map.
Example: Bird Walk. It is the easiest and shortest walk and you get to watch birds.
1 - Partial Comprehension
The response indicates the selection of a route and provides only one reason for choosing the
route. -OR It may provide two reasons that essentially refer to the same feature.
Example: Bird Walk. It takes two hours. It is the shortest.
0 - No Comprehension
The response may or may not indicate the selection of a route. The reason for choosing the
route is too general, vague, inaccurate, or not appropriate for the selection.
Education system
Percent
correct
Hong Kong-CHN
Singapore
Finland
England-GBR
United States
Portugal
Chinese Taipei-CHN
Israel
Northern Ireland-GBR
Denmark
Slovenia
Czech Republic
Canada
Italy
Russian Federation
Croatia
Ireland
Poland
New Zealand
France
Slovak Republic
Australia
Germany
Netherlands
International average
Sweden
Hungary
Belgium (French)-BEL
Austria
Lithuania
Romania
Bulgaria
Malta
Trinidad and Tobago
Spain
Norway
United Arab Emirates
Qatar
Georgia
Oman
Saudi Arabia
Indonesia
Colombia
Iran, Islamic Rep. of
Azerbaijan
Morocco
60
54
53
48
48
48
46
45
45
44
43
43
43
42
42
40
40
38
38
38
36
36
34
33
33
32
31
30
29
29
28
28
27
26
26
25
20
18
13
13
13
12
11
10
8
3
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
47
43
42
42
31
28
25
17
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
74
Student Responses
Correct Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
75
Student Responses
Partially Correct Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
76
Student Responses
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
77
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
78
A farmer went out one day to search for a lost calf. The herders had
returned without it the evening before. And that night there had been a
terrible storm.
He went to the valley and searched by the riverbed, among the
reeds, behind the rocks and in the rushing water.
He climbed the slopes of the high mountain with its rocky cliffs. He
looked behind a large rock in case the calf had huddled there to escape
the storm. And that was where he stopped. There, on a ledge of rock, was
a most unusual sight. An eagle chick had hatched from its egg a day or
two earlier, and had been blown from its nest by the terrible storm.
He reached out and cradled the chick in both hands. He would take
it home and care for it.
He was almost home when the children ran out to meet him.
The calf came back by itself! they shouted.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
79
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
80
So, the eagle lived among the chickens, learning their ways. As it
grew, it began to look quite different from any chicken they had ever
seen.
One day a friend dropped in for a visit. The friend saw the bird
among the chickens.
Hey! That is not a chicken. Its an eagle!
The farmer smiled at him and said, Of course its a chicken. Look
it walks like a chicken, it eats like a chicken. It thinks like a chicken. Of
course its a chicken.
But the friend was not convinced. I will show you that it is an
eagle, he said.
The farmers children helped his friend catch the bird. It was fairly
heavy, but the farmers friend lifted it above his head and said, You are
not a chicken but an eagle. You belong not to the earth but to the sky.
Fly, Eagle, fly!
The bird stretched out its wings, looked about, saw the chickens
feeding, and jumped down to scratch with them for food.
I told you it was a chicken, the farmer said, and he roared
with laughter.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
81
Very early the next morning the farmers dogs began to bark. A
voice was calling outside in the darkness. The farmer ran to the door. It
was his friend again. Give me another chance with the bird, he begged.
Do you know the time? It is long before dawn.
Come with me. Fetch the bird.
Reluctantly, the farmer picked up the bird, which was fast asleep
among the chickens. The two men set off, disappearing into the darkness.
Where are we going? asked the farmer sleepily.
To the mountains where you found the bird.
And why at this ridiculous time of the night?
So that our eagle may see the sun rise over the mountain and
follow it into the sky where it belongs.
They went into the valley and crossed the river, the friend leading
the way. Hurry, he said, for the dawn will arrive before we do.
The first light crept into the sky as they began to climb the
mountain. The wispy clouds in the sky were pink at first, and then began
to shimmer with a golden brilliance. Sometimes their path was dangerous
as it clung to the side of the mountain, crossing narrow shelves of rock
and taking them into dark crevices and out again. At last he said, This
will do. He looked down the cliff and saw the ground thousands of feet
below. They were very near the top.
Carefully, the friend carried the bird onto a ledge. He set it down
so that it looked toward the east, and began talking to it. The farmer
chuckled. It talks only chicken-talk.
But the friend talked on, telling the bird about the sun, how it gives
life to the world, and how it reigns in the heavens, giving light to each
new day. Look at the sun, Eagle. And when it rises, rise with it. You
belong to the sky, not to the earth. At that moment the suns first rays
shot out over the mountain, and suddenly the world was ablaze with
light.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
82
The sun rose majestically. The great bird stretched out its wings to
greet the sun and feel the warmth on its feathers. The farmer was quiet.
The friend said, You belong not to the earth, but to the sky. Fly, Eagle,
fly! He scrambled back to the farmer. All was silent. The eagles head
stretched up, its wings stretched outwards, and its legs leaned forward as
its claws clutched the rock.
Then, without really moving, feeling the updraft of a wind more
powerful than any man or bird, the great eagle leaned forward and was
swept upward higher and higher, lost to sight in the brightness of the
rising sun, never again to live among the chickens.
Fly, Eagle, Fly by Christopher Gregorowski and illustrated by Niki Daly. Published by Simon and
Schuster, New York. Text copyright 2000 by Christopher Gregorowski and illustrations copyright 2000 by Niki
Daly. An effort has been made to obtain copyright permission.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
83
Passage
Reading Purpose
Literary Experience
a calf
B.
herders
C.
rocky cliffs
D.
an eagle chick
Correct Response:
What did the farmer set out to look for at the beginning
of the story?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Russian Federation
Croatia
Hong Kong-CHN
Italy
Finland
Austria
Northern Ireland-GBR
Chinese Taipei-CHN
Czech Republic
Israel
Germany
Denmark
Netherlands
Slovenia
Bulgaria
Sweden
Canada
Lithuania
Portugal
Ireland
France
Georgia
Singapore
Azerbaijan
Hungary
Australia
England-GBR
New Zealand
Slovak Republic
Norway
Poland
United States
International average
Romania
Belgium (French)-BEL
Spain
Iran, Islamic Rep. of
Malta
Indonesia
Colombia
Trinidad and Tobago
United Arab Emirates
Saudi Arabia
Oman
Qatar
Morocco
99
98
97
96
96
96
96
95
95
95
95
94
94
94
94
94
94
93
93
93
93
93
92
92
91
91
91
91
90
90
90
90
89
88
87
86
85
84
82
81
81
74
73
72
71
52
Benchmarking
education system
Percent
correct
Ontario-CAN
Quebec-CAN
Alberta-CAN
Florida-USA
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
94
92
92
91
87
84
81
71
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
84
Passage
Reading Purpose
Literary Experience
Comprehension Process of
the Task
Focus on and Retrieve Explicitly
Stated Information and Ideas
Overall Percent Correct
Percent
correct
Education system
A.
in its nest
B.
by the riverbed
C.
on a ledge of rock
D.
Russian Federation
Chinese Taipei-CHN
Northern Ireland-GBR
Finland
Denmark
Hong Kong-CHN
Netherlands
Sweden
Israel
Germany
Italy
Hungary
Bulgaria
Ireland
Croatia
Slovenia
Romania
Canada
Singapore
Lithuania
Austria
Azerbaijan
Georgia
England-GBR
United States
France
Portugal
Australia
Slovak Republic
Poland
International average
Czech Republic
Norway
Spain
New Zealand
Colombia
Belgium (French)-BEL
Trinidad and Tobago
Malta
Iran, Islamic Rep. of
United Arab Emirates
Qatar
Saudi Arabia
Morocco
Indonesia
Oman
90
87
87
86
86
86
86
82
82
82
81
81
80
79
79
79
78
78
78
78
78
78
77
76
75
74
74
74
74
74
73
72
72
71
70
66
64
63
62
61
60
53
45
44
43
42
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Quebec-CAN
Ontario-CAN
Alberta-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
78
78
77
74
68
66
60
57
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
85
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
What in the story shows that the farmer was careful with
the eagle chick?
A.
B.
C.
D.
Correct Response:
Education system
Percent
correct
Northern Ireland-GBR
Chinese Taipei-CHN
Singapore
Germany
Austria
United States
Czech Republic
Portugal
Poland
England-GBR
Hungary
Lithuania
Slovak Republic
Hong Kong-CHN
Finland
Israel
Italy
Australia
Ireland
Slovenia
New Zealand
Russian Federation
France
Trinidad and Tobago
Canada
Colombia
Spain
International average
Malta
Croatia
Netherlands
United Arab Emirates
Azerbaijan
Bulgaria
Georgia
Denmark
Saudi Arabia
Belgium (French)-BEL
Indonesia
Iran, Islamic Rep. of
Qatar
Romania
Norway
Sweden
Oman
Morocco
86
86
84
83
79
78
75
74
74
74
73
73
72
71
71
70
70
69
69
68
68
66
66
66
65
64
64
64
63
63
60
57
57
56
55
55
54
54
51
50
47
43
42
38
34
30
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Abu Dhabi-UAE
Quebec-CAN
Maltese-MLT
79
70
67
61
58
56
50
40
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
86
Passage
Reading Purpose
Literary Experience
He taught it to fly.
B.
He set it free.
C.
He trained it to be a chicken.
D.
Correct Response:
What did the farmer do with the eagle chick when he brought it
home?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Czech Republic
Russian Federation
Croatia
Lithuania
Germany
Italy
Denmark
Sweden
Hong Kong-CHN
Slovak Republic
Chinese Taipei-CHN
Austria
Northern Ireland-GBR
Finland
Norway
Slovenia
Hungary
Netherlands
Singapore
Bulgaria
France
Ireland
Canada
Portugal
England-GBR
Poland
Israel
United States
Georgia
International average
New Zealand
Romania
Belgium (French)-BEL
Australia
Spain
Trinidad and Tobago
Azerbaijan
Malta
Iran, Islamic Rep. of
Colombia
United Arab Emirates
Saudi Arabia
Oman
Indonesia
Qatar
Morocco
97
97
97
97
96
96
96
95
95
95
95
95
95
95
95
94
93
93
92
92
92
92
91
91
91
91
89
89
88
88
88
88
87
87
85
83
82
80
80
79
74
70
70
66
64
58
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
93
92
91
89
86
81
81
70
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
87
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
During the friends first visit, the eagle chick behaved like a
chicken. Give two examples that show this.
1.
2.
SCORING
2 - Complete Comprehension
The response identifies two ways that the eagle chick behaved like a chicken listed below.
- It walks/moves like a chicken.
- It eats/pecks on the ground for food like a chicken.
- It thinks like a chicken.
- It wont fly (returns to the chickens on the ground).
- It scratches with the chickens.
1 - Partial Comprehension
The response identifies one way that the eagle chick behaved like a chicken listed above.
0 - No Comprehension
The response does not describe any of the ways listed above. It may include only a vague or
circular description of how the eagle behaved.
Examples:
It acted like a chicken.
It looked like one.
It learned chicken ways.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Education system
Percent
correct
Hong Kong-CHN
Belgium (French)-BEL
Singapore
Israel
Croatia
Finland
Denmark
Hungary
Northern Ireland-GBR
Canada
United States
Ireland
Netherlands
Sweden
Czech Republic
Russian Federation
Lithuania
England-GBR
Italy
Germany
Bulgaria
Spain
France
Chinese Taipei-CHN
Malta
Austria
International average
New Zealand
Slovak Republic
Portugal
Poland
Australia
Norway
Slovenia
Romania
Trinidad and Tobago
United Arab Emirates
Iran, Islamic Rep. of
Georgia
Qatar
Saudi Arabia
Colombia
Oman
Azerbaijan
Indonesia
Morocco
78
77
74
74
74
73
72
72
71
70
69
68
68
68
67
67
67
64
64
63
63
62
62
62
58
57
56
56
55
55
55
54
50
49
49
46
39
38
37
36
34
32
27
23
20
11
Benchmarking
education system
Percent
correct
Quebec-CAN
Florida-USA
Andalusia-ESP
Alberta-CAN
Ontario-CAN
Maltese-MLT
Dubai-UAE
Abu Dhabi-UAE
80
73
69
66
66
55
46
37
88
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
89
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
When the farmers friend first met the eagle, how did he try to
make the eagle fly?
A.
B.
C.
D.
Correct Response:
Education system
Percent
correct
Czech Republic
Finland
Northern Ireland-GBR
Croatia
Hong Kong-CHN
Denmark
Slovak Republic
Lithuania
Israel
Sweden
Italy
Singapore
Russian Federation
Chinese Taipei-CHN
Ireland
Bulgaria
England-GBR
Hungary
United States
Poland
Canada
Germany
Slovenia
Netherlands
Portugal
France
Austria
Georgia
Romania
International average
Norway
Australia
New Zealand
Spain
Iran, Islamic Rep. of
Belgium (French)-BEL
Malta
Azerbaijan
Trinidad and Tobago
Colombia
United Arab Emirates
Qatar
Saudi Arabia
Oman
Indonesia
Morocco
86
84
84
84
83
83
80
79
78
78
78
77
77
76
76
75
75
75
74
74
74
73
73
72
72
70
70
70
70
70
69
67
65
65
63
61
60
60
59
55
55
53
52
44
44
35
Benchmarking
education system
Percent
correct
Florida-USA
Quebec-CAN
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
77
76
75
71
67
61
60
51
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
90
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
Explain what the farmers friend meant when he told the eagle,
You belong not to the earth but to the sky.
SCORING
2 - Complete Comprehension
The response interprets the meaning of both parts of the quote belong not to the earth and
belong to the sky in terms of the story.
Examples:
It is supposed to be free in the sky and not stuck on the ground.
That it was not a chicken who walked on the earth. It was an eagle and meant to fly.
1 - Partial Comprehension
The response interprets only the first or the second part of the quote.
0 - No Comprehension
The response may provide an explanation of the quote that is vague or inaccurate, or it may
provide a simple rephrasing of the quote itself.
91
Percent
correct
Israel
Hong Kong-CHN
United States
Sweden
Netherlands
Russian Federation
England-GBR
Croatia
Hungary
Finland
Chinese Taipei-CHN
Ireland
Northern Ireland-GBR
Slovak Republic
Lithuania
Canada
New Zealand
Italy
Bulgaria
Germany
Singapore
Poland
Slovenia
Denmark
Czech Republic
International average
Australia
Romania
France
Belgium (French)-BEL
Norway
Portugal
Malta
Georgia
Austria
Spain
Trinidad and Tobago
United Arab Emirates
Iran, Islamic Rep. of
Qatar
Saudi Arabia
Colombia
Azerbaijan
Oman
Indonesia
Morocco
66
63
62
62
61
61
60
60
58
57
55
54
53
53
52
51
51
50
49
48
48
46
44
43
42
42
41
39
39
38
38
37
36
35
30
30
25
24
23
21
17
14
13
13
9
6
Benchmarking
education system
Percent
correct
Florida-USA
Ontario-CAN
Alberta-CAN
Quebec-CAN
Maltese-MLT
Dubai-UAE
Andalusia-ESP
Abu Dhabi-UAE
Example:
That it was not a chicken. /It was an eagle. -OR-
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Education system
66
57
51
46
43
32
30
23
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
92
Passage
Reading Purpose
Literary Experience
B.
C.
D.
Correct Response:
Why did the farmer roar with laughter during his friends first
visit?
A.
Comprehension Process of
the Task
Education system
Percent
correct
Hong Kong-CHN
Russian Federation
Northern Ireland-GBR
Singapore
Germany
Croatia
United States
Finland
England-GBR
Austria
Czech Republic
Ireland
Georgia
Portugal
Sweden
Slovenia
New Zealand
Israel
Canada
France
Poland
Azerbaijan
Italy
Australia
Spain
Lithuania
Slovak Republic
International average
Bulgaria
Iran, Islamic Rep. of
Chinese Taipei-CHN
Netherlands
Denmark
Trinidad and Tobago
Romania
Malta
Colombia
Saudi Arabia
Oman
Qatar
United Arab Emirates
Hungary
Norway
Belgium (French)-BEL
Indonesia
Morocco
72
68
66
63
62
59
59
59
59
59
58
56
55
54
53
53
52
52
51
51
50
50
50
50
49
48
47
46
45
45
44
41
39
36
34
33
32
29
28
27
25
25
20
20
17
12
Benchmarking
education system
Percent
correct
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Quebec-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
63
56
55
44
39
34
27
22
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
93
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
Why did the farmers friend take the eagle to the high mountains
to make it fly? Give two reasons.
1.
2.
SCORING
2 - Complete Comprehension
The response provides two reasons related to the sun, the mountains as the eagles natural
habitat, or the mountains height in the sky. See the list of appropriate reasons below.
- To see the sun (rise)/to feel the warmth of the sun/to follow the sun.
- To feel the updraft of the wind.
- To be in its natural home/where it belongs/where it was found.
- To get it closer to the sky/to get it higher.
1 - Partial Comprehension
The response provides one reason related to the sun, the mountains as the eagles natural
habitat, or the mountains height in the sky as listed above.
0 - No Comprehension
The response may provide a reason for making the eagle fly, rather than a reason for taking it
to the mountains.
The response may provide a reason that is vague or inaccurate, or it may simply repeat part of
the question.
Percent
correct
Singapore
Hungary
Israel
Northern Ireland-GBR
Hong Kong-CHN
Canada
Sweden
England-GBR
Denmark
New Zealand
United States
Russian Federation
Croatia
Czech Republic
Germany
Ireland
Finland
Netherlands
France
Austria
Slovenia
Italy
Chinese Taipei-CHN
International average
Lithuania
Australia
Georgia
Slovak Republic
Qatar
Romania
Portugal
Poland
Saudi Arabia
Malta
Norway
Spain
Belgium (French)-BEL
Bulgaria
Oman
United Arab Emirates
Iran, Islamic Rep. of
Indonesia
Azerbaijan
Colombia
Morocco
Trinidad and Tobago
31
30
25
24
24
23
23
22
21
20
20
20
19
19
19
19
19
19
18
18
17
17
17
17
16
16
16
16
15
15
14
14
14
13
13
13
12
11
11
10
9
9
8
5
3
Benchmarking
education system
Percent
correct
Alberta-CAN
Ontario-CAN
Quebec-CAN
Florida-USA
Maltese-MLT
Dubai-UAE
Andalusia-ESP
Abu Dhabi-UAE
Not applicable.
25
24
21
20
16
13
12
10
Examples:
It made it easier to fly.
To make it fly.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
Education system
94
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
95
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
Find and copy words that tell you how beautiful the sky
was at dawn.
Education system
SCORING
1 - Acceptable Response
The response provides any of the words or phrases in the list below.
Note any of the underlined words are sufficient and other parts of the quote also may
be given. Ignore minor variations in phrasing from the text, as long as it is clear what
is intended.
The wispy clouds in the sky were pink at first, then began to shimmer with golden brilliance.
The sun rose majestically.
The suns first rays shot over the mountain, and suddenly the world was ablaze with light.
Examples: Wispy pink clouds, Majestically, Golden brilliance, Ablaze with light
0 - Unacceptable Response
The response does not provide any of the words or phrases in the list above. The response
may repeat words from the question.
Examples: Sunrise, Dawn, Beautiful
Percent
correct
Hong Kong-CHN
Singapore
Portugal
Russian Federation
Northern Ireland-GBR
Croatia
England-GBR
Georgia
Ireland
Israel
Bulgaria
Lithuania
Canada
United States
New Zealand
Hungary
Australia
Romania
Finland
Chinese Taipei-CHN
Slovak Republic
Slovenia
Denmark
Italy
Germany
International average
Austria
Poland
Malta
France
Spain
Sweden
Netherlands
Czech Republic
Norway
Trinidad and Tobago
Iran, Islamic Rep. of
United Arab Emirates
Belgium (French)-BEL
Saudi Arabia
Colombia
Qatar
Indonesia
Oman
Azerbaijan
Morocco
89
80
76
76
75
74
73
71
71
69
69
68
68
67
67
67
64
64
64
63
61
61
61
59
57
56
56
55
53
52
51
48
48
47
46
46
43
41
39
35
32
31
30
30
28
12
Benchmarking
education system
Percent
correct
Ontario-CAN
Alberta-CAN
Florida-USA
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
69
69
69
62
54
52
37
37
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
96
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
97
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
Education system
A.
B.
C.
D.
Russian Federation
Portugal
Finland
United States
Ireland
Northern Ireland-GBR
Sweden
Hong Kong-CHN
Italy
Lithuania
Hungary
England-GBR
Slovak Republic
Israel
Bulgaria
Romania
Czech Republic
Denmark
Singapore
Poland
Netherlands
Canada
Azerbaijan
Australia
Slovenia
New Zealand
Croatia
Georgia
Spain
International average
Germany
France
Austria
Malta
Belgium (French)-BEL
Trinidad and Tobago
United Arab Emirates
Chinese Taipei-CHN
Colombia
Indonesia
Qatar
Norway
Iran, Islamic Rep. of
Saudi Arabia
Morocco
Oman
79
77
74
73
72
72
71
68
68
67
66
66
66
65
65
65
65
65
64
63
63
63
62
62
62
60
58
58
57
57
55
54
53
53
51
51
44
44
37
34
34
33
29
25
23
23
Benchmarking
education system
Percent
correct
Correct Response:
Florida-USA
Alberta-CAN
Ontario-CAN
Andalusia-ESP
Quebec-CAN
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
78
70
65
57
56
51
48
43
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
98
Passage
Reading Purpose
Comprehension Process of
the Task
Literary Experience
You learn what the farmers friend was like from the things he did.
Describe what the friend was like and give an example of what he
did that shows this.
SCORING
2 - Complete Comprehension
The response describes one plausible character trait (persistent, stubborn, nice, clever,
friendly to animals, etc.). In addition, the response provides one example of the farmers
friends actions that are evidence of the character trait.
Example:
He was determined. He kept trying to teach the eagle to fly.
1 - Partial Comprehension
The response provides one plausible character trait. -OR The response provides one example of the friends actions that are evidence of the friends
character.
Example:
He is kind to animals.
0 - No Comprehension
The response does not provide an appropriate or accurate description of the farmers
friends character, or provides a vague and general description that demonstrates limited
comprehension of the story without further textual support. -OR The response may include some information from the story that has no connection to the
description of the friends character.
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
99
Education system
Percent
correct
Hong Kong-CHN
Chinese Taipei-CHN
Israel
Russian Federation
Singapore
Ireland
Croatia
Italy
England-GBR
Austria
Northern Ireland-GBR
Czech Republic
United States
Slovak Republic
Sweden
Bulgaria
Portugal
Canada
Lithuania
Finland
Denmark
Hungary
International average
Poland
Australia
Romania
Georgia
New Zealand
Spain
Netherlands
Colombia
Belgium (French)-BEL
Malta
Iran, Islamic Rep. of
Trinidad and Tobago
France
Norway
Germany
United Arab Emirates
Slovenia
Qatar
Oman
Azerbaijan
Saudi Arabia
Indonesia
Morocco
59
55
50
50
48
46
45
45
44
44
43
42
42
41
40
39
38
38
38
38
37
35
29
28
25
25
24
23
21
20
19
19
18
18
18
17
15
14
14
13
12
7
7
4
3
1
Benchmarking
education system
Percent
correct
Ontario-CAN
Florida-USA
Alberta-CAN
Quebec-CAN
Andalusia-ESP
Dubai-UAE
Maltese-MLT
Abu Dhabi-UAE
47
42
34
31
30
20
17
12
Student Responses
Correct Response:
Incorrect Response:
Copyright 2013 International Association for the Evaluation of Educational Achievement (IEA).
100