ANALYSIS OF HOTS IN EFL TEACHERS’ SUMMATIVE ASSESSMENT

PENILAIAN AKHIR TAHUN FOR 11th GRADERS SMAN 5 CIREBON

A Paper
Submitted for Fulfilling Assessment in ELT Final Assignment

by:

FathiyaPutriHandini 0203518035

ENGLISH EDUCATION
GRADUATE PROGRAM
UNIVERSITAS NEGERI SEMARANG
2019
 Analysis of HOTS in EFL Teachers’ Summative Assessment
PenilaianAkhirTahunfor 11th Graders SMAN 5 Cirebon

INTRODUCTION
Education in the 21st century must reflect four skills, namely (1) Critical Thinking and
Problem Solving; (2) Creativity and Innovation; (3) Communication; and (4) Collaboration.
These skills are considered as Higher Order Thinking Skills (HOTS). It is thinking on a level
that is higher than memorizing facts or retelling something to someone exactly the way it was
told (Thomas & Thorne, 2009). In Bloom’s Taxonomy, the cognitive processes that belong to
HOTS are analysis, synthesis, and evaluation. Bloom’s taxonomy was later revised by Anderson
et al. (2001). In Revised Bloom’s Taxonomy, analyze, evaluate, and create are categorized as
Higher Order Thinking Skills (HOTS).
Table 1. Bloom’s Taxonomy
The Cognitive Process
The Dimension
Knowled
ge Remember Understand Apply Analyze Evaluate Create
Dimensi
on
Factual List Summarize Classify Order Rank Combine
Knowled
ge
Conceptu
al Describe Interpret Experiment Explain Assess Plan
Knowled
ge
Procedur
al Tabulate Predict Calculate Differentiate Conclude Compose
Knowled
ge
Meta- Appropriate Execute Construct Achieve Action Actualize
Cognitive Use
Knowled
ge

HOTS is important to support the teaching and learning process. It is very helpful for
students to face the problem that is uncommon in their daily life (Widiawati, Joyoatmojo,
&Sudiyanto, 2018). Furthermore, students with HOTS can make the students to recognize
themselves by improving their performance and reducing their weaknesses (Yee et al.,2011 in
Nourdad, Masoudi, &Rahimali, 2018). In order to foster Higher Order Thinking Skills (HOTS),
Curriculum 2013 (K-13) is implemented. HOTS is attached to the assessment. Learning
outcomes assessment is expected to help students improve Higher Order Thinking Skills
(HOTS). Therefore, K-13 emphasizes that Higher Order Thinking Skills is an important skill
that must be possessed by learners (Widiawati et al., 2018). Hence, educators must be able to
design a sustainable assessment which contains Higher Order Thinking Skills (HOTS).
In order to develop a good HOTS- based item for students, the quality of teachers becomes
a very important part of this case. The teacher must have a good understanding of the cognitive
processes in Lower Order Thinking Skills (LOTS), Moderate Order Thinking Skills (MOTS),
and Higher Order Thinking Skills (HOTS). So, in developing the test, they must have a clear
distinction from one cognitive process to the others.
Therefore, this paper aims to analyzing the extent to which the summative assessment by
eleventh-grade English teachers reflects on higher-order thinking skills. Hence, this paper is
aimed to know how the eleventh-grade English teachers’ summative assessment reflects Higher
Order Thinking Skills (HOTS). This study will be important to be conducted for verifying the
HOTS-based summative assessment instrument made by the eleventh-grade English teachers in
SMAN 5 Cirebon academic year 2017/2018.

FINDINGS AND DISCUSSION

HOTS is important to be implemented in the teaching and learning process in 21st-century
education. It could be trained through HOTS-based items made by the teachers. HOTS in
Revised Bloom’s Taxonomy involves the cognitive process of Analyze (C4), Evaluate (C5), and
Create (C6). The findings of this study show that the most dominant items that appeared in the
teacher-made test are in Lower Order Thinking Skills.HOTS-based items are rarely found.Even
though there are some items categorized as HOTS-based items,yet those items only cover 5
cognitive process of Analyze (C4), 1 cognitive process of Evaluate (C5), and 1 cognitive process
of Create (C6).
 The distribution of items from all teacher-made tests is presented in the table below:
Table 2. The total percentage of LOTS and HOTS-based Items
Cognitive Process Frequency Total Percentage
Remember (C1) 3
LOTS Understand (C2) 18 37 84.09 %
Apply (C3) 16
Analyze (C4) 5
HOTS Evaluate (C5) 1 7 15.91 %
Create (C6) 1
Total 44 100 %

The examples of the HOTS-based item in teacher-made tests in SMAN 5 Cirebon are
shown below:
Analyse

10. Following are some expressions for letter writing except.....

A. Gratitude
B. Giving advice
C. Delivering good news
D. Asking for help
E. a, b, c, dance are true

It is reading test (reading comprehension, letter). It is analyzing level. The test demands to find
out the wrong information of the expression related to the text.

24. According to this page, what is the difference between glamour Rock and
grunge?
A. Glamour Rock is flashier and superficial, while grunge is thought-
provoking and antiestablishment.
B. Glam Rock is more idealistic and real, while grunge is based on
fantasy and compromises with the market
C. Glam Rock appeals to teenager, while grunge appeals to adults.
D. Glam Rock faded quickly, while grunge is still prominent.
E. Glam Rock was more commercially successful than grunge..

It is reading test (reading comprehension, entertainment article). It is analyzing level. The test
demands to find the difference between the information related to the text.
 25. Which of the following bands is not associated with grunge..?
A. Nirvana D. Backstreet Boys
B. Mud honey E. Sound garden
C. Pearl Jam

It is reading test (reading comprehension, entertainment article). It is analyzing level. The test
demands to find the wrong information of the bands related to the text.

32. Why do banks, law firms, and other businesses use facsimile to
send their documents?
Because facsimile.....
A. Is better than a telephone
B. Is cheap and effective
C. The documents are in precise form
D. The machine does its work it self
E. Is faster than skilled operator, effective and precise

It is reading test (reading comprehension, article). It is analyzing level. The test demands to find
the reason of the information related to the text.

42. Read the sentences and find which one the cause and effect.
A. Siti has planned a trip to her uncle’s house because she loves her
cousins.
Cause =............
Effect =.............

B. The green House gases trap the heat in the air ,so the Earth become
warmer.
Cause =............
Effect =.............

It is essay test (cause and effect). It is analyzing test. The test demands to find the cause and
effect from the phrase given.
Evaluate

34. How do we communicate in the globalization Era..?

A. By familiar device of communication
B. By using a very fast way like fax
C. By speaking each other over telephone lines
D. Watching television
E. Using computer

It is reading test (reading comprehension, article). It is evaluating. The test demands to evaluate
then conclude the information related to the text.
Create

41. Write a letter to your friend, telling her/him all about your adventures
during your trip to Jogjakarta or Bali.

It is essay test (writing test, recount). It is creating. The test demands to create a letter for friend
and telling her/his friend all about writers’ adventures during her/his trip.
The examples of the LOTS-based item in teacher-made tests in SMAN 5 Cirebon are
shown below:
Remember

4. The phrase Take more caution (saudian) can most probably be replaced
by.....
A. Give information more frequently
B. Write a bigger statement
C. Cause more to happen
D. Will likely happen
E. Be more careful

5.The idiom stood out (education) mean...

B. Got difficulty
C. Been superior
D. Become a problem
E. Stopped developing
F. Leave
 21. The word "ostentatious" in the first sentence
most nearly mean....
A. Stubborn D. Unadorned
B. Youthful E. Romantic
C. Showy

Those tests above are reading tests. It is remembering level because those asks the test-takers to
define the synonym of the word and sentence.
Understand

1.From the text we can state that the Saudian letter contains.....
A. a criticism
B. clarification
C. and introduction
D. and announcement
E. and opinion

2.The education letter, meanwhile, is....

A. Criticism
B. a clarification
C. an introduction
D. and announcement
E. and editorial.

3.The audience of the Saudian letter is.....

A. The newspaper
B. The Saudian Embassy
C. The newspapers reader
D. The office of public relations
E. The Indonesian Embassy

Those test above are reading tests. It is understanding level because those asks the
understanding of test-takers about the information related to the text.
Apply

15. many spices of wild life are becoming extinct... ..the rainforest are being
destroyed
A. Therefore
B. Because
C. Consequently
D. Due to
E. So

16. ....... logging provides jobs and profits, the

government is reluctant to control it.
A. So
B. Due to
C. Because
D. Therefore
E. Consequently

17. bark can be used to make paper.... it could reduce the need for logging.
A. Therefore
B. Because
C. Due to
D. But
E. If only

Those tests above are fill in the blanks of reading text. It is applying level because those tests
were tested the test-takers’ understanding about applying conjunction in a sentence.

CONCLUSION
From the table above, it was found that summative assessment instruments in SMAN 5
Cirebon are applied Higher Order Thinking Skills (HOTS) 5 on the Analyze (C4) cognitive, 1 on
the Evaluate (C5), and 1 on the Create (C6). From all of the summative assessment instruments
in Senior High School for 11th grade academic year 2017/2018 (44 items), it comes up to a
conclusion that 15.91% (7 items) are indicated HOTS-based items. For the rest of the test
84.09% are indicated LOTS-based items, consist of 3 on the Remember (C1) cognitive, 19 on
the Understand (C2), and 15 on the Apply (C3).
REFERENCES
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruickshank, K. A., Mayer, R. E.,
&Pintrich, P. R. (2001). Ataxonomy for learning, teaching, and assessing. New York:
Pearson Education, Inc.
Nourdad, N., Masoudi, S., &Rahimali, P. (2018).The effect of higher order thinking skill
instruction on efl reading ability.International Journal of Applied Linguistics & English
Literature, 7(3), 231–237.
Thomas, A., & Thorne, G. (2009). How to increase higher order thinking. Center for
Development andLearning. Retrieved March 19, 2019, from http://www.cdl.org/resource-
library/articles/HOT.php?type=subject&id=18
Widiawati, L., Joyoatmojo, S., &Sudiyanto. (2018). Higher order thinking skills as effect of
problem based learning in the 21st century learning. International Journal of Multicultural
and MultireligiousUnderstanding, 5(3), 96–105.
 RESULTS OF THE ANALYSIS
HOTS
Analyse
10. Following are some expressions
for letter writing except.....
A. Gratitude
B. Giving advice
C. Delivering good news
D. Asking for help
E. a, b, c, dance are true
24. According to this page, What is the
difference between glamour Rock and
grunge?
A. Glamour Rock is flashier and
superficial, while grunge is
thought-provoking and
antiestablishment.
B. Glam Rock is more idealistic
and real, while grunge is based
on fantasy and compromises
with the market
C. Glam Rock appeals to teenager,
while grunge appeals to adults.
D. Glam Rock faded quickly, while
grunge is still prominent.
E. Glam Rock was more
commercially successful than
grunge
25. Which of the following bands is not
associated with grunge..?
A. Nirvana D. Backstreet Boys
B. Mud honey E. Sound garden
C. Pearl Jam
32. Why do banks, law firms, and
other businesses use facsimile
to send theirdocuments?
Because facsimile.....
A. Is better than a telephone
B. Is cheap and effective
C. The documents are in precise form
D. The machine does its work it self
E. Is faster than skilled operator,
effective and precise
42. Read the sentences and find which
one the cause and effect.
A. Siti has planned a trip to her
uncle’s huse because she loves her
cousins.
Cause =............
Effect =.............
B. The green House gases trap the
heat in the air ,so the Earth
become warmer.
Cause =............
Effect =.............
Evaluate
34. How do we communicate
in the globalization Era..?
A. By familiar device of
communication
B. By using a very fast way like fax
C. By speaking each other over
telephone lines
D. Watching television
E. Using computer
Create
41. Write a letter to your friend, telling
her/him all about your adventures
during your trip to Jogjakarta or Bali.
LOTS C. The newspapers reader
D. The office of public relations
Remember
E. The Indonesian Embassy
4. The phrase Take more caution
(saudian) can most probably be 6. I am so happy to share this with you.....
replaced by..... The purpose of the expressions above is
A. Give information more frequently A. To apologize
B. Write a bigger statement B. To ask a favor
C. Cause more to happen C. To share a good news
D. Will likely happen D. To ask for reply
E. Be more careful E. To give advice

5.The idiom stood out (education) mean... 7. Thank you so much for
A. Got difficulty remembering me. The purpose of
B. Been superior the expressions
C. Become a problem A. To ask a favor
D. Stopped developing B. To ask a reply
E. Leave C. To thank the person
D. To give an advice
21. The word "ostentatious" in the first E. Closing
sentence
most nearly mean.... 8. The examples of expression used in
A. Stubborn D. Unadorned closing in personal letters
B. Youthful E. Romantic A. Dearest
C. Showy B. It was so good to hear from you
C. Sincerely yours
Understand D. I will write soon
E. How are you
1.From the text we can state that the
Saudian letter contains..... 9. The example of expression used in
starting the letter...
A. a criticism A. It was so good to hear from you
B. clarification B. Sweetheart
C. and introduction C. I will write soon
D. and announcement D. Much love
E. and opinion E. I'm looking forward to seeing you
soon
2. The education letter, meanwhile, is....
A. Criticism 22. Teenagers embraced grunge
B. a clarification fashion because....
C. an introduction A. They were tired of Glam Rock
D. and announcement Fashion
E. and editorial. B. It defied corporate America
and the shallowness of pop
3. The audience of the Saudian letter is..... culture
A. The newspaper C. Grunge rockers told them to
B. The Saudian Embassy embrace it
 D. It outraged their parents
E. It was seen as beneficial thing
23. This writer is trying to convey....
document
A. The popularity of glam Rock
B. .nirvana's popularizing
grunge music
C. To rise and fall of grunge music
D. The quickly changing music
changing music fashion in
American youngsters
E. The reasons young people
responded enthusiastically to
grunge music
27. X : Did you study last night ?
Y : What ?
X : I wanted to know if ...last night.
A. You studied
B. You would study
C. You have studied
D. You had studied
E. You will have studied
28. If you have money in your account,....
A. You can withdraw your money
from a cash dispenser
B. You have special voucher
C. The bank send you a monthly
statement
D. You have paid special interest
E. The type of card is acceptable
29. If it rain, they will.......
A. Try to play slowly
B. Ask for cancellation
C. Make a preparation
D. Change the rule of the game
E. Not play in the field
30. If Hardy had taken the flight, He
could have been one of the victims.
The fact is....
A. Hardy does not take the first flight.
B. Hardy did not take the first flight
C. Hardy had not taken the first flight
D. Hardy cannot take the first flight
E. Hardy is not take the first flight
31.The text tell us about.....
A. The faster system of modern
machine
B. The service system over telephone
lines
C. The way of transmitting text and
pictures over telephone lines
D. The use of facsimile in modern way
E. The facesism is faster than other
media
33. What device is used for transmitting
receiving images?
A. A facsimile machine
B. Receiving machine
C. Transmitting machine
D. And electronic scanner
E. A fact board
35. to send a documents, the user inserts it
into the machine and dial the telephone
number of thereceiving fax machine.
The italic word means...
A. Put D. Transfer
B. Take care E. Move
C. Transmit
36. social function of the text above is....
A. To describe the people and things
B. To entertain or amuse the reader
C. To describe how and why and
certain phenomenon happen
D. To retell the past events
E. To describe how to make
and to-do something
37. What is the tense used in explanation
text...?
A. Simple past tense
B. Simple present tense
C. Present continuous tense
D. Future tense
E. Past perfect tense.
Apply
17. bark can be used to make paper.... it
11. could reduce the need for logging.
A. Therefore A. Therefore
B. Because B. Because
C. Consequently C. Due to
D. Because of D. But
E. Due to E. If only

12. 18. coconut tree was grown

A. Therefore through out history...... it's
B. Because versatility.
C. Due to A. Due to
D. Because of B. Because
E. Consequently C. Therefore
D. If only
13. E. But
A. Because
B. Therefore
C. Consequently
D. And than
E. Because of
14.
A. Because
B. Therefore
C. Consequently
D. But
E. Because of

15. many spices of wild life are becoming

extinct... ..the rainforest are being
destroyed
A. Therefore
B. Because
C. Consequently
D. Due to
E. So

16. ....... logging provides jobs and profits,

The government is reluctant to control
it.
A. So
B. Due to
C. Because
D. Therefore
E. Consequently
 19. ...... it can be used to make B. Is designed
many different things C. Have been designed
A. Therefore D. Were designed
B. Because E. Will be designed
C. Due to
D. Because of 39. Active : my sister will
E. Consequently celebrate her victory in
debating contestnext week
20. I didn't find your home.... your name Passive: the victory I
card is lost debating contest.... B my
A. Because of sister
B. So A. Was celebrated
C. Therefore B. Will be celebrated
D. Since C. Is celebrated
E. As result D. Have been celebrated
E. Celebrated
26. ......be at Home if I......you tonight ?
A. Would you - Visit 40. Active : Bonar eat two plates of
B. Are you going to - visit friend rice this
C. Would you - visited morning
D. Are you going to - am visit Passive: This Morning, to plates of
E. Will you - visit friend rice.... by Bonar
A. Was eaten D. Ate
27.X : Did you study last night ? B. Are eaten E. Were eaten
Y: What ? C. Have been eaten
X : I wanted to know if ...last night.
A. You studied 43. Change the following sentences into
B. You would study passive tense
C. You have studied a. Columbus discovered America.
D. You had studied b. Edo has suggested the new ideas
E. You will have studied
44. Change the following sentences
38. Active :Diky designed the logo into if conditional type 2
of this company. a. I don’t know her address so I
Passive : The logo of this company.... dont go to her house
By diky. b. They come late so they doesn’t
A. Was designed watch the film