ELT4102- TESTING IN ELT

FINAL PAPER

GROUP 8
Ayşe Dilara Yeşil – 1901766
Ayşenur Kaynar – 1903016
Ebru Helin Seçmen – 1807440
İpek Yücesoy – 1728878
Nisanur Yazıcı – 1804555

26.06.2023
Purpose of the Test

 Assessing understanding of present tense usage in the context of the unit theme

"Festivals" to determine students' ability to use appropriate verb forms when

discussing actions related to festival celebrations.

 Evaluate students' ability to understand and adapt to cultural practices beyond their

own.

 Reflect on their own experiences with festivals, share personal stories, or draw

connections between different festivals and their own lives.

 Provided to assess students' knowledge and understanding of various festivals and

cultural celebrations.

 Prompt students to consider and appreciate the diversity of festivals and cultural

celebrations across different regions and countries.

Content of the Test

Unite 5: Festivals
1. Content:

 Understanding of festivals all around the world.

2. Language:

 Grammar (present simple tense)

 Choose the correct verb form:

 Answer the questions:

- How does Ayşe celebrate Ramadan? —She visits her relatives.

1
 3. Vocabulary:

 Match the festivals with its places:

 Diwali, Mardi Gras, Songkran, La Tomatina, Rio Carnival.

Exam
A. Multiple Choices: Total 25 points

1. People ___________ colourful lanterns during the Lantern Festival.

a) fly
b) flew
c) flies
d) flying

2. The Holi festival ___________ people throwing coloured powders at each other.
a) involves
b) involved
c) involve
d) involving

3. The Thanksgiving festival ___________ place in November.

a) takes
b) took
c) taking
d) take

4. Children ___________ candy during Halloween.

a) eats
b) ate
c) eat
d) eating

5. People ___________ fireworks to celebrate Independence Day.

a) launch
b) launched
c) launches
d) launching

2
 B. Matching Questions (Total 15 points)

Match the festivals with its places:

1. Diwali

2. Mardi Gras

3. Songkran

4. La Tomatina

5. Rio Carnival

A. India

B. Thailand

C. Spain

D. United States (specifically New Orleans)

E. Brazil

C. True False Questions (Total 15 points)

6. December 25th is the day that Christmas is observed.

7. The Festival of Lights is another name for the Hindu holiday of Diwali.

8. Germany is where the Oktoberfest celebration first took place.

9. Most celebrations for the Day of the Dead (Da de los Muertos) take place in Mexico.

10. Since the Chinese New Year is based on the lunar calendar, it always occurs on a

different day.

D. Close Ended Questions: (Total 20 points)

3
 11. How do people decorate traditionally their homes during Christmas? (7 points)

12. How do you celebrate 23rd April in your country? (7 points)

13. Which festival involves the lighting of lanterns and the performance of traditional

ceremonies? (6 points)

E. Open Ended Questions: (Total 25 points)

14. How do you people decorate their homes during Diwali, and what significance do

these decorations hold?

15. Can you share a folk song or a traditional poem that is often performed during

festivals in your culture?

Research Purpose

- Identifying patterns in strengths and weaknesses of the student understanding and

capability in terms of present simple tense and to determine next steps for student

learning.

- Investigating the level of knowledge and understanding of festivals and cultural

celebrations among students.

Methods of Administration

- The test might be given in writing, with the students receiving a question-and-

answer sheet. The questions can be given to the students in the sequence listed

4
 above, and each segment should have a set time limit. To ensure that students are

aware of each question type's requirements, clear instructions should be given.

Methods of Rating
- Scoring can be done based on predetermined answer key for multiple choice,

true/false and matching questions. For close-ended and open-ended questions can

be scored based on the correct use of grammar, accurate and rich vocabulary

usage, and clarity of the answers. For the consistency and fairness in grading, a

scoring rubric can be constructed to allocate points for each type of question.

For example:

- Multiple Choice Questions: Each correct answer can be awarded 5 points, and

incorrect or unanswered questions can receive 0 points.

- True/False Questions: Each correct answer can be awarded 3 points and

incorrect or unaswered questions can receive 0 points.

- Close Ended Questions: The first question, correct answer can be awarded 6

points; the second question can be awarded 7 points; the third question can be

awarded 7 points. Incorrect or unanswered questions can receive 0 points.

- Open Ended Questions: The first question, correct answer can be awarded 12

points; the second question can be awarded 13 points. Incorrect or unanswered

questions can receive 0 points.

Validity of the Exam

5
 - Content Validity: The exam covers a range of topics that aligned to the lesson

objectives and related to festivals and cultural celebrations, including multiple-

choice, matching, true/false, close-ended, and open-ended questions. The

questions assess various aspects such as festival traditions, cultural knowledge,

and the significance of specific celebrations. The content is relevant and

appropriate for testing knowledge and understanding of festivals.

- Construct Validity: The exam assesses the intended construct, which is knowledge

and understanding of festivals and cultural celebrations. The multiple-choice

questions test factual knowledge, while the matching questions assess the ability

to associate festivals with their respective locations. The true/false questions

evaluate comprehension of festival-related facts. The close-ended questions

require specific answers about festival traditions, while the open-ended questions

assess the ability to provide detailed and meaningful responses about cultural

practices. Overall, the exam have sufficient construct validity for its intended

purpose.

Reliability of the Exam

- Internal Consistency: In this exam, the internal consistency can be evaluated by

examining the coherence of the multiple-choice questions, matching questions,

true/false questions, and close-ended questions. The questions within each section

is related to the same construct and measure it consistently. Assessing internal

consistency requires statistical analysis, such as calculating Cronbach's alpha

6
 coefficient. The test is designed to ensure that the test is aligned, compatible with

the theme and the test itself.

- Test-Retest Reliability: Although the current test was conducted as a single

assessment, it is advisable to consider a test-retest methodology for future

evaluations. By administering the identical test to the same group of students at

different time intervals, we can evaluate the test's reliability and consistency over

time.

- Inter-Rater Reliability: In this exam, inter-rater reliability would be relevant for

the open-ended questions (questions 14 and 15). To assess inter-rater reliability,

multiple examiners would need to independently evaluate and score the responses.

Then, statistical measures, such as Cohen's kappa or intraclass correlation

coefficient, could be used to determine the level of agreement among the raters.

Students’ Scores
1) Student 1: 87
2) Student 2: 92
3) Student 3: 89
4) Student 4: 96
5) Student 5: 95
6) Student 6: 85
7) Student 7: 100
8) Student 8: 97
9) Student 9: 88
10) Student 10: 98
11) Student 11: 96
12) Student 12: 90
13) Student 13: 80
14) Student 14: 91
15) Student 15: 83
16) Student 16: 79
17) Student 17: 94
18) Student 18: 84
19) Student 19: 92

7
 20) Student 20: 76
21) Student 21: 81
22) Student 22: 73
23) Student 23: 100
24) Student 24: 87
Report of the Students’ Scores
- The students achieved a range of scores, with the lowest score being 73 and the

highest score being a perfect score of 100. The average score obtained by the class

was approximately 89.5 out of 100.

It is worth noting that several students performed exceptionally well, achieving

scores above 90. These students demonstrated a strong understanding of the

material and were able to accurately answer the questions. Additionally, two

students in particular achieved perfect scores, showcasing a comprehensive grasp

of the exam topics.

On the other hand, a few students obtained scores below 80, indicating potential

areas for improvement in their understanding of the subject matter. It may be

beneficial for these students to seek additional support or review the material to

enhance their knowledge and performance in future assessments.

Overall, the majority of students performed well on the exam, displaying a solid

understanding of the festivals and cultural celebrations covered in the test. The

scores reflect the efforts and abilities of the students in relation to their knowledge

of festivals, traditions, and associated facts.

What can be improved?

8
- Feedback and Remediation: After grading the exams, we should provide feedback

to students, highlighting their strengths and areas for improvement. Plus, we

should offer opportunities for students to review their mistakes and provide

additional resources or support to help them address any knowledge gaps.

- Integrating Critical Thinking Questions: To enhance the test and promote deeper

understanding, critical thinking questions can be incorporated. This type of

questions encourage students to analyse, evaluate, and apply their knowledge in a

meaningful way. By going beyond simple recall, students are challenged to think

critically, make connections, and demonstrate a deeper comprehension of the

subject matter. Critical thinking questions require students to engage in higher-

order thinking skills, such as analysis, synthesis, and evaluation. These questions

prompt students to examine information from different perspectives, consider

evidence, and draw well-reasoned conclusions. For example, instead of asking

students to identify the date of a festival, a critical thinking question might ask

them to analyse the social and cultural significance of the festival in contemporary

society.

- Enhancing Question’s Contextuality: Contextualized questions can involve

analysing historical events or cultural practices, understanding the symbolism

behind certain festival traditions, or evaluating the impact of festivals on society.

For example, instead of asking for a simple description of a festival, a

contextualized question might ask students to discuss how the festival has evolved

over time and its relevance in contemporary society.

9
10