Professional Documents
Culture Documents
A Checklist For Material Evaluation
A Checklist For Material Evaluation
INTRODUCTION
English for specific purposes (ESP) has been around for about 70 years.
Dudley Evans and St John in Baleghizadeh and Rahimi (2011: 1009) stated that ESP
is part of a more general movement of teaching language for specific purposes (LSP).
ESP has attracted more attention within the teaching of English as a foreign or second
language. The other argue in Baleghizadeh and Rahimi, however Hutchinson and
Waters in (2011: 1010) said that ESP must be seen as an approach not as a product. It
does not consist of a particular type of teaching material, nor is it a particular kind of
language or methodology. From those views, ESP is designed for a particular group
of people in a particular context. The materials used are related to the learners'
specialized field of study. One of the important factors which is of the most
importance in language learning in general and ESP in particular is to see whether the
books and materials are useful for the purpose of the course or not. This is done
through the process of textbook evaluation, which is the aim of the current study.
Hutchinson in Syaifulloh (2014: 237) stated that textbooks are not only media for
everyday activity in the classroom used by teachers and students but they are also an
embodiment of aims, values and method of the certain teaching and learning
situation. Therefore, from using the textbooks in the learning process could help
teachers to focus on what they should do in the classroom and not having their energy
universities could provide drawbacks not only for teachers or lecturers but also for
students. Example, for teachers or lecturers, they could be demotivated because they
sometimes find that the materials provided in the ready textbooks could not be used
depend on their context and situation. For the students, the content of the ready
textbooks sometimes does not fit with their background. Therefore, designing
textbooks based on the context and situation of a specific area seems to be the best
colleges design their own books for their students because they consider that by
published books will not fulfill their learners’ needs. They have thought that
published books are not appropriate with a certain teaching context. Therefore, the
institutions assign their lecturers to design their own books, which suit a particular
group of students.
the lecturers of those universities or colleges, however, it seems that many designers
are not encouraged to evaluate the quality of the materials being developed.
Evaluating textbooks is important because it could be used as a way to find the
problems during the use of textbooks in the teaching and learning process and to get
findings indicated that the book, despite having merits, was not very suitable for the
course. They further give suggestions regarding the kinds of activities, strategies,
Karimnia and Jafari (2017:220) argue that materials in ESP programs should be
selected appropriately and creatively, and they should be modified and supplemented
include the usefulness of the textbook for the majority of the students, given that it is
congruent with the textbook, the consistency of the teaching materials with the level
sources of materials for teachers to guide both teachers and learners in process of
teaching the course. In the case of ESP materials, the choice should be made
carefully. We have to consider the learners’ needs, learning objectives of the study
course and methodology. Despite the increasing growth of ESP textbooks, it does not
seem that the systematic evaluation as well as assessment of their qualitative features
have gained enough attention. In other words, it seems that only few studies have
made an effort to evaluate this particular ESP textbook for the students of Biology
department. Thus, the question is whether it is wise to make use of this single ESP
textbook for all the biology related fields of study? The present research is an attempt
characteristics of an ESP textbook suitable for all fields of Biology studies. This
activity is also aimed at finding out whether the students of biology feel any needs
THEORITICAL REVIEW
The central unit of the dynamic process of learning and teaching is usually
thought to be the textbook. Cunningsworth (1995) asserts that textbooks are part of
and target;
2. Providing the students with staged activities for communicative practice and
3. Providing teachers and learners with different parts of speech to be taught and
practiced;
4. Being a source of stimulation and inspiration ideas for both teachers and
activities;
learning objectives;
7. Acting as a support for less experienced teachers to manage her/his class and
back to the 1960s. Developments in language theory indicated the need for ESP
courses; namely, students’specific needs led to the emergence of English for Specific
Purposes (ESP). Thus, the students of different professions are taught ESP to be able
what learners will need in their working environments or what will be required by the
The need to learn a specific variety of the English language, which in turn creates the
necessity for preparing the narrowed-down materials, is in fact the origin of ESP
textbooks.
learners will be equipped with the knowledge they will need in their future career,
depend on Vičič in Karimna and Jafari (2017: 223). Therefore, to identify strength
(1997), evaluation generally plays a key role in education and it is important for
teachers since it can provide valuable information for classroom practice, for the
management of learning tasks and for teaching the students. Depending on the subject
Such a definition might also serve the purpose of ESP materials; however,
four main issues should be emphasised before proceeding any further: 1) There
are major and minor ESP areas/courses, and published materials are sensible to
this reality. Business English and Maritime English are examples of these. Some
courses that are tailor-made to suit a particular group of students would also fall
within the minor category (for instance, English for tourism to a group of taxi
a particular discipline and which people, like students and future experts, possess
in their mother tongue. ESP teachers will need a reasonable understanding of the
activities the students are involved in” (Dudley-Evans and St John, 1998: 14). 3)
All too often, ESP teachers become evaluators, designers and developers of
for very limited markets” (Hutchinson and Waters, 1987: 106) and most ESP
(2003: 52), textbooks play a very crucial role in the realm of language teaching
and learning and are considered the next important factor in the second/foreign
O'Neill (1982) presents four reasons for the use of coursebooks. Firstly,
most parts of coursebook materials are appropriate for students' needs, even if
they are not specially designed for them. Secondly, they make it possible for
students to plan for future learning and also review the previous materials or
modify them to meet the learners' needs and also allow for natural interaction to
happen.
noted that a number of scholars argue that a heavy dependence on a book and not
Evaluation Textbooks are among the most important resources utilized to achieve
the aims of a course which are based on the learners' needs. However, they should
not become the aim of the course themselves and set those aims (Brown, 1995).
Regarding the importance of the textbooks, one should make sure that those
ascertain that "careful selection is made, and that the materials selected closely
reflect the aims, methods, and values of the teaching program" (p.7). One of the
methods which can help us in achieving the aforementioned goal is the evaluation
ensure that materials are consistent with the needs and interests of the learners
ideologies on the nature of language and learning. (p.209) Sheldon (1988) has
suggested several reasons for textbook evaluation. He states that the selection of a
teachers will become familiar with the content of available textbooks and
recognize the weaknesses and strengths of each. One more reason for evaluation
Cunningsworth (1995) and Ellis (1997) have proposed three types of materials
evaluation: predictive or pre-use evaluation in which the future or potential
can decide how to improve the given textbook for subsequent use. Dudley-Evans
and St John (1998) define evaluation as asking questions and acting on the
responses. They further argue that evaluation “begins with determining what
information to gather and ends with bringing about change in current activities or
influencing future ones” (p.128). They divide evaluation into formative and
summative types. They suggest that ESP practitioners should pay more attention
course including materials and books. Summative evaluation takes place at the
end of the course or when the course is finished. Therefore, it does not affect the
course. This kind of evaluation is used to gauge the usefulness of the course and
They further add that to make the best choice, different parties involved in the
formative (conducted while the course is ongoing). She states that evaluation can
making processes, while the latter is concerned with the students' product such as
examination results, essays, etc. By insiders she means teachers, students, and
course designers. Robinson lists a number of tools used to carry out evaluation:
follows: This refers to evaluation that seeks to find out how different aspects of
understanding of the processes of teaching and learning that occur in the program,
without necessarily seeking to change the course in any way as a result. (p.289)
McDonough and Shaw (2003) suggest a model for textbook evaluation which
involves three stages. First, external evaluation that examines the organization of
materials stated by the author or the publisher including claims made on the cover
evaluation gives information about the intended audience, the proficiency level,
book. Second, internal evaluation in which the following factors are examined: a)
the presentation of the skills, b) the grading and sequence of the materials, c)
appropriateness of the materials for different learning styles and claims made by the
authors for self-study. The last stage is overall evaluation in which usability,
Such a definition might also serve the purpose of ESP materials; however, four main
issues should be emphasised before proceeding any further: 1) There are major and
minor ESP areas/courses, and published materials are sensible to this reality. Business
English and Maritime English are examples of these3. Some courses that are tailor-
made to suit a particular group of students would also fall within the minor category
(for instance, English for tourism to a group of taxi drivers and policemen in a
the information which is specific to a particular discipline and which people, like
students and future experts, possess in their mother tongue. ESP teachers will need a
St John, 1998: 14). 3) All too often, ESP teachers become evaluators, designers and
materials for very limited markets” (Hutchinson and Waters, 1987: 106) and most
ESP areas conform to this reality. These roles are not exclusive to ESP teachers but, if
compared with EFL/ESL teachers, they are more often engaged in the task of
evaluating, designing and developing materials for their classroom use. It is precisely
this additional role of materials providers/developers that has endowed ESP teachers
teaching, there exists a mismatch between pedagogy and research; that is, there is a
gap between coursebooks and pedagogical practice, on the one hand, and research
findings, on the other. For instance, as Harwood (2005: 150) found, there is “a lack of
fit between how academic writers write and what the textbooks teach about writing”.
Materials are particularly useful in ESP because they play a key role in exposing
are a source of “real language” (Dudley-Evans and St John, 1998: 171). Developing
materials for the ESP classroom is a trade-off between learning needs, language
content and subject-matter content which implies the review of a number of issues: -
What is the target topic/what will be the carrier content? - Is this topic relevant for my
are the learning goals? - What is the target language form/function/skill? - What
- How much time should be spent on the design, development and implementation of
At its most basic level, the process of ESP materials development is as shown in
Figure 1. Firstly, available materials are reviewed, evaluated and selected according
to different criteria and with reference to a particular ESP course. Then, if there is a
abridge, extend, refine, rewrite – in short, adapt – the available materials for a
particular learning situation, ESP area, target group of learners, timing or set of
resources. There exists the possibility that, although there are materials available for
classroom use, practitioners feel the need to provide additional materials for out-of-
classroom work, self-study or the like. In this case, the process would not differ.
current trends in the field or research findings. This last step is a desirable practice
because “materials that undergo this evaluative review and revision process are likely
to serve student and teacher audiences more effectively than materials that do not”
(Stoller et al., 2006: 175). Developing materials is a matter of trial and error, and it
will be convenient to bear in mind that materials that are appropriate for a particular
ESP course/area may not prove so efficient for other ESP courses/areas.
SUBJECTIVE OBJECTIVE
SCORE SCORE
ANALYSIS ANALYSIS
AUDIENCE
1A Who are your 1B. Who is the material
AIMS
2A What are the aims of 2B What are the aims of
CONTENT
3A What kind of 1B What type(s) of
Should it be structural, ?
notional, functional,
discourse-based, some
integrated work ?
the meanings of
unfamiliar words)
What level of
knowledge should be
colledge/university, post-
graduate) ?
medicine, hospital
organization, medical
technology)?
given (e.g.
‘starightforward’,
factual; ‘human interest’
angle; humorous;
unusual perspective;
issues, controversy)
- Around language
points ?
- By subject-
matter?
- By some other
skills)?
- By a combination
of means?
- By a set pattern
of components?
- By a variety of
patterns?
- By some other
means?
- To allow a clear
focus on e.g.
a communication
task?
more difficult?
- To create variety?
- To provide
recycling?
- By other criteria?
Should there be no
obvious sequence?
free?
- From
comprehension to
production?
- Accuracy to
fluency?
- By some other
means?
Should there be no
obvious sequence?
METHODOLOGY
13A What theory/ies of 13B What theory/ies of
Should it be behaviourist,
cognitive, affective,
combination of one or
more of these?
account?
e.g.
- guided free?
- comprehension
production?
- Language/skills
practice language/skills
use
individual?
- language-/skills-based
content-based?
- ‘mechanical’
problem-solving?
- role-play, simulation,
drama, games?
- self-study?
be used?
e.g.
- ‘lockstep’?
- pair-work/
- small-group work?
- student presentations?
subject-matter?
-other kinds?
e.g.
- cassette recorders?
- overhead projectors?
- realia?
- wallcharts?
- video?
- other?
guidance/support for
e.g.
- statements of aims?
language-skills points?
- language guidance?
- technical information?
- methodological
directive or hints?
work?
- tests?
- other kinds?
different points?
different orders?
(e.g. cassettes)?
OTHER CRITERIA
20A What price range is 20B What is the price?
necessary?
TOTAL TOTAL