Professional Documents
Culture Documents
PL Call2013
PL Call2013
net/publication/282355022
CITATIONS READS
14 8,086
1 author:
Agnieszka Leńko-Szymańska
University of Warsaw
35 PUBLICATIONS 422 CITATIONS
SEE PROFILE
All content following this page was uploaded by Agnieszka Leńko-Szymańska on 01 October 2015.
ABSTRACT
1. Introduction
While the value of corpora in language education has long been acknowledged
(cf. Ghadessy et al. 2001, Sinclair 2004, Aijmer 2009, Campoy-Cubillo et al.
2010), to date linguistic databases have been exploited mainly in the production
of dictionaries (e.g. Longman Dictionary of Contemporary English 2003), and
reference grammars (e.g. Biber et al. 1999, Carter – McCarthy 2006), as well as
in the design of language materials and courses (Mascull 1995, McCarthy et al.
2005, Barlow – Burdine 2005, Lee – Swales 2006). The concept of data-driven
learning, advocated by Johns as early as in 1991, which recommends that
language learners have a direct contact with corpus citations and other
information derived from corpora, has not gained wide popularity in the foreign
language classroom.
136 A. Leńko-Szymańska
There are many reasons for language teachers’ reluctance to exploit corpora
in their work, including problems with hardware and computing skills as well as
the scarcity of resources which are easily available, free or inexpensive, reliable,
and user-friendly (Römer 2010, Tribble 2012). However, the problem which is
probably at the heart of teachers’ lack of enthusiasm about data-driven learning
is their shortage of knowledge about the different ways that corpora can be used
in the classroom (Römer [2009] 2010). Graduates of teacher-training
programmes might have heard about or even encountered corpora during their
linguistic education. However, this experience does not automatically imply that
they know how to apply corpora in their teaching (Tribble 2012). As it was
pointed out by Breyer (2009: 156), “recognising that there is a significant
difference between learning and teaching with corpora, as well as providing
student teachers with the required skills, is of great importance.” It can be
argued that there is a requisite for explicit instruction of pre-service and in-
service teachers in the potential applications of corpora in the language
classroom. A need for institutionalized teacher-training courses devoted to or
featuring the applications of corpora in language instruction has already been
voiced by several researchers (Breyer 2009, Römer 2010).
The course is intended to introduce the students to the concept of a corpus and
its analysis, and to familiarize them with various applications of corpora in
language education, with special emphasis placed on the independent
preparation of courses, teaching materials and class activities. The participants
are expected to have a good knowledge of language teaching methodology and
be familiar with various language teaching techniques. On the other hand, they
are assumed to have had no prior contact with corpora. Thus, the focus of the
course is not on the teaching procedures per se (such as planning a lesson) but
A teacher-training course on the use of corpora... 137
The course lasts one semester and covers, depending on the length of a
semester, from thirteen to fifteen 90-minute classes. It consists of three thematic
modules, each spreading over three or more meetings. The first module is an
introduction to corpora and corpus tools along with an overview of their
applications in language education. The second concentrates on the exploration
of large general corpora for teaching language elements and skills. The third is
devoted to the compilation and analyses of small specialized corpora and their
uses in syllabus design and the production of language teaching materials and
activities. Table 1 presents the course syllabus for the winter semester
2012/2013.
Classes take place in a computer lab with twenty student computers connected
to the Internet and they are run from the Moodle platform. Except for four
classes featuring the instructor’s presentations (also available on the platform),
the students complete tasks on Moodle. The tasks guide them in studying
selected language points and include detailed step-by-step instructions on how
to manipulate the software. Exercises such as gap filling or matching are
presented as CALL activities prepared with the authorable software Hot
Potatoes1. If necessary, the instructor assists individual students, who can work
individually or in pairs to complete all the tasks and submit them through
Moodle. If they do not finish the tasks in class they have a week to complete
and submit them. The last 10-15 minutes of each session are devoted to the
class discussion of the activities with a focus on their pedagogical benefits.
At the end of the course the participant are requested to prepare a project
which involves the creation and analysis of a small corpus of specialized
language (c.a. 30 thousand words) on a chosen topic, as well as the preparation
of a state-of-the-art language lesson which will include materials and tasks
based on this corpus.
The Moodle content of the course can be viewed in the guest mode at
http://moodle.ils.uw.edu.pl/course/view.php?id=101. All the course materials
and activities (without the option of submitting completed tasks) have also been
made available to general public at http://corpora.blog.ils.uw.edu.pl/.
3. The questionnaire
The course described above was first offered to students in academic year
2010/2011. Since then it has been repeated in the winter semesters of the
following academic years and at the time of writing this chapter it is running for
the fourth time. At the end of each edition of the course students’ reactions to
the course were collected in order to evaluate its relevance and quality.
This paper presents the results of the questionnaire administered to the
students after the third edition of the course in January 2013. The questionnaire
offered to the participants on this occasion differed from the instrument used in
the previous year and analyzed elsewhere (Leńko-Szymańska in press). Unlike
the 2012 questionnaire, its focus was not on the quality of the course, but on the
respondents’ reactions to corpus-informed and corpus-based methods of
teaching a foreign language.
The questionnaire consisted of the total of 43 questions. It was divided to 5
parts each focusing on different information concerning 1) the students’
motivations for choosing the course, 2) their prior knowledge about corpora and
No. of
Part Focus
questions
I chose this course because … 4 Motivations
Before the course … 3 Prior knowledge
After the course … 24 Perceived results
In the future, if I become a teacher … 4 Attitudes
About the course 8 Course evaluation
The questionnaire was administered to the students during the last class and,
similarly to most of the course activities, it was completed through the Moodle
platform. The questionnaire was anonymous but obligatory. The instructor
could not link the responses to individual students but she could control who
had submitted the answers through log-in logs. The students who were absent
were urged to complete the questionnaire at home before they received the final
grades. Thus the questionnaire was completed by all the 18 students
participating in the course.
The questions were in English. The first 40 questions were closed and they
required the participants to rank statements using a 5-point scale ranging from
strongly disagree to strongly agree, with an option of no opinion. The next two
questions were open, encouraging the respondents to describe their own
unprompted reactions to the course. In the last question students were required
to mark the course using the 6-point Polish academic marking scale ranging
from fail to very good.
Below is the screenshot from the questionnaire.
140 A. Leńko-Szymańska
4. Results
The results of the five parts of the questionnaire are presented in Tables 3-11
3
below. The acronyms used in the tables stand for strongly agree (SA), agree
(A), disagree (D), strongly disagree (SD) and no opinion (NO).
Table 3 presents the students’
students answers related to the reasons for choosing the
course. Contrary to the instructor’s
instructor prior assumptions,
sumptions, the practical issues such
as unavailability of other electives or the convenient course time were not the
main or only reason for signing up for this class. In fact, only for four students
the course was the second best choice. All but one student
student reported that they
had wanted to develop their teaching skills and 15 respondents declared that
they had had genuine interest in corpus linguistics. These answers indicate that
the students started the course with a good degree of motivation and curiosity
curiosi
about the subject.
Tables 5-7 summarize the answers to the largest part of the questionnaire (Part
3) focusing of the students’ perceptions of the course results. The first section
(Questions 8-25) concerns the students’ confidence in using corpora as language
learners, whereas Questions 26-31 relate to the students’ familiarity with
corpora as resources for language teaching.
The answers to questions 8 to 10 demonstrate that the students were satisfied
with their technical knowledge and skills related to using and manipulating
corpus data, which they had gained during the course. Only one student reported
that he/she was still not comfortable with interpreting concordance lines.
Further answers to questions 11-14 reveal that on the whole students felt
confident in employing corpora to search linguistic information on lexis,
phraseology, grammar and discourse, yet in the case of grammar and discourse
the responses were not so unanimous: one student reported that he/she did not
know how to search information on grammar and 4 students (a little above
20%) stated that they found discourse-related uses of corpora problematic. Such
perceptions reflect well the strengths of corpus-based queries on relevant
linguistic information. The information on precise meanings, collocational
patterns or syntactic behaviours of individual words is easier to locate and
142 A. Leńko-Szymańska
Only the five students who reported not using corpora outside the course were
supposed to answer Questions 22-25 (Table 7) which aimed to elicit the reasons
for their reluctance to exploit these resources. However, 5 and even 6 remaining
students also answered these questions choosing the negative responses.
Only one student reported not having easy access to the Internet which is
necessary for using corpus resources presented in class. Two participants stated
they did not feel confident handling corpora. These responses are puzzling as in
the previous sections all students declared that they knew how to manipulate
corpus resources and tools (Question 9). Thus, it seems that even though the
students know how to work with linguistic databases, some do not feel
comfortable with the procedures yet. Two students reported not finding the
results of corpus queries particularly relevant and useful and three students
attested to preferring more traditional resources.
The last part repeated the main points of the questionnaire distributed to the
previous group of students a year before and concerned the evaluation of the
course. As in the previous year, the present participants evaluated the course
positively. All of them found the course useful and informative, and most of
them (15 students, above 80%) thought the classes had been interesting and
enjoyable. As in the previous year most of the students found the course
demanding in terms of workload (14 answers). All but one participant
appreciated the workshop format of the classes and all of the students liked the
end-of-the-semester project.
Questions 41 and 42 were open and they required the students to list three
things they liked and disliked about the course. The participants gave a variety
of answers, a few of which were not very clear (e.g. “Easy way to process text”
146 A. Leńko-Szymańska
as a one of three things a student liked). The most frequently repeated positive
points were:
The positive aspect of the course highlighted by one of the participants deserves
attention because it reflects the idea that lay at the heart of designing the course.
This student particularly appreciated “learning about corpora and teaching at the
same time”.
The students’ complaints were more varied and often stayed in contradiction
both to the positive comments discussed above as well as the participants’
responses to the closed questions. The most frequent negative comment was
that the Moodle activities were too long and monotonous, and there was not
enough discussions (8 students) and two students complained about working
with the computer all the time. These responses may indicate that too much
focus in the course was placed on the presentation of a whole range of corpus-
based tasks and the technicalities of manipulating corpora, and that the students
were given too few opportunities to give and receive feedback and to share and
discuss their ideas in class. At the same time, three students thought there had
been too few examples of actual use of corpora in language teaching. In
addition, four students thought the end-of-the-course project had been too time-
consuming, and the instructions had not been clear. One student also claimed
that the project should have been divided into stages. Interestingly, two students
complained that there had been too many activities which they had never been
able to complete in class and had to finish at home (as opposed to 3 students
who saw no homework as one of the positive aspects of the course).
Two quotes from the questionnaire are particularly potent in showing the
contrast in the students’ perceptions of the usefulness of corpus-based activities.
One student listed the following positive comment about the course: “[I]t was
very practical, it really showed us how to use corpora as a teaching aid. I’ve
already used exercises based on corpora during my private lessons with
students”, whereas another student wrote: “It may not come in handy in real
life, I tried to work with the ideas from the course but all students responded
negatively to them”. These comments demonstrate that both the students felt
inspired to try out corpus-based activities in their language tutoring, yet their
A teacher-training course on the use of corpora... 147
experience was very different. The former student did not state explicitly if the
corpus-based techniques s/he had used with his/her learners had been
successful, but since this comment was listed as a positive reaction, it can be
assumed that that new activities had proven effective in his/her classes. In
contrast, the experience of the latter student was clearly negative. It is
impossible to speculate for the reasons for such contrasting experiences but they
may have been decisive in forming the students’ perceptions of the value of
corpora in language pedagogy.
In the final question the students were requested to assess the course using
the Polish academic rating scale. This was done with the hope that one mark
will summarize best the participants’ reaction to the course and their perception
of its content. The Polish academic marking scale was chosen because the
students themselves are evaluated on this scale. The final marks for the course
were spread almost evenly between very good (6 student), good plus (5
students) and good (7 students) No student rated the course as merely
satisfactory (marks 3 or 3+) or unsatisfactory (mark 2). This shows that in spite
of all the criticism the students for the most part found the course useful.
Q 5 4+ 4 3+ 3 2
On the Polish academic scale I grade
43 6 5 7 0 0 0
the course as…
5. Conclusions
Although the main purpose of the questionnaire was to elicit the participants’
perceptions of the value of corpora in language education, the responses are also
indicative of their reactions to the course itself. On the whole, the results are
encouraging. The students had a high motivation when starting the course,
which seems to have met their expectations. The important outcome of the
course is that the participants started to use corpora for their own learning
outside the class, in particular for solving their own linguistic problems relating
to lexis and phraseology, less so to grammar and discourse features. More
importantly, most of the students also recognized the benefits of corpora in
language teaching, notably of general corpora but also, to a lesser extent, of
small purpose-built specialized corpora.
The study also revealed that a few participants had developed negative
attitudes to the value of corpus-based activities in language teaching. These
unfavourable perceptions may be a reason of the future reluctance of the teacher
148 A. Leńko-Szymańska
References