Professional Documents
Culture Documents
2013-Applyin AR To Esl
2013-Applyin AR To Esl
net/publication/301553708
Applying action research to investigate the use of goal setting for ESL writing
CITATIONS READS
6 1,548
1 author:
Emily Edwards
University of Technology Sydney
39 PUBLICATIONS 390 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Action research project: Using assessment for learning to help L2 writing View project
All content following this page was uploaded by Emily Edwards on 21 April 2016.
Emily Edwards
Introduction
This study was completed as part of the 2012 English Australia Action Research in
ELICOS Program, supported by Cambridge English Language Assessment, an annual
program first implemented in 2010 that involves a small group of ELICOS (English
Language Intensive Course for Overseas Students) teachers in Australia being initiated
into the classroom-centred process of ‘action research’ and then undertaking projects
relevant to their own teaching environments. Action research is widely accepted as a
pertinent form of research for English language teachers (Burns, 2010; Nunan, 2001),
permitting them to become active participants in the research community. Further,
it is one example of ‘reflective pedagogy’, encouraging teachers to contemplate and
better understand their practice in order to make informed improvements in their
classrooms (Bailey, 2009; Nunan, 2001; Wallace, 1991). In addition to presenting
the results of the current project, this article aims to provide an example for other
teachers of how they could investigate a classroom ‘issue’ using an action research
approach in their own contexts.
Theoretical overview
The action research process involves consulting the literature during the research
itself and to a large extent at the analysis stage; however, the relevant theories
and studies will be summarised here in order to provide a clear theoretical context
from the outset. As mentioned above, AfL is the main concept investigated in this
study, and so the relevant aspects of AfL will be outlined first of all. Over the last
20 years, Assessment for Learning (also termed Assessment as Learning by some
researchers such as Earl, 2003) as opposed to Assessment of Learning, has become
a major educational trend, especially in mainstream education, encouraging a focus
on formative assessment. According to the UK-based Assessment Reform Group’s
(ARG) main definition, AfL is:
the process of seeking and interpreting evidence for use by learners and their
teachers to decide where the learners are in their learning, where they need to
go and how best to get there (2002a, p. 2).
Embedded in this definition are three aspects that have been transformed into three
questions students need to ask themselves (with guidance from their teachers) in
relation to assessment and learning:
• [Teachers should] give feedback that enables pupils to know the next steps
and how to succeed in taking them.
Reflect
Plan
CYCLE 1
Observe
Action
Reflect
Revised
Plan
CYCLE 2 Observe
Action
This view, combined with reading articles about AfL and goal-setting principles, led
to the research question for the second stage of the project:
How can goal setting using assessment rubrics in my Academic English class
most effectively enable students to assess and monitor their own written
assignments?
In addition to answering this question, this second stage also had the objective of
integrating assessment with classroom learning and teaching, in accordance with
AfL principles. The intervention involved implementation of goal-setting activities
based on assessment rubrics over a period of eight weeks in three cycles, shown in
Figure 3, accompanied by continuous qualitative and quantitative data collection.
After introducing the participants, the specific procedure for each cycle will then be
described in turn, followed each time by the results and analysis of each cycle. This
sequencing has been chosen to illustrate as accurately as possible the action research
‘thought process’ for this study, and the headings reflect the action research stages
(see Figure 1) of ‘planning’, ‘action’, ‘observation’ and ‘reflection’.
2) Goals provide a It helps me to focus on my needs and to do the activities that really
focus to improve will improve my knowledge.
If you don’t know where do you want to go, you will not go anywhere.
3) Goals provide Setting goals provide you the motivation to reach a target, in that case
motivation improving English.
The students in this class clearly had an awareness of the importance of and reasons
for goal setting, probably because they all had specific goals in terms of achieving
an IELTS score or an Academic English level to enter university. However, despite
the learners’ keen awareness and although most of them were able to express their
writing goals quite well in relation to the assessment criteria, they found it much
more of a challenge to specify relevant methods of achieving these goals – as shown
through selected examples in Table 2.
Responses to question 4: What goals do you Responses to question 5: How are you going
have to improve your essays? to achieve these goals?
(4a) I have to improve my academic (5a) I’m going to write more essays and try to
vocabulary and grammar such as prepositions. learn new vocabulary as much as I can.
(4b) Improve grammar, I think sometimes (5b) Ask teacher and try to find the
when I write essay I confuse some tenses. information how to use that tense from books
or the Internet.
(4c) I need to answer the question correctly. (5c) Practise more. Learn from the mistakes.
Use the topic we learn from the class. Pay
attention.
I think my potential is not improved very much, because just one mark, I think I
have to improve more than this. So that’s why I have to see about the feedback
what is the point I have to fix and how to find a method to get a higher mark
than before. [Student 1]
Limitations
There were several limitations of this study that should be noted. Firstly, the data
collected are only able to show short-term change over eight weeks and therefore
a longitudinal action research study exploring a similar theme would be valuable.
Additionally, it was not possible to study a control group due to the nature of the
rolling intake system; however, this was countered considerably by triangulation of
the data. It is also likely that a range of factors were involved in determining each
student’s score for each assignment (such as motivation for the topic, time available,
class attendance), so it would be misleading to conclude that each increase in score
analysed was due to the effect of the goal-setting intervention.
This study aimed to explore the use of AfL principles to enhance student progress
on a high-stakes Academic English course in Australia, using action research as the
guiding process. Although, as explained above, it is impossible to state categorically
from this study that the implementation of goal-setting activities resulted in all
students making progress with their writing, it is certainly clear that these methods
benefited many of the Academic English students involved, equipping them with study
skills that will also be useful in the future. The usefulness of employing assessment
rubrics in feedback and as the basis for goal setting has also been highlighted, but
Numerous AfL studies have already been undertaken in the public education sector;
for example, Black and colleagues (1998, 2004) have done much work with teachers
from public high schools in the UK, promoting AfL principles and their integration into
classroom teaching and assessment. There is now a need for more research into AfL
in the private EFL/ESL sector, especially action research, since this is a vital method
of bridging the gap between theory and practice and making research accessible
and relevant to teachers (Allwright & Bailey, 1991; Nunan, 2001).
ACKNOWLEDGEMENT
Emily Edwards has taught English in Europe, Japan and Australia, and is
currently working as an Academic English Coordinator at English Language
Company in Sydney. She is hoping to start her PhD studies soon.
e.c.edwards@hotmail.co.uk
2. On your essay feedback sheet, the final section asks you to set goals to
improve your next essay based on that first essay feedback. Do you like
doing this? Please circle: yes/no
Do you think it helps you to improve your writing in your next essay?
3. Which of the 5 criteria areas for your essays do you think you need to
improve most? Please tick ü ONE area only:
• Response to question
• Structure & organisation
• Vocabulary
• Grammar
• Research & referencing (for EAP students)
4. What goals (if any) do you currently have to improve your essays?
Please explain them here:
5. How are you going to achieve this goal/these goals (i.e., what are you
going to do exactly)?
The following grid shows how cards were designed based on the specific criteria of the
assessment rubrics. For each specific criterion, two methods were supplied by the teacher,
and then the grid cut up to make cards. Learners then had to match methods (white cards)
to goals (dark grey card).
Overall Specific criteria (my How to achieve my goal A How to achieve my goal B
criteria goal is to improve
this)
• I will highlight/ • I will highlight/
underline the parts underline the parts of
of the task/question the task/question in
Responds to all parts
Response to in different colours different colours and
of the task fully
and then highlight my then make an essay
question answer to each part in plan which covers all
my final essay aspects of the question
• When I’ve finished my • I will check in my
Includes a clear essay, I will highlight/ notebook/ textbook or
position/thesis underline the position with another student
statement /purpose/ and outline statements for ideas on how to
outline in my introduction write clear position
statements and outlines
• I will ask myself: does • I will ask myself: have I
Presents relevant each point I make explained each point I
information which is relate directly to the make clearly, and have
well developed and question? I supported each point
supported with an example?
This sheet was used for students to record their writing goals, methods, and progress. It was
designed to encourage self-directed study and monitoring of progress, but also incorporated
feedback from the teacher in the form of encouragement or tips relating to the methods
chosen. An example of one student’s completed sheet can be seen at the bottom of this page.
Name: ..................................
1) Date: ................................
2) Date: ................................