Professional Documents
Culture Documents
ARC-Backgrounder Checklist
ARC-Backgrounder Checklist
ARC-Backgrounder Checklist
Work with group to determine why the author used the contextual
reference background to support points in the text.
Work with group to rank each contextual background reference from Ranking scale
1 (irrelevant) to 5 (very useful to help understand the text) (optional)
Individual What was the biggest challenge of being the Backgrounder? Why?
reflection(
after the
ARC)
What advice would you give the next Backgrounder of your group?
Adapted from checklists created by Seburn, T., 2016. Academic reading circles. Createspace Independent Publishing Platform.
Adapted from checklists created by Seburn, T., 2016. Academic reading circles. Createspace Independent Publishing Platform.
Rating scales McNamara (1996), the scale used in assessing performance tasks
represents both implicitly and explicitly, the theoretical foundation upon
which the test is built.
Weigle (2002, p. 109) reviewed rating scales used to score writing
assessments
and found two features that could be used to distinguish between
different types. These apply equally well to scales used to assess
speaking.
+ Task-specific versus generic scales
+ Holistic (primary traits) VS analytic scales (multiple traits - 5 criteria
Range, Accuracy, Fluency, Interaction and Coherence)
Behaviour or Bachman (1990) and Council of Europe (2001), scales can also be
ability? categorised according to whether they are more ‘real world’ and
‘behavioural’ in orientation or whether they are more
‘ability/interaction’
and ‘normative’
Nested systems Pollitt (1991), the grade of the examination contributes to the
interpretation of each score.
Intuitive North (2000), Fulcher (2003) categorised recent methods of scale
approaches development within two general approaches: intuitive and empirical.
towards + intuitive: experts prepare rating scales according to their intuitions,
designing established practice, a teaching syllabus, a needs analysis. Refined
rating scales overtime, new development.
+ empirical methods: more directly based on evidence.
Upshur and Turner (1995) described three alternative empirical
approaches: empirically derived, binary-choice, boundary-definition
(EBB) scales
Criticism of Fulcher et al. (2011, p. 9) objected to such quantitative ‘scaling
quantitative rating descriptors’ approaches, arguing that ‘Measurement-driven scales suffer
scales from descriptional inadequacy. They are not sensitive to the
communicative context or the interactional complexities of language
use.’
Ways to encourage Walsh (2011) ways that have been suggested to encourage reflective
reflective thinking thinking include allowing time for learners to self-correct and increasing
wait time for learners (the time between putting a question and
expecting a response.
???
1. Fulcher (2003): Assessment designers need to decide how best to take account of
such choices when scoring performance. P132
2. Weigle (2002, p. 109) reviewed rating scales used to score writing assessments
and found two features that could be used to distinguish between
different types. These apply equally well to scales used to assess speaking.
3. Stobart (2008) their retrospective standpoint, delayed feedback, reductive scoring
and limited sampling limits the diagnostic and formative potential of external tests.
Adapted from checklists created by Seburn, T., 2016. Academic reading circles. Createspace Independent Publishing Platform.