- Large-scale assessments traditionally take a psychometric perspective focused on measuring outcomes, while classroom assessments examine student thinking and learning processes.
- Both assessment types should support student learning, reflect important mathematics, and provide opportunities for students to demonstrate their knowledge.
- While formats differ, common principles like problem solving, modeling, and representing the complex nature of mathematics should be valued in both large-scale and classroom assessments.
- Large-scale assessments traditionally take a psychometric perspective focused on measuring outcomes, while classroom assessments examine student thinking and learning processes.
- Both assessment types should support student learning, reflect important mathematics, and provide opportunities for students to demonstrate their knowledge.
- While formats differ, common principles like problem solving, modeling, and representing the complex nature of mathematics should be valued in both large-scale and classroom assessments.
- Large-scale assessments traditionally take a psychometric perspective focused on measuring outcomes, while classroom assessments examine student thinking and learning processes.
- Both assessment types should support student learning, reflect important mathematics, and provide opportunities for students to demonstrate their knowledge.
- While formats differ, common principles like problem solving, modeling, and representing the complex nature of mathematics should be valued in both large-scale and classroom assessments.
Large-scale assessment and classroom assessment have different
traditions/backgrounds, having been influenced in different ways by learning theories and perspectives (Glaser and 2 State of the Art 3 Silver 1994). Large-scale assessment traditionally comes from a psychometric/ measurement perspective, and is primarily concerned with scores of groups or individuals, rather than examining students’ thinking and communication processes. A psychometric perspective is concerned with reliably measuring the outcome of learning, rather than the learning itself (Baird et al. 2014). The types of formats traditionally used in large-scale assessment are mathematics problems that quite often lead to a single, correct answer (Van den Heuvel-Panhuizen and Becker 2003). Some might see these types of questions as more aligned with a behaviourist or cognitivist perspective as they typically focus on independent components of knowledge (Scherrer 2015). A focus on problems graded for the one right answer is sometimes in conflict with classroom assessments that encourage a range of responses and provide opportunities for students to demonstrate their reasoning and creativity, and work is being done to examine large- scale assessment items that encourage a range of responses. Current approaches to classroom assessment have shifted from a view of assessment as a series of events that objectively measure the acquisition of knowledge toward a view of assessment as a social practice that provides continual insights and information to support student learning and influence teacher practice. These views draw on cognitive, constructivist, and sociocultural views of learning (Gipps 1994; Lund 2008; Shepard 2000, 2001). Gipps (1994) suggested that the dominant forms of large-scale assessment did not seem to have a good fit with constructivist theories, yet classroom assessment, particularly formative assessment, did. Further work has moved towards socio-cultural theories as a way of theorizing work in classroom assessment as well as understanding the role context plays in international assessment results. Common Principles There are certain principles that apply to both large-scale and classroom assessment. Although assessment may be conducted for many reasons, such as reporting on students’ achievement or monitoring the effectiveness of an instructional program, several suggest that the central purpose of assessment, classroom or large-scale, should be to support and enhance student learning (Joint Committee on Standards for Educational Evaluation 2003; Wiliam 2007). Even though the Assessment Standards for School Mathematics from the National Council of Teachers of Mathematics in the USA (NCTM 1995) are now more than 20 years old, the principles they articulate of ensuring that assessments contain high quality mathematics, that they enhance student learning, that they reflect and support equitable practices, that they are open and transparent, that inferences made from assessments are appropriate to the assessment purpose, and that the assessment, along with the curriculum and instruction, form a coherent whole are all still valid standards or principles for sound large-scale and classroom assessments in mathematics education. Assessment should reflect the mathematics that is important to learn and the mathematics that is valued. This means that both large-scale and classroom assessment should take into account not only content but also mathematical practices, processes, proficiencies, or competencies (NCTM 1995, 2014; Pellegrino et al. 2001; Swan and Burkhardt 2012). Consideration should be given as to whether and how tasks assess the complex nature of mathematics and the curriculum or standards that are being assessed. In both large-scale and classroom assessment, assessment design should value problem solving, modelling, and reasoning. The types of activities that occur in instruction should be reflected in assessment. As noted by Baird et al., “Assessments define what counts as valuable learning and assign credit accordingly” (2014, p. 21), and thus, assessments play a major role in proscribing what occurs in the classroom in countries with accountability policies connected to high-stakes assessments. That is, in many countries the assessed curriculum typically has a major influence on the enacted curriculum in the classroom. Furthermore, assessments should provide opportunities for all students to demonstrate their mathematical learning and be responsive to the diversity of learners (Joint Committee on Standards for Educational Evaluation 2003; Klieme et al. 2004; Klinger et al. 2015; NCTM 1995). In considering whether and how the complex nature of mathematics is represented in assessments, it is necessary to consider the formats of classroom and large-scale assessment and how well they achieve the fundamental principles of assessment. For instance, the 1995 Assessment Standards for School Mathematics suggested that assessments should provide evidence to enable educators “(1) to examine the effects of the tasks, discourse, and learning environment on students’ mathematical knowledge, skills, and dispositions; (2) to make instruction more responsive to students’ needs; and (3) to ensure that every student is gaining mathematical power” (NCTM, p. 45). These three goals relate to the purposes and uses for both large-scale and classroom assessment in mathematics education. The first is often a goal of large-scale assessment as well as the assessments used by mathematics teachers. The latter two goals should likely underlie the design of classroom assessments so that teachers are better able to prepare students for national examinations or to use the evidence from monitoring assessments to enhance and extend their students’ mathematical understanding by informing their instructional moves. Classroom teachers would often like to use the evidence from large-scale assessments to inform goals two and three and there are successful examples of such practices (Boudett et al. 2008; Boudett and Steele 2007; Brodie 2013) where learning about the complexity of different tasks or acquiring knowledge about the strengths and weaknesses of one’s own instruction can inform practice. However, this is still a challenge in many parts of the world given the nature of the tasks on large-scale assessments, the type of feedback provided from those assessments, and the timeliness of that feedback. Table 1 provides a sample of assessment goals that are taken from different perspectives and assessment purposes. Looking across the columns of the table, there are similarities in the goals for assessment that should inform the design of tasks, whether the tasks are for formative assessment, for competency models, or for high-stakes assessment; in fact, they typically interact with each other. Specifically, teachers and students need to know what is expected which implies that tasks need to align with patterns of instruction, tasks need to provide opportunities for students to engage in performance that will activate their knowledge and elicit appropriate evidence of learning, the assessment should represent what is important to know and to learn, and when feedback is provided it needs to contain enough information so that students can improve their knowledge and make forward progress. These common goals bear many similarities to the 1995 NCTM principles previously discussed.