Professional Documents
Culture Documents
WIDA PRIME 2020 Rubric and Portfolio Workbook 1
WIDA PRIME 2020 Rubric and Portfolio Workbook 1
WIDA PRIME 2020: Eligible Materials for the External Review Process . . . . . 7
Portfolio Checklist. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Summary Self-Rating. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Appendix B: References. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Appendix C: Acknowledgements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Over the years, there have been multiple reports indicating that there is a lack of standards-aligned,
high-quality curricular materials that support multilingual learners well (see, for example, de Araujo & Smith,
2022; Estrada, 2005; Gándara et al., 2003; Loewus, 2016; Mitchell, 2019). With the release of the Framework,
there is a recognition among educators that curriculum and instruction will need to shift. One of the benefits
of the PRIME review process is the feedback it provides to material developers for strengthening alignment.
The productive conversations educators have while reviewing materials (i.e., the review process) provide
additional benefits.
Through PRIME and a host of other resources it offers, WIDA hopes to increase the availability of high-quality
instructional materials that are student-centered, culturally and linguistically sustaining, and responsive to
multilingual learners' strengths and needs.
Increasing the availability of rigorous, high-quality core materials that attend to the diverse needs of multilingual
learners is a critical avenue to move forward toward the realization of the Big Ideas of the Framework, namely
Educational entities (publishers and local users) may use WIDA PRIME to
• Prompt productive conversations about how instructional materials are serving multilingual learners
• Guide self-reflection, self-analysis, self-assessment, and self-determination of a degree of alignment
between a given set of instructional materials and the Framework via the criteria specified in the PRIME
rubric
• Collect evidence and information about instructional materials for potential improvements and revisions to
strengthen alignment with the Framework
• Support communication with stakeholders (e.g., parents, program directors, school boards, teachers,
program reviewers) about instructional materials under consideration for adoption
The WIDA PRIME 2020 Rubric and Workbook is written for publishers seeking a PRIME 2020 seal of alignment
to the Framework for a set of instructional materials and for PRIME reviewers who determine eligibility of the
materials for the PRIME seal. Local users can adapt the detailed PRIME review process for publishers as needed
to fit their own review of curriculum alignment with the Framework.
• WIDA PRIME Rubric: alignment criteria, indicators, descriptors, and a scoring scale for inferring a degree
of alignment between a given set of instructional materials and the Framework.
• WIDA PRIME Portfolio Workbook: a guided workbook that an educational entity (i.e., publisher, district,
school, or group of educators) uses to compile an evidence-based portfolio to demonstrate alignment
between a given set of instructional materials and the Framework according to the PRIME rubric.
• WIDA PRIME Seal: an awarded seal that can be earned by publishers through an external review process.
The PRIME seal indicates that a team of WIDA-trained reviewers believes the publisher has provided
sufficient evidence to determine a degree of alignment between a given set of instructional materials and
the Framework, based on the PRIME rubric.
0 Ed iti o n
Alig n e d to t
will earn the PRIME seal—since it will be awarded according to the
review team’s evidence-based determination of a degree of alignment.
202
PRIME 2020
he
Publishers' materials that earn the seal may be posted, along with final
k,
ID
or
W
A e
w
reports, on the WIDA PRIME Instructional Materials Published Reviews EL
D St ra m
an d ards F
page, which then serves as one data point to inform district and school
choices in materials adoption.
At this time, materials developed by local users in district and school contexts are not eligible to undergo
the external review process with WIDA-trained reviewers in order to earn approval for use of the PRIME seal.
However, local users may still benefit from using PRIME to have productive discussions about curriculum and
make local determinations of alignment.
This publication is not intended as an introduction to the Framework or to curriculum design. A thorough
understanding of the Framework and curriculum design are needed to effectively apply the PRIME rubric and
review process. WIDA offers several ways to support learning about the Framework, including through the
WIDA ELD Standards page and a suite of professional learning offerings.
The PRIME seal does not imply overall high quality of materials. It refers only to
alignment.
WIDA PRIME is not an evaluative tool that judges the overall effectiveness of instructional materials, and
the PRIME seal does not imply that the submitted materials have been evaluated to show a positive impact
on student learning outcome. As described in its theory of action (page 8), PRIME reviews yield a socially
constructed inference about a degree of alignment between the Framework and a given set of instructional
materials designed to teach them, in accordance with the criteria in the PRIME rubric. Yet instructional materials
can and should do more, such as supporting development of student agency and critical stance and inviting
The PRIME seal is not an endorsement from WIDA for any set of instructional materials.
WIDA does not make recommendations or determine that one set of instructional materials is better than
another. Educators of multilingual learners work with a heterogeneous population with a wide range of
strengths and needs, in a variety of programs, and in a wide range of environments. The question of what is
"the best" curriculum for one student, teacher, or school requires more information than what PRIME analyzes
through its rubric.
The PRIME seal cannot account for how instructional materials are enacted in specific
contexts.
Each school, classroom, teacher, and student is unique, and so are the instructional decisions educators make
to engage multilingual learners during each task, lesson, and unit.
Local or publisher self-determination of alignment is not the same as earning the PRIME
seal.
A local process of review that appropriately uses PRIME tools may be helpful in self-determining alignment
of materials. That is one use of PRIME. However, the PRIME process cannot account for how a self-selected
local or publisher panel may enact the PRIME tools in specific contexts. The PRIME seal can only be awarded
through an external and independent review process completed by a team of WIDA-trained reviewers
that makes a determination of sufficient alignment between a given set of instructional materials and the
Framework, based on the PRIME rubric.
PRIME spotlights the need for curricular coherence of core (Tier 1) instructional materials. Although at this
time PRIME only reviews alignment of materials in relation to the four core content areas represented by the
WIDA ELD Standards Statements (language arts, math, science, and social studies), we recognize that language
permeates schooling and that all teachers are in fact language teachers.
To support this goal, publishers may submit the following instructional materials for external review of
alignment by a WIDA-trained team of reviewers in order to earn the PRIME seal:
• Materials for one full year’s course of study in the core academic disciplines (language arts, mathematics,
science, and social studies or interdisciplinary materials) that are designed to align with the Framework.
• Materials for one full year’s course of study of dedicated ELD instruction that clearly and concretely
connect to grade-level academic content standards.
• Whether in the core academic disciplines or dedicated ELD, publishers may also submit adjacent
grade levels when they are within the Framework’s grade-level clusters (K, 1, 2–3, 4–5, 6–8, 9–12) for
an extended review. For example, if a publisher submits a portfolio for review of grade 4, they may
also submit a rationale and evidence for why grade 5 maintains the same approach and structure of
alignment to the Framework as grade 4 does. (For more information about the extended review, see
Appendix A.)
• Supplemental materials for multilingual learners may be submitted, but only if clearly and concretely
connected to grade-level core instructional materials.
Alignment: A socially mediated set of procedures meant to establish the association between two or more
equivalent educational artifacts, commonly identified as curriculum, instruction, standards and/or assessments.
(Cook, 2017). In PRIME, alignment refers to the degree to which instructional materials are in agreement, and
serve in conjunction with the Framework to guide the educational system to support multilingual learners in
developing language in the context of grade-level disciplinary learning in ways that are student-centered,
culturally and linguistically sustaining, and responsive to student strengths and needs. A broader view of
alignment continues beyond PRIME and the focus on instructional materials to include other parts of the
educational system, such as instructional practices, professional learning, teacher education, and local policy.
Criteria: To determine the degree of alignment, the PRIME rubric uses three criteria previously operationalized
by distinct but related alignment methodologies: match, depth, and breadth (Cook, 2006; Webb, 2007; Porter
et al., 2007). The three criteria are applied to each of the four components of the Framework (ELD Standards
Statements, Key Language Uses [KLUs], Language Expectations, and Proficiency Level Descriptors [PLDs]). The
table below describes each criterion. In Section III of this document (Portfolio Workbook), each criterion is
accompanied by indicators, key questions, and references to specific page numbers in the Framework.
What are the criteria? What do the criteria determine? How is each criterion met?
• Match This criterion determines whether The criterion is met if evidence
• Depth instructional materials… related to indicators clearly
• Breadth shows that materials…
Match is the degree address the same or similar concepts explicitly and concretely
to which instructional and ideas about language development connect to the concepts
materials connect to that appear in each component of the and ideas embedded in each
the Framework. Framework. component of the Framework.
Depth is the degree reflect the linguistic purpose, variety, are planned to support
to which materials richness, and complexity embodied in each multilingual learners to develop
capture the linguistic component of the Framework (e.g., various language in purposeful,
purpose, variety, purposes of Key Language Uses; language varied, and ever-expanding
and complexity development over a variety of texts and ways congruent to the
embedded in the tasks; growing complexity through the three concepts, ideas, and practices
Framework. dimensions of language). embodied in the Framework.
Key Questions: These help educational entities consider where and how materials might be designed to
support multilingual learners in developing language for learning in ways that are congruent with the rubric
criteria and indicators.
• Then,
• if the match, depth or breadth is weak between instructional materials and the Framework,
• the educational entity has clarity on how to improve instructional materials for stronger alignment to
the Framework, and
• the sponsoring educational entity has limitations regarding the inferences they can make about
alignment to the Framework
• if the match, depth, or breadth is strong between artifacts,
• the sponsoring educational entity can claim strong inferences about the relationship between
instructional materials and the Framework
The focus of scoring rests largely in Part C, where for each of the four components of the Framework (ELD
Standards Statements, Key Language Uses, Language Expectations, and Proficiency Level Descriptors),
educational entities will submit, as part of their self-analysis and self-assessment:
Scoring: After carefully reviewing the complete portfolio and checking against evidence in the materials,
reviewers score each rubric criterion for each Framework component according to the following scale:
On the next page is an example of the form that local review panels will use to self-rate locally developed
materials, or that WIDA-trained reviewers will use to determine eligibility of published materials for the PRIME
seal.
Breadth.ELD
Breadth.KLU
Breadth.LE
Breadth.PLD
Sample Rating 1
Framework Lowest
Match 1 Match 2 Depth Breadth
Components Criterion Score
ELD Standards
4 4 3 3 3
Statements
Key Language
3 n/a 3 3 3
Uses
Language
3 n/a 3 3 3
Expectations
Proficiency Level
3 n/a 2 3 2
Descriptors
If publishers score a 2 (present but insufficient) in two or more Framework components (e.g., Language
Expectations and Proficiency Level Descriptors, they are not yet eligible to earn the seal.
Sample Rating 1
Framework Lowest
Match 1 Match 2 Depth Breadth
Components Criterion Score
ELD Standards
4 4 3 3 3
Statements
Key Language
3 n/a 3 3 3
Uses
Language
3 n/a 2 3 2
Expectations
Proficiency Level
3 n/a 3 2 2
Descriptors
Section III of this document offers a detailed description of the PRIME review and scoring processes.
1. Create a submissions team: assemble a qualified small team with depth of expertise in curriculum design
and the Framework. (A small team is preferable to a single person.)
2. Learn: Review this complete document to understand what is required for submission (e.g., eligible
materials, submissions process) and how that information will be organized and scored (e.g., portfolio
format). Become thoroughly familiar with the PRIME rubric’s criteria, indicators, and key questions, as
well as with the review and scoring process. All these factors will help determine alignment between
instructional materials and the Framework.
3. Begin self-analysis of alignment: Use this document to guide self-reflection and self-analysis. Take notes
and begin planning the pieces of evidence you might collect in order to make evidence-based alignment
claims between instructional materials and the Framework.
b. Part B: Alignment to Big Ideas: Develop a narrative analysis and provide evidence of how
instructional materials align to the Framework’s Big Ideas. Although this part of the portfolio is not
scored, publishers who earn the seal may have this narrative included in the final report that helps
local users make decisions about materials adoptions, and local users may present this narrative to
stakeholders.
i. An alignment claim for each rubric criterion: Make evidence-based claims about the degree
of alignment you believe exists between materials and the Framework. The alignment claim
should be based on the rubric’s criteria and indicators as defined above and detailed in the
portfolio workbook. For each criterion, the educational entity will make a claim that they have
submitted evidence that is consistent with the following scale:
iii. Evidence to support claim(s): Clearly, concretely, and precisely document where in the
materials the evidence for claims can be found. Include page numbers and links.
ii. Areas of need and growth plan: Identify needs in materials that show non-existent or weak
alignment to the Framework as stipulated by the PRIME rubric, and describe a plan for how
areas of growth might be addressed in the next materials development cycle. Note that this
growth plan will not be used by reviewers to determine eligibility for the PRIME seal. Instead,
you may use it when planning for future development of materials. One of the benefits of the
PRIME review process is the productive conversations educators and materials developers
have while reviewing materials.
iii. Rate rubric: confirm and summarize your ratings for each rubric criterion.
5. Complete the portfolio checklist: Use the checklist to determine if portfolio is ready for submission.
Incomplete submissions will not be reviewed.
I. Include a full year’s course of study: Include the full, year-long scope of materials (refer to eligibility
of materials on page 7). You may also include supplementary materials when they clearly and
concretely connected to grade-level core instructional materials. If you are requesting an extended
review, include any adjacent grade levels from within the Framework’s grade-level clusters (K, 1, 2–3,
4–5, 6–8, 9–12). For more information about preparing the extended review, see Appendix A.
6. Begin submission of your portfolio workbook through the PRIME website. A call will be set up for initial
conversations with publishers.
Publishers should remember that incomplete portfolios will not be accepted for review in order to
earn the PRIME seal.
Local Users may also use this checklist to prepare for analysis of locally developed instructional
materials. As previously noted, it is important to highlight that the PRIME seal can only be awarded
through a process completed by WIDA-trained reviewers. The PRIME process cannot account for how
a self-selected local panel (comprised of local educators or publishers) may enact the PRIME tools in
specific contexts.
q Portfolio Part A: Orientation to materials includes general descriptive information (e.g., title, discipline,
grade-level, format, etc.). We have included the following:
q Student materials
q Any supplementary or companion resources that concretely connect to and support core materials
q Links to materials and any other curricular reviews that have been completed (e.g., EdReports)
q Portfolio Part B: Alignment to Big Ideas includes a narrative response indicating how materials align to
the Framework’s Big Ideas, along with clear and concrete evidence to support the narrative response.
Note that although Part B is not scored, publishers who earn the seal may have this narrative included
in the final report that helps local users make decisions about materials adoptions, and local users may
present this narrative to stakeholders.
q Portfolio Part C: Alignment to Components of the Framework. For each Framework component we have
completed a self-reflection and analysis considering the following:
q For each criterion, we provided a robust justification referring to the criterion and its indicators
q For each criterion, we provided strategically curated and sufficient evidence to support the claim
(include page numbers and direct links).
q Portfolio Part D: Summary of Alignment Self-Analysis. We have summarized strengths and areas of growth
for alignment in the materials and included specific evidence (include page numbers and direct links).
Part A of the portfolio is where you lay out the general descriptive information about your materials,
such as the title, discipline, grade levels, and format.
Title of Materials:
The materials submitted for review meet the eligibility requirement. Check one:
q Materials for one full year’s course of study in the core academic disciplines (language arts,
mathematics, science, social studies or interdisciplinary materials) that are designed to align with the
Framework.
q Materials for one full year’s course of study of dedicated ELD instruction that clearly and
concretely connect to grade-level academic content standards.
q Adjacent grade-levels. Whether in the core academic disciplines or dedicated ELD, publishers
may also submit adjacent grade levels when they are within the Framework’s grade-level clusters
(K, 1, 2–3, 4–5, 6–8, 9–12) for an extended review (Appendix A). For example, if a publisher submits
a portfolio for review of grade 4, they may also submit a rationale and evidence for why grade 5
maintains the same approach and structure of alignment to the Framework as grade 4 does.
q Any supplementary materials. Supplemental materials for multilingual learners may be submitted,
but only if clearly and concretely connected to grade-level core instructional materials.
q Grade level
q Content area(s)
q General scope of materials: how many units of learning are included in the submitted materials?
(If materials are not organized through units of learning, describe alternate organizational schema)
q Type of materials included (e.g., student core text and workbook, teacher’s guide, etc.)
q Include any necessary additional descriptions or pertinent information reviewers should be aware
of.
q Have you had any other external reviews of the materials completed (e.g., EdReports, evidence for
state-based reviews)? If so, please include the link(s) to the published reports.
Four Big Ideas are interwoven throughout the Framework. Like the WIDA Can Do Philosophy, they
support the design of standards-based educational experiences that are student-centered, culturally
and linguistically sustaining, and responsive to multilingual learners’ strengths and needs.
Part B of the portfolio is where you describe your alignment to the Big Ideas.
• Learn more about Big Ideas on pages 15–20 of the WIDA English Language Development
Standards Framework, 2020 Edition.
• Appendix F: "Theoretical Foundations" offers an overview of theories and research that informed
the development of the Big Ideas (pages 354–367 of the 2020 Edition).
Use the prompts on the following pages to develop a narrative analysis and provide evidence of how materials
align to the Framework’s Big Ideas. Page numbers refer to the WIDA ELD Standards Framework, 2020 Edition.
Although this part of the portfolio is not scored, publishers who earn the seal may have this narrative included
in the final report that helps local users make decisions about materials adoptions, and local users may present
this narrative to stakeholders.
YOUR TURN → Concrete, precise, and clear evidence supporting narrative response (include page
numbers and links):
YOUR TURN → Concrete, precise, and clear evidence supporting narrative response (include page
numbers and links):
YOUR TURN → Concrete, precise, and clear evidence supporting narrative response (include page
numbers and links):
YOUR TURN → Concrete, precise, and clear evidence supporting narrative response (include page
numbers and links):
Part C of the portfolio addresses each component of the WIDA ELD Standards Framework.
Underpinned by the four Big Ideas, the Framework offers road signs to set goals for curriculum,
instruction, and assessment for multilingual learners. The Framework consists of four components (ELD
Standards Statements, Key Language Uses, Language Expectations, and Proficiency Level Descriptors)
that work together to make a comprehensive picture of language development.
For each Framework component, complete a self-reflection and analysis considering the following:
q Each criterion description (match, depth, and breadth—defined on page 8 of this document)
q Indicators for each criterion (with direct references to page numbers in the 2020 Edition)
q Provide strategic and sufficient evidence to support the claim (include page numbers and direct
links)
The following pages describe each criterion. After the first criterion is a workbook page you can use as a note-
taking template for each criterion. You may print out the page if you choose to hand write notes, or copy the
template into your own electronic form (e.g,, MS Word or Google Doc). Once publishers establish contact to
apply for a PRIME seal, a link will be sent for electronic submission of materials.
The five WIDA ELD Standards Statements guide us to create materials that simultaneously develop content
and language, where language development is positioned in service of disciplinary learning. Standard 1,
Language for Social and Instructional Purposes (ELD-SI) helps teachers become aware of language for social
interactions, everyday routines, negotiation, and problem-solving. ELD-SI works alongside and blends into
Standards 2–5 that address disciplinary language (ELD-LA for Language Arts, ELD-MA for Math, ELD-SC for
Science, and ELD-SS for Social Studies). This interweaving reminds us that students communicate to learn, but
also to convey personal needs and wants, to interpret and present different perspectives, to affirm their own
identities, and to form and maintain relationships.
• Learn more about the WIDA ELD Standards Statements and the relationship of Standard 1 to Standards 2–5
on pages 24–25 of the 2020 Edition.
• Appendix F: "Theoretical Foundations" offers an overview of theories and research that informed the
development of the WIDA ELD Standards Statements (pages 354–367).
• Criterion Match.ELD.1 determines whether the same or similar concepts and ideas about language
development appear in materials and in ELD-SI.
• Match.ELD.1 is met if evidence related to indicators clearly shows that materials explicitly and concretely
connect to the indicators of ELD-SI.
a. Reflect and guide teachers to value and • Reflects students’ cultures, languages, and
leverage students’ languages, cultures, backgrounds?
experiences, and identities. (2020 Edition, • Leverages students’ languages, cultures,
pp. 12, 18, 24–25) experiences, and identities as a resource
b. Support language for social and for learning and means of entering new and
instructional interactions. (e.g., everyday complex disciplinary topics?
routines, negotiation, and problem-solving) • Encourages social and instructional
(2020 Edition, p. 25) interaction?
c. Leverage ELD-SI as a valuable meaning- • Intertwines ELD-SI with content learning
making resource in conjunction with the represented by Standards 2–5 (ELD-LA, ELD-
disciplinary contexts represented by MA, ELD-SC, and ELD-SS)?
Standards 2–5 (ELD-LA, ELD-MA, ELD-SC,
and ELD-SS). (2020 Edition, p. 25)
Alignment claim: Evidence submitted for criterion ___________________________________________________________________ and its indicators is:
Provide specific and concrete evidence to support the claim (include links and page numbers):
• Criterion Match.ELD.2–5 determines whether the same or similar concepts and ideas about language
development appear in materials and in at least one of the ELD Standards Statements related to the core
disciplines (ELD-LA, ELD-MA, ELD-SC, and ELD-SS) (e.g., materials connect to Language for Science, ELD-
SC).
• Match.ELD.2–5 is met if evidence related to indicators clearly shows that materials explicitly and
concretely connect to at least one of ELD-LA, ELD-MA, ELD-SC, and ELD-SS.
• Criterion Depth.ELD determines whether materials reflect the linguistic purpose, variety, richness, and
complexity embodied in the ELD Standards Statements.
• Depth.ELD is met if evidence related to indicators clearly shows that materials are planned to support
multilingual learners to develop language in purposeful, varied, and ever-expanding ways congruent to
the concepts, ideas, and practices embodied in ELD-SI and at least one of ELD-LA, ELD-MA, ELD-SC, and
ELD-SS.
How do instructional materials reflect the linguistic richness, variety, and complexity
embodied in the ELD standards?
• Criterion Breadth.ELD determines whether materials consistently and systematically support language
development in ways that are congruent with the concepts, ideas, and practices represented in the WIDA
ELD Standards Statements.
• Breadth.ELD is met if evidence related to indicators clearly shows that materials consistently and
systematically address teaching and learning in service of ELD-SI and at least one of ELD-LA, ELD-MA,
ELD-SC, and ELD-SS over time and across a set of materials (across lessons, units, or according to an
alternate organization scheme).
Key Language Uses (KLUs)—Narrate, Inform, Explain, Argue—emerged from a systematic analysis of academic
content standards, disciplinary practices, and research literature. They bring focus and coherence to the
language of schooling, helping educators make choices in what to prioritize during curricular planning for
content-language integration.
• Criterion Match.KLU determines whether the same or similar concepts and ideas about language
development appear in materials and in KLUs.
• Match.KLU is met if evidence related to indicators clearly shows that materials explicitly and concretely
connect to KLUs (or prominent genres of schooling).
• Criterion Depth.KLU determines whether materials reflect the linguistic purpose, variety, richness, and
complexity embodied in KLUs.
• Depth.KLU is met if evidence related to indicators clearly shows that materials are planned to support
multilingual learners to develop language in purposeful, varied, and ever-expanding ways congruent to
the concepts, ideas, and practices embodied in KLUs (or prominent genres of schooling).
How do instructional materials reflect the linguistic purposes, variety, and complexity
embodied in Key Language Uses show?
a. Highlight how KLUs work in • Explaining how KLUs are constructed and used in
particular disciplines. (2020 • a disciplinary community or communities (e.g., an
Edition, pp. 26, 217–218) argument in language arts is different than a mathematical
b. Offer explicit explanations argument)?
of how KLUs work in a • a variety of texts and tasks (e.g., exposure to various
variety of texts, tasks, instances of argumentation)?
and purposes, examining • Examining and revealing organizational patterns characteristic
and revealing common of the genre (e.g., claim, evidence, and reasoning in Argue)?
and unique linguistic and • Drawing students’ attention to the ways in which linguistic
organizational features of choices are shaped by the speaker’s identity and social roles,
each KLU. (2020 Edition, p. as well as by topic, audience, purpose, and task (e.g., I make
217) different choices with language when I argue with my best
c. Emphasize language friend or my boss)?
use within sociocultural • Capturing the shared and unique ways in which KLUs work in a
contexts (e.g., for particular particular discipline?
purposes, topics, situations, • Showcasing how the KLUs intersect, blend, and build on each
participant’s identities and other?
social roles, audiences).
(2020 Edition, pp. 26, 363)
• Criterion Breadth.KLU determines whether materials consistently and systematically support language
development in ways that are congruent with the concepts, ideas, and practices represented by KLUs.
• Breadth.KLU is met if evidence related to indicators clearly shows that materials consistently and
systematically address teaching and learning in service of KLUs (or prominent genres of schooling).
Language Expectations are goals for content-driven language instruction. Developed from a systematic
analysis of academic content standards, Language Expectations are built around a set of Language Functions,
which in turn are supported by example Language Features (e.g., types of sentences, clauses, phrases, and
words).
• Learn more about Language Expectations on pages 28–30 of the 2020 Edition.
• Take a look at grade-level cluster materials to see Language Expectations (with Functions and Features)
• Appendix B offers sample correspondence tables for academic content standards and Language
Expectations
• Appendix C offers a compilation of all Language Expectations, K–12
• Appendix F: "Theoretical Foundations" offers an overview of theories and research that informed the
development of Language Expectations (pages 354–367).
• Criterion Match.LE determines whether the same or consistent concepts and ideas about language
development embodied in Language Expectations appear in materials.
• Match.LE is met if evidence related to indicators clearly shows that materials explicitly and concretely
connect to Language Expectations (or content-driven language goals and objectives).
• Criterion Depth.LE determines whether materials reflect the linguistic purpose, variety, richness, and
complexity embodied in Language Expectations.
• Depth.LE is met if evidence related to indicators clearly show that materials are planned to support
multilingual learners to develop language in purposeful, varied, and ever-expanding ways congruent to
the concepts, ideas, and practices embodied in Language Expectations (or content-driven language goals
that help students understand how language and genre work in service of disciplinary learning).
How do instructional materials reflect the linguistic purposes, variety, and complexity
embodied in the Language Expectations?
• Criterion Breadth.LE determines whether materials consistently and systematically support language
development in ways that are congruent with the concepts, ideas, and practices represented by Language
Expectations.
• Breadth.LE is met if evidence related to indicators clearly shows that materials consistently and
systematically address teaching and learning in service of Language Expectations (or content-driven
language goals that help students understand how language and genre work in service of disciplinary
learning).
Proficiency Level Descriptors (PLDs) are an articulation of student language performance across six levels
of English language proficiency. PLDs are written in interpretive and expressive communication modes,
and represent three dimensions of language use: discourse, sentence, and word/phrase. While Language
Expectations offer goals for how all students might use language to meet academic content standards, PLDs
describe how multilingual learners might develop language across levels of English language proficiency
as they move toward meeting Language Expectations. In this way, PLDs can inform choices about how to
monitor and support learning, so that instructional materials and instruction can maintain grade-level cognitive
challenge and rigor while intentionally scaffolding content and language development.
• Learn more about PLDs and the dimensions of language on pages 31–34 of the 2020 Edition.
• PLDs appear in grade-level cluster materials (pages 39–214).
• Appendix D offers some technical notes about PLDs, as well as a compilation of all PLDs, K–12 (page 329).
• Appendix F: "Theoretical Foundations" offers an overview of theories and research that informed the
development of the PLDs (pages 354–367).
• Criterion Match.PLD determines whether the same or similar concepts and ideas about language
development appear in materials and the PLDs.
• Match.PLD is met if evidence related to indicators clearly shows that materials explicitly and concretely
connect to PLDs (or research-based typical trajectories of language development).
• Criterion Depth.PLD determines whether materials reflect the linguistic purpose, variety, richness, and
complexity embodied in PLDs.
• Depth.PLD is met if evidence related to indicators clearly shows that materials are planned to support
multilingual learners to develop language in purposeful, varied, and ever-expanding ways congruent to
the concepts, ideas, and practices embodied in PLDs (or research-based typical trajectories of language
development).
How do instructional materials reflect the linguistic purposes, variety, and complexity
embodied in the PLDs?
• Criterion Breadth.LE determines whether materials consistently and systematically support language
development in ways that are congruent with the concepts, ideas, and practices represented by PLDs.
• Breadth.PLD is met if evidence related to indicators clearly shows that materials consistently and
systematically address teaching and learning that is informed by the PLDs (or research-based typical
trajectories of language development).
Portfolio Part D: Summary of Alignment Self-Analysis. Summarize strengths and areas of growth in
relation to alignment in the materials, referring to specific representative evident to support your
determination of strengths and needs.
Big Ideas
ELD Standards
Statements
Key Language
Uses
Language
Expectations
Proficiency Level
Descriptors
Include any additional information about the materials that you feel our review team should know.
Evidence for 4 3 2 1
alignment in Strong and Present Present but Not yet
relation to criteria comprehensive (2 indicators) insufficient sufficiently
and indicators is… (3 indicators) (1 indicator) present
(no indicators)
Match.ELD.1
Match.ELD.2–5
Depth.ELD
Breadth.ELD
Match.KLU
Depth.KLU
Breadth.KLU
Language Expectations
Match.LE
Depth.LE
Breadth.LE
Match.PLD
Depth.PLD
Breadth.PLD
The review process is described below in six steps, with suggestions for notetaking during the process.
Different types of material submissions, different team compositions, and a different combination of areas of
expertise in a team may prompt different approaches to note-taking. Use the examples below as a foundation
and add as needed. The reviewer’s careful and strategic note-taking will serve the following purposes:
• To document individual and joint review processes, collect data, substantiate evidence, and record
observations
• To prepare for deliberation at the debrief meeting when the review team will triangulate data and come to
agreement about final scores, thereby coming to consensus on a degree of alignment between materials
and the Framework
• To support drafting the alignment report
• In case of publishers undergoing external review by the team of WIDA-trained reviewers, these notes
support the deliberation process to determine whether the materials are eligible to receive the PRIME seal
of alignment.
Review team:
Lead reviewer:
Submission title:
Submission date:
Educational entity’s primary contact information:
1. Eligibility and completeness of materials: Reviewers check that materials are eligible, and that all
required components are present prior to beginning review. If any pieces of the portfolio are missing,
reviewers will send it back to the primary contact. The lead reviewer specifies which piece(s) of the
submission are missing and provides the primary contact with a date by which to submit the missing
pieces. Upon this initial look at the portfolio, the team also determines the length of the review window.
2. Selection of unit sampling: The review team selects a common set of units and/or sections of instructional
a. What are the common units or sections all reviewers will analyze? (e.g., 2 and 6).
b. In addition to the common units, what units or sections are assigned to individual reviewers as
"dipstick units?" (For example, reviewer A will analyze unit 4, reviewer B will analyze unit 10.)
c. The total number of units/sections that will be reviewed (both common and individual) represent
roughly what percentage of the submitted materials?
d. In addition to the year-long core course of study, are any other supplementary materials submitted?
If so, briefly note what they are?
e. Has an extended review (Appendix A) been requested for adjacent grade-levels within a grade-
level cluster? If so, note the requested additional grades.
3. Individual reviewer analysis and rating: Reviewers first work individually on all aspects of the portfolio’s
self-assessment: descriptions, narratives, alignment claims, justifications, and supporting evidence.
Moreover, reviewers substantiate and triangulate evidence in the materials, examining both the team’s
common units or sections (e.g., 2 and 6) and the individually assigned "dipstick units" or sections (e.g.,
units 4, 10, and supplement C). Reviewers rate the evidence submitted for each criterion using the scoring
system described on page 10.
INDIVIDUAL REVIEWER NOTES AND CRITERION SCORE (see form on next page)
Reviewer name:
Date:
Directions: Use the form on the next page to summarize findings from your individual analysis of materials.
Highlight the most compelling evidence you have found and offer criterion and indicator-based feedback,
noting strengths and weaknesses in alignment. This provides a rationale for how you will score each criterion.
Match.ELD.2–5
Depth.ELD
Breadth.ELD
Depth.KLU
Breadth.KLU
Depth.LE
Breadth.LE
Match.PLD
Depth.PLD
Breadth.PLD
a. The lead reviewer guides team discussion of each rubric criterion. Each team member shares
individual analysis, scores, and rationale for why they awarded each score. As they discuss, the team
also selects the best sources of evidence to include in the final report.
b. When there is lack of consensus, the team collaboratively compares individual findings and
rationales. The lead reviewer supports the team in achieving consensus, including – if necessary –
calling in an additional reviewer in case of scoring disagreement.
c. The team collaboratively identifies strengths and needs in materials, making notes for the final
report.
d. The team collaboratively determines eligibility for the seal.
e. The lead reviewer drafts the PRIME report.
Lead reviewer:
Date:
Directions: Once individual analyses and rating are complete, begin the team deliberation process. Use the
form on the next page to summarize consensus findings from the teams’ collaborative analysis of materials.
Highlight the most compelling evidence the team has found and offer criterion and indicator-based feedback,
noting strengths and weaknesses in alignment. This provides a rationale for how the team scores each criterion,
and for the team’s determination of the materials’ eligibility to receive the PRIME 2020 seal of alignment.
Match.ELD.2–5
Depth.ELD
Breadth.ELD
Match.KLU
Depth.KLU
Breadth.KLU
Depth.LE
Breadth.LE
Match.PLD
Depth.PLD
Breadth.PLD
6. Final report available for publication: The lead reviewer prepares the final report for publication.
For example, if a publisher submits a portfolio for review of grade 4 science materials, they may also submit
a rationale and evidence for why materials for grade 5 science maintain the same approach and structure
of alignment to the Framework as grade 4 science does. When a grade-level cluster is only comprised of
one grade (e.g., K or 1), materials for adjacent grades are not eligible for the extended review but must be
submitted as a separate portfolio.
After completing the portfolio for the initial course (e.g., grade 4 science), you may request an extended review
by following the steps below:
Match.ELD.1
Match.ELD.2–5
Depth.ELD
Breadth.ELD
Match.KLU
Depth.KLU
Breadth.KLU
Language Expectations
Match.LE
Depth.LE
Breadth.LE
Match.PLD
Depth.PLD
Breadth.PLD
5. Is there anything else you would like the review team to know about the adjacent materials?
Cook, H. G. (2006). Aligning English language proficiency tests to English language learning standards:
Assessing limited English proficiency students. State Collaborative on Assessment and Student Standards
(SCASS), Chief Council of State School Officers (CCSSO), Washington, DC
Cook, G. (2017). Alignment is in the eye of the beholder: Validity considerations. Annual Meeting of the National
Council on Measurement in Education (NCME), San Antonio, TX.
Estrada, P. (2014). English learner curricular streams in four middle schools: Triage in the trenches. The Urban
Review, 46(4), 535–573.
Gándara, P., Rumberger, R., Maxwell-Jolly, J., & Callahan, R. (2003). English learners in California schools:
Unequal resources, unequal outcomes. Education Policy Analysis Archives, 11, 36.
Lê, Q. T. N., & Polikoff, M. S. (2021). Do English language development curriculum materials matter for students’
English proficiency? SAGE Open, 11(3). https://doi.org/10.1177/21582440211035770
Loewus, L. (2016, May 11). Quality learning materials are scarce for English-language learners. Education Week.
https://www.edweek.org/teaching-learning/quality-learning-materials-are-scarce-for-english-language-
learners/2016/05
Mitchell, C. (2019, February 20). High-quality teaching materials for ELLs is goal of new initiative. Education
Week. https://www.edweek.org/teaching-learning/quality-learning-materials-are-scarce-for-english-
language-learners/2016/05
Porter, A., Smithson, J., Blank, R., & Zeidner, T. (2007). Alignment as a teacher variable. Applied Measurement in
Education, 20, 27–51.
Webb, N .L. (2007). Issues related to judging the alignment of curriculum standards and assessments. Applied
Measurement in Education, 20(1), 7–25.
Reviewers
Elizabeth Warren, State Relations Specialist, Consortium and State Relations
Alissa Metzler, State Relations Specialist, Consortium and State Relations
Jennifer Wilfrid, Researcher, Educator Learning, Research, and Practice
Margo Gottlieb, WIDA Co-Founder
Marketing
Selena Franklin, Specialist, Communications and Marketing
External Contributors
Consultants
Allison Audet, Transformative Learning Collaborative
Paula Merchant, Transformative Learning Collaborative
Reviewers
Kelly Cooney, Consultant
Gwyneth Dean-Fastnacht, WCEPS Consultant
Amy King, Assistant Director of Educator Engagement, WCEPS
Maria Puga, English Learner Program Coordinator, Idaho State Department of Education
Veronica Sala, Multilingual Learner Specialist, Rhode Island Department of Education
Yvonne Williams, Director of MLL Educator Engagement, WCEPS
We would also like to thank all the publishers who generously offered their time by participating in focus
groups and submitting feedback.