DTC 101 Assessment Inventory

Working Lunch
June 17, 2015

Assessment Inventory
Welcome
- Comments from Achieve
- DOE Release of Inventory

Status
- Questions
- Discussion

DTC 101 Face-to-Face

June 17, 2015

WELCOME
Please sign in and pick up your
district/school materials

Section 1

WRAP-UP FOR
DESSA 2014-2015

Section 2

SMARTER BALANCED
ADMINISTRATION
VISITS

Smarter Assessments Administered

Spring 2015
Grade

ELA CAT

ELA PT

MATH CAT

MATH PT

10,218

10,166

10,253

10,247

9,890

9,942

9,984

9,982

9,923

9,969

10,021

9,956

10,003

9,959

10,095

10,054

9,728

9,698

9,794

9,735

9,574

9,472

9,553

9,509

11

7,609

7,446

7,668

7,524

Total

66,945

66,652

67,368

67,007

Smarter Balanced Observations

May 2015
22 visits 12 districts and 4 charter
schools
8 visits in New Castle County
8 visits in Kent County
6 visits in Sussex County
Simple protocol for the first year

Smarter Balanced Observations

May 2015
Goals of observation protocol
Completion time for CAT, Classroom Activity,
and Performance Task
Observe the testing environment
Observe the security of the material before and
after testing
Gather information about the extent of technical
issues when dealing with accommodations
Gather information to help with the second
phase of the monitoring plan
9

Smarter Balanced Monitoring

2015-16 SY
Purpose is to ensure the testing procedures are implemented
as outlined in the documentation posted on the DE portal
Monitoring protocol release in Fall 2015 with additional details
Potential Areas of Monitoring:
Administration of DeSSA assessments (Smarter, DCAS, and
national tests)
Security and training
Schedules
Electronic device policy
Student participation
Accommodations provided/administered
Interviews with administration, teachers, and students

10

Section 3

SMARTER BALANCED
EDUCATOR SURVEY

Survey Summary
As of June 15, 2015, 341 educators answered the
survey. The survey asked questions and allowed the
educators to give comments
The Office of Assessment will use this feedback to
improve next years testing administration for Smarter
tests for all the categories mentioned above.
The other tests under DCAS were not surveyed as no
new tests were administered.

12

What is your role in the administration of the Smarter

tests? Select all that apply.

Test
Administrator
Grades 3-5
Test
Administrator
Grades 6-8
Test
Administrator
Grades 11
School Test
Coordinator
District Test
Coordinator

Which test were you responsible for

administering? Select all that apply.

Which of these statements apply to the Smarter Test

Administration materials/resources? Select all that apply.

The Smarter TAM and Portal resources

provided necessary information to
administer the test

The Smarter TAM and Portal resources

were easily accessible

The online training was clear and

appropriate

The material was available on time

How helpful was the AIR Help Desk? Select all that
apply.

Questions and concerns were

addressed in a timely manner

The Help Desk staff was

knowledgeable

Which of these statements apply regarding the test

administration? Select all that apply.

The suggested testing time for Math

was about right (if not, please
comment below)

The suggested testing time for

ELA/Literacy was about right (if
not, please comment below)

The scripts/materials were clear and

give all necessary information

I had no problems with the testing

administration

Which of these statements apply regarding technology

conditions for Smarter tests? Select all that apply.

Computer issues were resolved in

a timely manner

Supported tools were functional

(highlighting, calculator and other
tools available through the secure
browser

Accommodations supports were

functional

I had no technology issues

Section 4

TECHNICAL ISSUES

Technical Issues Spring 2015

Accommodations
Accommodations Functionality
TTS Stimuli on Performance Tasks
TTS for Spanish portion of Stacked
Spanish/English

Assessment Accommodations and TIDE

match issues
Grade 4 Math PT Stacked
Speech to Text
20

Technical Issues Spring 2015

Trained User Flag (early in window)
Custom/Standard Indicator
Item Counter

21

Changes for 2015-16

Training in Schoolology instead of
Blackboard
Shorter wait for access after registration,
completion

TA Interface has been redesigned

More user friendly selection of tests for test
session
Cleaner look

New Help Ticket System to Replace ARS

Simplify Accommodation Codes
22

Menu for Selection of Test

23

Menu for Selection of Test

24

Confirmation of Summative Selection

25

DSARA v1.2
Delaware Student Assessment Reporting
& Analysis
Current version of DSARA
Social Studies and Science data released
into this system

26

DSARA v2015
To be released with Smarter ELA/Math scores
Also includes SAT, PSAT, DCAS, DSTP scores
Individual reports can include one of the above
tests or ALL of a students tested history
Easily manipulated changes to graphs, reports
All reports downloadable
Class/Cohort reports
Includes Homeroom and Counselor watch
lists
27

TIDE STUDENTS 2015-16

DTC role and STC role will have access to
edit most accommodations directly
DOE will retain edit access to a small number
of accommodations
No waiting overnight for changes to take
effect
Assessment Accommodations Application
ceases to exist
TIDE students reporting capability increased
28

Section 5

SCHOOL REPORTS/
INTERPRETIVE GUIDE

29

Family Score Reports

30

Family Score Reports

31

Interpretive Guide
Will support parents in understanding the
information in the family report
Available online on the portal

32

Section 6

PARTICIPATION AND RESULTS

33

State Summary and Accountability

Participation rules
Results
Performance levels
Scale scores

Definitions

34

Section 7

TEST SECURITY

35

Definitions for Test Security Incidents

36

Definitions for Test Security Incidents

37

Definitions for Test Security Incidents

38

2015 Test Security Incidents

Incident Type
Cheating
Cellphone
Classroom Activity
Classroom Notes
Incorrect Testing Session
Student Disruption
Advantage Given by TA
Computer Usage
Component V Incidents
Calculator Usage
Other

Impropriety Irregularity Breach

3
33
6
3
3
2
0
4
0
1
6

13
4
3
0
0
0
3
1
3
3
3

0
0
0
0
0
0
0
1
0
0
0

39

2015 Test Security Incidents by Type

40
35
30
25
20
15
10
5
0

Breach
Irregularity
Impropriety

40

2015 Test Security Incidents

Incident Type
Cheating
Cellphone
Classroom Activity
Classroom Notes
Incorrect Testing Session
Student Disruption
Advantage Given by TA
Computer Usage
Component V Incidents
Calculator Usage
Other
Total

Impropriety Irregularity Breach

3
33
6
3
3
2
0
4
0
1
6
61

13
4
3
0
0
0
3
1
3
3
3
33

0
0
0
0
0
0
0
1
0
0
0
1

Number of
Incidents
16
37
9
3
3
2
3
6
3
4
9
95

41

Test Security Manual

Update Summer 2015
Manual
Training

Finalize by August 15, 2015

Face-to-Face DTC Training
Videotape for training Purposes

42

Section 8

LOOKING AHEAD

43

5-Year Plan

44

2015/2016 School Year DeSSA Calendar

45

Communications

e-Newsletters
DTC Weekly Webinar/Conference Calls
DTC Weekly One-on-One Contacts
Face-to-Face DTC Sessions

46

Section 9

WRAP-UP AND EXIT TICKET

47

Wrap Up
Plus/Delta feedback

48