2020 21 Pretest Workshop Session 3 Managing Testing

2020– 21 Pretest Workshop Session 3: Managing Testing and Reporting

Welcome bit. ly/Pretest. Three 011221 2

Learning Goals By the end of training today, participants will understand the following: – Test scheduling – Test administration guidelines – Test security – Monitoring testing – Reporting 2020– 21 Pretest Workshop: Session Three 3

Success Criteria Participants will be able to do the following: – Plan for the administration of CAASPP and ELPAC testing in the local educational agency (LEA) – Monitor test administration and test security – Access results reporting 2020– 21 Pretest Workshop: Session Three 4

Overview of CAASPP and ELPAC Assessments 2020– 21 Pretest Workshop: Session Three 5

Test Administration Window Test Start date California Assessment of Student Performance and Progress (CAASPP) (Smarter Balanced, California Science Test [CAST], California Alternate Assessments [CAAs] for English language arts/literacy [ELA] and Mathematics) Minimum of 66 percent of Minimum of 25 the instructional calendar instructional days after days completed testing window opens (February 22, 2021 for Smarter Balanced) CAA for Science September 8, 2020 California Spanish Assessment (CSA) Minimum of 66 percent of Last instructional day or the instructional calendar July 15, 2021 days completed Initial English Language Proficiency Assessments for California (ELPAC) July 1, 2020 June 30, 2021 Summative ELPAC February 1, 2021 May 31, 2021 2020– 21 Pretest Workshop: Session Three End Date Last instructional day or July 15, 2021 6

Remote Testing and Physical Distancing Guidance 7

Test Administration Options § Recommended: In-person or co-located administration § Remote computer-based administration § Remote paper-pencil administration § Educators website – http: //bit. ly/spring_21 educators § Parents/Guardians website – https: //bit. ly/spring_21 2020– 21 Pretest Workshop: Session Three 8

Smarter Balanced Average Testing Times Content Area ELA Computer Adaptive Test (CAT) Questions Hours: Minutes Grades Short Form 3– 5 0: 45 Performance Task Total (PT) Hours: Minutes 2: 00 2: 45 ELA 6– 8 0: 45 2: 00 2: 45 ELA 11 1: 00 2: 00 3: 00 Mathematics 3– 5 0: 45 1: 00 1: 45 Mathematics 6– 8 1: 00 2: 00 Mathematics 11 1: 00 1: 30 2: 30 Both 3– 5 1: 30 3: 00 4: 30 Both 6– 8 1: 45 3: 00 4: 45 Both 11 2: 00 3: 30 5: 30 2020– 21 Pretest Workshop: Session Three 9

Other CAASPP Tests Average Testing Times Content Area CAA for ELA CAA for Mathematics CAA for Science CAST CSA Grade Levels or Estimated Testing Time Grade Spans Hours: Minutes 3– 8 and 11 1: 00 to 1: 40 Total Testing Time Hours: Minutes 1: 00 to 1: 40 3– 8 and 11 1: 00 to 1: 40 5, 8, and once in high school 3 -8 and 11 1: 00 to 1: 40 per PT, 4 PTs total 4: 00 to 6: 40 1: 00 to 2: 00 2020– 21 Pretest Workshop: Session Three 10

Summative ELPAC Average Testing Times Content Area Summative ELPAC Grade Levels or Estimated Testing Total Testing Time Grade Spans Time Hours: Minutes Kindergarten 0: 50 to 1: 20 Summative ELPAC 1 1: 10 to 1: 40 Summative ELPAC 2 1: 10 to 1: 40 Summative ELPAC 3– 5 1: 50 to 3: 00 Summative ELPAC 6– 8 1: 50 to 3: 00 Summative ELPAC 9– 10 11– 12 2: 05 to 3: 10 2020– 21 Pretest Workshop: Session Three 11

Testing Schedules 2020– 21 Pretest Workshop: Session Three 12

Scheduling Testing § Recommend taking a practice or training test with students first using a web-based student testing interface § Recommend taking the entire testing window § Schedule in-person testing sessions and remote testing session in separate testing sessions § Recommend no more than 20 students during a remote testing session 13

Monitoring Remote Testing (1) Computer-based Administration § No limit but start small § Factors to consider: – Technology readiness – Preparedness – One test administrator or test examiner per remote test session – Grade level of students – Multiple grades levels and tests in test session 2020– 21 Pretest Workshop: Session Three 14

Summative ELPAC K− 2 Writing Process (1) § The LEA provides nonsecure answer sheets to students using – a student or parent portal, – email, – Parent/Guardian pickup, or – noncertified, standard mail. § The test examiner displays the Answer Book with response options via screenshare software. 15

Summative ELPAC K− 2 Writing Process (2) § The student shares the response with the test examiner via webcam. § The test examiner transcribes verbatim student response into answer book. § The student returns the answer sheet to the school. 16

Benefits to Process § Benefits – Blank answer sheets are nonsecure, allowing for multiple and flexible ways to provide them to students – Minimal mailing costs – Minimizes follow-up for nonreturned books 17

Providing SSIDs to Students § Use parent and student portal § Pick up at school with other materials § Mail home to parents and guardians § Direct message to student § Provide during a one-on-one meeting with the student § Provide verbally § Email not considered a secure distribution method 18

Processing Time 2020– 21 Pretest Workshop: Session Three 19

Test Administration 20

CALPADS and Testing 2020– 21 Pretest Workshop: Session Three 21

Online Manuals 2020– 21 Pretest Workshop: Session Three 22

CAASPP Directions for Administration (DFAs) Nonsecure CAASPP DFAs 2020– 21 Pretest Workshop: Session Three 23

CAA Forms Assignments CAAs for ELA and mathematics CAA for Science 2020– 21 Pretest Workshop: Session Three 24

CAA DFAs in TOMS The DFA contains test content and must be kept secure at all times. Download and use this document only to prepare for and administer the CAA assessment, and securely destroy as soon as administration is complete. 2020– 21 Pretest Workshop: Session Three 25

DFA—Alternative Text Alternative text describes images for students with visual impairments. 2020– 21 Pretest Workshop: Session Three 26

Cues and Wait Times Guidelines for establishing whether a student responds or orients to the task: § The student should be allowed a reasonable amount of time for a verbal response or for a motor response. § Wait times are approximate; you know your student and the appropriate time for a response. § Directions may be repeated if necessary. 2020– 21 Pretest Workshop: Session Three 27

Possible Response Modes § Independent use of mouse, touchscreen, or computer keyboard § Verbal response § Gestures § Pointing independently to indicate a response § Augmentative and Alternative Communication devices § Eye gaze § Other 2020– 21 Pretest Workshop: Session Three 28

Student Response Check (SRC) — For ELA and Mathematics Only Purpose: To confirm that the student has a consistent and observable way to indicate responses to test items and can orient to the task 2020– 21 Pretest Workshop: Session Three 29

ELPAC Forms Assignments Download DFAs corresponding to your LEA’s forms assignment. 2020– 21 Pretest Workshop: Session Three 30

ELPAC DFAs in TOMS 2020– 21 Pretest Workshop: Session Three 31

After Testing—DFAs 2020– 21 Pretest Workshop: Session Three 32

Checklists 2020– 21 Pretest Workshop: Session Three 33

Processing Time (2) 2020– 21 Pretest Workshop: Session Three 34

Test Security 35

Secure Materials Tests CAASPP Secure Materials List CAA DFAs ELPAC Kindergarten through grade two Writing Answer Books Kindergarten through grade twelve Summative ELPAC DFAs All DFAs CAASPP and Scratch paper ELPAC Student logon information Special forms (braille, large-print, etc. ) Paper–pencil tests 2020– 21 Pretest Workshop: Session Three 36

Security and Test Administration Incident Reporting System (STAIRS) in TOMS 2020– 21 Pretest Workshop: Session Three 37

Appeals in TOMS 2020– 21 Pretest Workshop: Session Three 38

STAIRS Video Tutorial 2020– 21 Pretest Workshop: Session Three 39

Test Security Incidents There are three types of test security incidents: 1. Impropriety 2. Irregularity 3. Breach 2020– 21 Pretest Workshop: Session Three 40

Test Impropriety Low Impact 2020– 21 Pretest Workshop: Session Three 41

Test Irregularity 2020– 21 Pretest Workshop: Session Three 42

Test Breach Threatens test validity (e. g. , release of secure materials) Has external implications for the Consortium and other statewide assessments 2020– 21 Pretest Workshop: Session Three Must be reported to the LEA CAASPP or ELPAC coordinator or the test site coordinator 43

Remote Testing Considerations 2020– 21 Pretest Workshop: Session Three 44

Item Security and Information Bar A barcode at the top of the testing web page can be decoded and tracked if an image of the student’s screen is posted to social media or online. 2020– 21 Pretest Workshop: Session Three 45

Item Security Incident Types and Examples Incident Type Example Test Impropriety Students talking during testing Test Irregularity Students cheating or providing answers to one another Test Irregularity Student accessing or using electronic equipment (e. g. , cell phone) Test Breach Test administrator (TA), test examiner (TE), or test site coordinator modifying student responses or records at any time Test Breach TA or TE allowing students to take home test questions, passages, prompts, or scratch paper 2020– 21 Pretest Workshop: Session Three 46

Test Security Resources § Security Incidents and Appeals Procedure Guide – Information on incident types – Tips for how to avoid security issues – Detailed STAIRS/Appeals instructions § Test Security Site Visits Audit Questionnaire 2020– 21 Pretest Workshop: Session Three 47

Test Security Incident Chart Level of Severity and Potential Effect on Test Security Types of Issues LOW— Impropriety A test expiring before the student could complete the test or the student accidentally submitting a test before completion MEDIUM— Irregularity Student(s) cheating or providing answers to each other, including passing notes, giving help to other students during testing, or using hand-held electronic devices to exchange information MEDIUM— Irregularity Student(s) accessing the internet or any unauthorized software or applications 48 during a testing event

Monitoring of Crisis Papers (1) § Readers § Automated flagging process § Alert notification letters 2020– 21 Pretest Workshop: Session Three 49

Monitoring of Crisis Papers (2) 2020– 21 Pretest Workshop: Session Three 50

Processing Time (3) 2020– 21 Pretest Workshop: Session Three 51

Monitoring 52

TOMS At-a-Glance Screen— CAASPP 2020– 21 Pretest Workshop: Session Three 53

TOMS At-a-Glance Screen— ELPAC 2020– 21 Pretest Workshop: Session Three 54

Completion Status Reports Provide LEAs and sites with completion rates and detailed information regarding student progress 2020– 21 Pretest Workshop: Session Three 55

Reports in TOMS 2020– 21 Pretest Workshop: Session Three 56

Processing Time (4) 2020– 21 Pretest Workshop: Session Three 57

Reporting 58

Student Score Reports (SSR) 2020– 21 Pretest Workshop: Session Three 59

Smarter Balanced Adjusted Form: SSRs 2020– 21 Pretest Workshop: Session Three 60

Lexile and Quantile Reports 2020– 21 Pretest Workshop: Session Three 61

Video SSRs ELPAC Video Student Score Reports Webcast § February 24, 2021 § 1– 2 p. m. 2020– 21 Pretest Workshop: Session Three 62

Electronic SSR Credentialing 2020– 21 Pretest Workshop: Session Three 63

California Educator Reporting System (CERS) 2020– 21 Pretest Workshop: Session Three 64

Public Web Reporting Aggregate results from all CAASPP and ELPAC tests are publicly reported following the scoring and validation. 2020– 21 Pretest Workshop: Session Three 65

CERS 66

Timeline for CERS Historical results Cancellatio n of state testing 2020– 21 Pretest Workshop: Session Three Weekly results 67

Viewing Reports in CERS 2020– 21 Pretest Workshop: Session Three 68

CERS Rostering 2020– 21 Pretest Workshop: Session Three 69

Processing Time (5) 2020– 21 Pretest Workshop: Session Three 70

Conclusion and Questions 2020– 21 Pretest Workshop: Session Three 71

Follow us on Twitter! @CDEAssessments 2020– 21 Pretest Workshop: Session Three 72

Pretest Workshop Session Three 2020– 21 Pretest Workshop: Session Three 73