K12 Student Assessment Scoring and Reporting Dr Qian

K-12 Student Assessment Scoring and Reporting Dr. Qian Liu Gabriel Colorado Annual District Assessment and Accountability Coordinators Meeting www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved.

Why no reported score for ELA? Score Status Flag • Each test record in the data file has a score status flag. If a score is not reported, the score status flag defines the reason why the score wasn’t reported. Only the score for the test records that were assigned with score flag of 1 (regular report) or 9 (late reporting) are reported. • The score status flag can be found in the DSR file and school report of students. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 2

Score Status Flag • The DSR file layout provides the definition of each score flag. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 3

Score Status Flag (ELA) • There are three score flags in the DSR file for ELA: one for Reading component test record, one for Writing component test record and one for ELA score. • The ELA score flag is derived from the Reading and Writing score status flags. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 4

Score Status Flag (ELA) Writing Reading ELA Score Status Flag – ELA Score Flag Report Status 1 1 9 9 RS 9 1 9 Report Score 9 9 9 0, 1, 3, 4, 5, 6, 7, 2, 3, 4, 5, 6, 7, 8 0 8, 9 NR 0, 1, 2, 3, 4, 5, 6, 7, Not Reported 3, 4, 5, 6, 7, 8 8, 9 0 NT 0 0 0 Not Tested * All pending ELA records (i. e. , Writing or Reading records that cannot be merged with the other component test) will get a score flag of 0. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 5

Score Status Flag on report (EOC and Mathematics) • The following abbreviations may appear in the scale score column of the PDF version of the school report of students: NR 2, NR 3, NR 5, NR 6, NR 7 and NR 8. • NR (Not Reported) indicates that no score information are reported for the student and the code explains why the score is not reported. The footnote on the bottom of the report provids the definition of each score flag. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 6

Score Status Flag on report (EOC and Mathematics) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 7

Score Status Flag on report (ELA) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 8

Score Status Flag on report (ELA) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 9

Why students pass Algebra 1/Geometry with level 2 ? Alternative Passing Score (APS) • The State Board of Education adopted the Commissioner’s proposed score scales for the Florida Standards Assessments (FSA) on January 6, 2016. The board also approved alternate passing scores for the Grade 10 ELA, Algebra 1, and Geometry FSA assessments based on linking the scores to the spring 2014 FCAT 2. 0/NGSSS scores, as required in statute. • The following table summarizes eligibility requirements and passing/alternate passing scores for these assessments: Assessment Eligibility Passing Score (FSA scale) Grade 10 FSA ELA Entered Grade 9 in 2014 -15 or after 350 (Level 3) FSA Algebra 1 First participated in Spring 2016 or beyond 497 (Level 3) FSA Geometry First participated in Spring 2016 or beyond 499 (Level 3) Grade 10 FSA ELA Entered Grade 9 in 2013 -14 or prior or/and took test prior to Spring 2016 349 (Level 2) FSA Algebra 1 First participated prior to Spring 2016 489 (Level 2) FSA Geometry First participated prior to Spring 2016 492 (Level 2) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 10

APS flag • ELA Retake: Districts flag the students who are eligible to use APS based on student cohort and provide this information to vendor via Pre. ID upload. • Algebra 1/Geometry: The Department works with vendor using the test history to identify the students who are eligible for APS. • The APS flag is included in the DSR file and displayed on the School Report of Students. • The APS flag may be updated during the late reporting, if it’s needed. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 11

Performance Level and Passing Status • The passing status is determined by the students’ scale score and APS eligibility (APS vs. regular passing score). The performance level is also determined by the scale score and the cut score for each performance level is the same for all students who take the same test. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 12

FSA Achievement Level cut scores established on January 6, 2016 www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 13

Why ELA subcategory score for Writing is 0? Writing Condition Codes, Dimension Score and Score Status Flag www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 14

• In addition to responses that receive the scores described in the rubric for each domain, some responses earn a score of “ 0” due to certain conditions as follows: Foreign Language Essay: The entire response is written in a language other than English. 2) Illegible, Insufficient, Incomprehensible or Copied Essay: The response is illegible, is incomprehensible, includes an insufficient amount of writing to be evaluated, or is completely copied from the source material with no original work. 3) Off-topic Essay: The response is completely off topic, and the Conventions domain is scored; this condition could result in a score of 0, 1, or 2 points. 1) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 15

• Blank Essay -- If the student response was totally blank, the student cannot receive a valid ELA score because he/she did not attempt the Writing portion of the ELA assessment. • Currently, there are 4 Writing condition codes: A -- blank essay (BL); B -- illegible, incomprehensible, insufficient or copied essay (IL); C -- off-topic essay (OT) and D -- foreign language essay (FL). • Starting from Spring 2017, insufficient essay and copied essay will have a stand-alone condition code. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 16

Updates for 2016 -17 Removing the S 3/Demographic fields in the SSR and SAR files • No demographic DSR and DAR files will be posted to the vendor’s reporting system. Instead, use the Department BI system to view and download the demographic results. Adding the FLEID to the file layouts • This field is optional in the Fall, Winter 2016 and Spring 2016, then becomes the required and sole identifier of each student in the Summer 2017. Adding the Test Accommodation listed on the IEP and 504 to the SSR layout Removing the 100% passing/Failing suppression from SAR file and aggregation reports www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 17

Updates on the 2016 -17 --- Pearson Student Report • One printed student report will be shipped to the districts and the districts will distribute these reports to schools. • The electronic copy of student reports will be posted to the Pearson. Access Next (PANext) for districts and schools. The additional student report may be printed, if needed. • The shipment detail is available on PANext to accompany the shipment of student reports. The shipment detail contains route codes and the number of boxes per school to assist with district’s distribution efforts. • The school memos will be included in the student report shipment along with the packaging list. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 18

Updates on the 2016 -17 --- Pearson Educator Reports • In addition to the PDF reports, Pearson will also provide the excel version for all educator reports, including the State Summary, District Summary, State Report of Districts, District Report of Schools and School Report of Students. Both PDF and excel formats will be posted to the PANext starting from Fall 2016. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 19

Pre. ID Schedule Fall 2016 - Spring 2017 FSA and NGSSS www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 20

Fall 2016 FSA Open Close EOC 8/17 9/23 ELA Retake 9/14 10/28 Labels Test Materials TAMs On-Demand Additional Order (TIDE) NGSSS Open Close Labels Test Materials TAMs EOC 8/5 9/22 Reading Retake 9/2 10/20 No Labels (Hand Grid Only) Additional Order (Pearson. Access) Enrollment Counts (7/11– 7/22) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 21

Winter 2016 FSA EOC Open Close Labels Test Materials TAMs 10/26 12/16 On-Demand Additional Order (TIDE) NGSSS EOC Open Close Labels Test Materials TAMs 10/31 12/16 No Labels (Hand Grid Only) Additional Order (Pearson. Access) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 22

Spring 2017 FSA Open Close Labels Test Materials TAMs ELA/Math 11/21 5/12 By 12/9 EOC 1/25 5/12 By 2/10 Enrollment Counts (submitted by DOE with Survey 6 Data) NGSSS Open Close Labels Test Materials EOC 2/27 5/19 By 3/10 Science 3/6 3/17 By 3/17 Retakes 2/27 4/7 On-Demand Additional Order www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. TAMs Enrollment Counts (12/5– 12/16) 23

New Pre. ID Field: FLEID • Optional to start • Fall 2016, Winter 2016 and Spring 2017 • Required starting Summer 2017 • 14 characters • FL followed by 12 Digits (FL######) www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 24

FLEID and Other ID Fields for 16 -17 • Fall 2016, Winter 2016 and Spring 2017: • SID – Primary ID for Pre. ID upload, testing and reports • Alias – Optional, 10 Digits • FLEID – Optional, 14 Characters • Summer 2017: • FLEID – Primary ID for Pre. ID upload, testing and reports • Alias – Optional, 10 Digits www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 25

Assisting with Accountability • While optional for Fall 2016 through Spring 2017, including FLEID for as many records as possible will help in accountability matching. • Districts may want to consider including a student’s SID from Fall 2016 through Spring 2017 as the alias starting Summer 2017. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 26

New Pre. ID Field: Testing Accommodations on IEP/504 Plan • Required for all FSA students • Starting with Fall 2016 ELA Retake • Not required for Fall 2016 EOC, but please provide this for all students • Required for all NGSSS students with S 504/PES www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 27

New Pre. ID Field: Testing Accommodations on IEP/504 Plan • This field should be Y if a student is eligible for accommodations for the test/administration in question. • It does not matter if student ends up using or not. • You can update this field from N to Y (or vice versa) through the end of the Pre. ID window on TIDE/PANext. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 28

Changes to TIDE • View/Edit/Export Students • This tab will remain open after testing ends. • Any changes made after testing ends will not be reflected on files or reports. • Deleting Students • Districts and School CBT Coordinators can delete at any time. • Deleting is optional, not required. • If a student is deleted with a test record and not readded, results will be reported to last enrolled school. www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 29

Changes to NGSSS Pre. ID (SRI) Layout • No longer one row per student • One row for each test a student will take • Possible Test Indicators: • CIV, BIO 1, HIST, RTKALG 1, RTK 2 RDG • Science eligibility based on enrolled grade • Same layout structure for all of 16 -17 • Some fields may not be applicable for all admins • ex. APS (Reading Retake only) will be filler for Winter 2016 EOC www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 30

Contact Information K-12 Scoring and Reporting Team Qian Liu: 850 -245 -0867 Qian. Liu@fldoe. org Gabriel Colorado 850 -245 -0779 Gabriel. Colorado@fldoe. org Esra Kocyigit 850 -245 -0769 Esra. Kocyigit@fldoe. org Seung-Yeon Ha 850 -245 -0783 Seung-Yeon. Ha@fldoe. org www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 31

www. FLDOE. org © 2014, Florida Department of Education. All Rights Reserved. 32