Orientation for New District Assessment Coordinators DACs Bureau

Orientation for New District Assessment Coordinators (DACs) Bureau of K– 12 Student Assessment 2019– 2020 www. FLDOE. org 1

Overview • Organization Chart for Assessment at FDOE • K– 12 Assessments (Tests by Subject and Contractor) • Test Administration Schedule (Quarterly Administrations) • Basic Test Administration Processes • High-Level Yearly Schedule (Monthly Key Events) • Assessment Information • Resources • Glossary/Acronyms www. FLDOE. org 2

Org Chart: FDOE Assessment Leadership Florida Department of Education Richard Corcoran, Commissioner of Education Division of Accountability, Research, and Measurement (ARM) Juan Copa, ARM Director; Deputy Commissioner Office of Assessment Vince Verges, Director of Assessment; Assistant Deputy Commissioner Bureau of K– 12 Student Assessment Susie Lee, Bureau Chief K– 12 Program Areas: • Test Administration (K– 12) • Scoring and Reporting (K– 12) • Psychometrics (K– 12) • Test Development (K– 12) Bureau of Postsecondary Assessment Phil Canto, Bureau Chief Postsecondary Program Areas: • Test Administration • Scoring and Reporting • Psychometrics • Test Development + FSAA, NAEP, FLKRS, ACCESS for ELLs (see next slide) www. FLDOE. org 3

Bureau of K– 12 Student Assessment Susie Lee, Bureau Chief K– 12 Assessment Program Area Directors: • • Test Development Center – TBD Test Administration – Jenny Black Psychometrics – Salih Binici Scoring and Reporting – Qian Liu Other K– 12 Student Assessment Programs: • • NAEP: National Assessment of Educational Progress FSAA: Florida Standards Alternate Assessment FLKRS: Florida Kindergarten Readiness Screener ACCESS for ELLs: English language proficiency assessments for English Language Learners FDOE Assessment Contacts, Team Members: http: //www. fldoe. org/accountability/assessments/staff-members. stml www. FLDOE. org 4

K– 12 Assessments by Contractor and Subject Area • Renaissance, Inc. § FLKRS – Star Early Literacy Kindergarten readiness screener administered to all entering first-time kindergarten students in public schools within the first 30 school days of the school year • Pearson § Next Generation Sunshine State Standards (NGSSS) assessments o o Statewide Science EOCs: Civics, U. S. History, Biology 1 • American Institutes for Research (AIR) and Data Recognition Corporation (DRC) § Florida Standards Assessments (FSA) o o o English Language Arts (ELA) – Reading and Writing Mathematics EOCs: Algebra 1, Geometry www. FLDOE. org 5

K– 12 Assessments by Subject, Grade Level, and Mode (Computer or Paper) • Florida Kindergarten Readiness Screener (FLKRS) § Star Early Literacy – Kindergarten, Computer-Adaptive Screener (no paper version) • NGSSS assessments § Statewide Science (Grades 5 and 8), Paper-Based Test (PBT) § EOCs: Civics (Grade 7), U. S. History (HS), Biology 1 (MS or HS) o Computer-Based Tests (CBTs), paper accommodations • FSA § § ELA Reading (Gr. 3– 10); Gr. 3– 6 PBT; Gr. 7– 10 CBT, paper accommodations ELA Writing (Gr. 4– 10); Gr. 4– 6 PBT; Gr. 7– 10 CBT, paper accommodations Mathematics (Gr. 3– 8); Gr. 3– 6 PBT; Gr. 7– 8 CBT, paper accommodations EOCs: Algebra 1 (MS or HS), Geometry (MS or HS) o CBTs, paper accommodations www. FLDOE. org 6

K– 12 Assessments, Other Programs • Florida Standards Alternate Assessment (FSAA) – For students with significant cognitive disabilities for whom the FSA and NGSSS statewide assessments are not appropriate tests. § § Performance Task (FSAA-PT) – Measures student performance on Access Points in Language Arts, Mathematics, Science, Social Studies; PBT Datafolio (FSAA-Datafolio) – Designed for students without a formal mode of communication. Information on student work is collected three times a year and reported through an online system. www. FLDOE. org 7

K– 12 Assessments, Other Programs • ACCESS for ELLs – Measures English language proficiency for ELLs § § Based on the WIDA English Language Development Standards Paper-based in Florida • National Assessment of Educational Progress (NAEP) § § § Sample-based testing administered in grades 4, 8, and 12 Conducted periodically in select years Subjects include Mathematics, Reading, Writing, Science, Civics, Geography, Economics, the Arts, U. S. History, and Technology and Engineering Literacy www. FLDOE. org 8

Test Administration Schedule (FSA, NGSSS) • Testing Windows Opened Four Times per School Year § Spring § Fall o o § EOCs ELA Retake o o Winter o o o EOCs o § EOCs ELA (Reading, Writing) ELA Retake Mathematics Science Summer o EOCs http: //www. fldoe. org/accountability/assessments/k-12 -studentassessment/assessment-schedules. stml www. FLDOE. org 9

Test Administration Process Pre. ID Scores Released Receive Materials Return Materials Training Testing www. FLDOE. org 10

Test Administration Process (FSA, NGSSS) 1. Enroll/Register (Pre. ID) students into the online system (TIDE, Pearson. Access Next). § § For Fall, Winter, and Summer – order any PBT materials needed (additional order) For Spring – materials delivered based on Pre. ID o TIDE User Guide (FSA): https: //fsassessments. org/resources/userguides-and-manuals/ > TIDE User Guide o Pearson Access Next User Guide (NGSSS Assessments): https: //support. assessment. pearson. com/display/PAsup/Pearson. Ac cess+Next+Online+User+Guide 2. Materials are distributed to the district, and then the district sends to schools. § § Manuals + ancillaries (e. g. , work folders, planning sheets) Test Materials, including accommodated materials www. FLDOE. org 11

Test Administration Process (FSA, NGSSS) 3. Training § Each administration, train school coordinators, test administrators, and proctors 4. Testing § § Computer-Based Testing o FSA: Test Administrators start a session in the TA Interface and students sign into the Secure Browser, Test Delivery System with test tickets o NGSSS: Schools set up a session ahead of time in PA Next, and students sign into Test. Nav 8 with authorization tickets For Fall, Winter, and Summer – Schools may test anytime within the statewide window For Spring – FDOE will send more specific scheduling guidance for districts to test within the window. Calibration sample – Schools test earlier in the window to allow for equating and data needed for scoring www. FLDOE. org 12

Test Administration Process (FSA, NGSSS) 5. Return Materials § Schools return materials to the district, and the district ships to the appropriate contractor, or schools return directly to the contractor 6. Scores Released § No announcement ahead of time § Available online through FSA Reporting System and Pearson. Access Next § One paper copy of the individual student report is mailed to the district for each student 7. Score Inquiry Process § Any scores not released or questions about scores www. FLDOE. org 13

High-Level Yearly Schedule (Monthly Key Events) • August § § § Annual Meeting for District Assessment Coordinators hosted by FDOE/Assessment TIDE and PA Next open for Fall materials Pre. ID for Fall EOC and ELA Retake opens New software released for online testing Refresh of user guides • September § Fall EOC and ELA Retake testing • October § Uniform Assessment Calendar due www. FLDOE. org 14

High-Level Yearly Schedule (Monthly Key Events) • November § § Pre. ID for Winter EOC opens Winter EOC testing • December § Winter EOC testing • January § § § Refresh of user guides Pre. ID for Spring Writing, Reading, Math opens Pre. ID for Spring testing due (for receiving materials) www. FLDOE. org 15

High-Level Yearly Schedule (Monthly Key Events) • February § § Pre. ID for Spring testing due (for Pre. ID labels) Spring ELA Retake Testing o ELA Writing, ELA Reading, Algebra 1 EOC Retakes • March § Spring ELA Retake Testing o ELA Writing, ELA Reading, Algebra 1 EOC Retakes • April § § Grade 3 ELA Reading Testing ELA Writing Testing www. FLDOE. org 16

High-Level Yearly Schedule (Monthly Key Events) • May § § ELA Reading, Mathematics, and EOC Testing By May 31, Grade 3 and Retake scores reported • June § By June 30, all other scores reported • July § Summer EOC Testing www. FLDOE. org 17

FSA Mathematics Grade/Subject Session Length Number of Sessions* Delivery 3 4 5 6 7 8 Alg 1/Retake Geo 80 minutes 60 minutes 90 minutes 2 2 2 3 3 3 2 2 PBT PBT CBT CBT *All sessions administered over two days. For Grades 6– 8, Session 1 is on Day 1, Sessions 2 & 3 on Day 2. www. FLDOE. org 18

FSA English Language Arts – Writing Grade/Subject Session Length 4 5 6 7 8 9 10 120 minutes 120 minutes Retake 120 minutes – up to half a school day Number of Sessions 1 1 1 1 Delivery PBT PBT CBT CBT CBT Break at 60 minutes, districts may choose to allow schools to dismiss students after 90 minutes. www. FLDOE. org 19

FSA English Language Arts – Reading Grade/Subject Session Length 3 4 5 6 7 8 9 10 80 minutes 85 minutes 90 minutes – up to half a school day Retake Number of Sessions* Delivery 2 2 2 2 PBT PBT CBT CBT 2 CBT *All sessions administered over two days. www. FLDOE. org 20

Science Grade/Subject Session Length Number of Sessions Delivery 5 8 80 minutes 2 2 PBT • Grade 5 Science is administered over two days. • Grade 8 Science is administered in one day. www. FLDOE. org 21

Fall FSA ELA Retake ELA Writing should be administered before ELA Reading Session 1 of ELA Reading MUST be completed before Session 2 Students MUST complete ELA Reading sessions over two days ELA Writing – One 120 -minute session ELA Reading – Two 90 -minute sessions (over two days) Students may work up to the length of half of a typical school day, if needed, for all ELA Retake sessions • Students are required to participate in all three sessions to receive an ELA Retake score (previous component scores are not used) • • • www. FLDOE. org 22

EOCs • FSA Algebra 1 and Geometry • Two 90 -minute sessions administered over 2 days • Students may have up to half a typical school day to complete each session • Calculators allowed for Session 2 • NGSSS Biology 1, Civics, and U. S. History • One 160 -minute session • Students may have up to the length of a typical school day to complete each session • Schools may schedule CBT tests as needed; PBT accommodations should be completed by established pickup dates. www. FLDOE. org 23

Spring ELA Writing • Grades 4– 6 FSA ELA Writing will be administered on paper • Grades 7– 10/Retake ELA Writing will be administered on computer • ELA Writing Sessions are 120 minutes • Retake may have up to half a typical school day • Writing Makeup Window • No makeup for Retake • One week at the end of the Reading window www. FLDOE. org 24

Grades 6– 8 Mathematics • Grades 6– 8 Mathematics Two-Day Administration • Session 1 must be scheduled on Day 1 • Sessions 2 and 3 must be scheduled on Day 2 • TAs must understand be familiar with the break between Sessions 2 and 3 (short or extended) and scripts • For Grades 7 and 8 only, an online calculator is provided in TDS for Sessions 2 and 3 ONLY (Day 2) • Approved handheld calculators may be provided for CBT students • Approved handheld calculators MUST be provided for PBT students (accommodations) • Students with an extended time accommodation may test over three days (one session per day) www. FLDOE. org 25

Resources • Statewide Assessment Program Information Guide § The Statewide Assessment Program Information Guide provides information about the FSA and NGSSS Assessments, including the considerations governing item and test development, the mechanics of item and test scoring, and the meaning of the different assessment scores. http: //www. fldoe. org/core/fileparse. php/5663/urlt/swapig. pdf • Test Administration Manuals (TAMs) § § § Produced for each testing window’s assessments, TAMs provide essential instructions for school test administrators and school/district assessment coordinators to meet all test administration requirements. FSA manuals (AIR): https: //fsassessments. org/resources/user-guidesand-manuals/ NGSSS manuals (Pearson): http: //florida. pearsonaccessnext. com/resources-training/ www. FLDOE. org 26

Resources • FDOE Assessment Webpage: § http: //www. fldoe. org/accountability/assessments/ • User Guides § § § User guides provide users with instructions for navigating and operating the online testing systems for FSA and NGSSS administrations. FSA User Guide Matrix – a matrix to indicate which users should read what guides: https: //FSAssessments. org/resources/user-guides-andmanuals/ FSA User Guides: https: //FSAssessments. org/resources/user-guides-andmanuals/ NGSSS Pearson. Access Next User Guide: http: //florida. pearsonaccessnext. com/resources-training/ Test. Nav 8 online user guide: https: //support. assessment. pearson. com/display/FL/Test. Nav+8++Florida www. FLDOE. org 27

Resources • Online Systems § Test Information Distribution Engine (TIDE) o For managing and monitoring students taking FSA assessments https: //FSAssessments. org/ > TIDE FSA Test Administration (on FSA Portal) o https: //FSAssessments. org/users/test-administration. stml § Pearson. Access Next o For managing and monitoring students taking NGSSS assessments http: //fl. pearsonaccessnext. com § Test. Nav 8 o Test delivery system for NGSSS assessments § https: //support. assessment. pearson. com/display/FL/Test. Nav+8+-+Florida § Comprehensive Online Resources o o o FSA Assessments (FSA Portal): https: //FSAssessments. org/ NGSSS Assessments: http: //florida. pearsonaccessnext. com/ Florida Resource Center: http: //florida. pearsonaccessnext. com/resources-training/ www. FLDOE. org 28

Resources • Monthly Assessment Calls § § § Conducted on the 4 th Tuesday of each month Prior to the call, DACs are emailed the monthly call agenda, with the call number and log-in information for the Web. Ex session Follow-up notes emailed to DACs, with included presentations • Monthly Summary § § § Emailed to district assessment contacts monthly Includes recap of key communications/events for the month All emails from FDOE/Assessment for the month are compiled and attached or posted on Share. File: https: //fldoe. sharefile. com/ o o File path: K-12 Administration > Communications > Monthly Emails DACs are set up with Share. File accounts by the FDOE Assessment group (notification for activation by email). www. FLDOE. org 29

Resources • K– 12 Test Administration Team – 850 -245 -0513 § § § § § Susie Lee, Bureau Chief, susan. lee@fldoe. org Jenny Black, Director, jenny. black@fldoe. org Marilyn Bemis, Program Specialist (CBT), marilyn. bemis@fldoe. org Robert Bowman, Program Specialist (Manuals), robert. bowman@fldoe. org Josh Kendrick, Program Specialist (CBT), joshua. kendrick@fldoe. org Becky Stephens, Editor (Manuals), rebecca. stephens@fldoe. org Kath Visconti, Program Specialist (Accommodations), kath. visconti@fldoe. org Teri Williams, Program Specialist (PBT), teri. williams@fldoe. org DAC Colleagues (DAC list available from K– 12 Administration) www. FLDOE. org 30

Glossary/Acronyms • Tests § § § § § ACCESS for ELLs – Assessing Comprehension and Communication in English State-to-State for English Language Learners CBT – Computer-Based Test ELA – English Language Arts EOC – End-of-Course (Assessment) FLKRS – Florida Kindergarten Readiness Screener FSA – Florida Standards Assessments FSAA – Florida Standards Alternate Assessment NAEP – National Assessment of Educational Progress NGSSS – Next Generation Sunshine State Standards PBT – Paper-Based Test www. FLDOE. org 31

Glossary/Acronyms • Test Administration § SWD – Students with Disabilities DAC – District Assessment Coordinator § TA – Test Administrator § DID – Due in District § § ELL – English Language Learner TAM – Test Administration Manual § FLEID – Florida Education Identifier § TDS – Test Delivery System § IEP – Individual Education Plan § § PA Next – Pearson. Access Next (also PAN) TIDE – Test Information Distribution Engine § APS – Alternate Passing Score § AVA – Assessment Viewing Application § www. FLDOE. org 32

Glossary/Acronyms • Scoring and Reporting § § § § § DAR – District Aggregated Results DRS – District Report of Schools DS – District Summary DSR – District Student Results ISR – Individual Student Report SAR – State Aggregated Results SRD – State Report of Districts SRS – School Report of Students SS – State Summary SSR – State Student Results www. FLDOE. org 33