National Assessment of Educational Progress NAEP and International

National Assessment of Educational Progress (NAEP) and International Assessments Annual Statewide Assessment and Accountability Meeting August 29, 2018 www. FLDOE. org 1

Florida NAEP 2017 Results in the Headlines Education Week: On NAEP, What's Flo rida Doing That Other Stat es Could L earn From? Orlando Se nti report card nel: Nation's : ‘Somethi ng very good is ha ppening in Florida’ Gov. Scott : Florida St udents Lead the N ation in Re ading and Mathe matics The 74: Flo rida Reform s Paying Off, De. Vos Says, Citin g Otherwis Dismal NA e EP Results a t ‘Nation a Risk’ Summ t it www. FLDOE. org CBS Miam i: Florida S tud Shine In N ew ‘Nation ents ’s Report Car d’ 2

2017 Nation’s Report Card: Florida Students Lead the Nation www. FLDOE. org 3

Florida NAEP Results Over Time www. FLDOE. org 4

Continue Momentum Even Better 2019 Results Great 2017 Results State-level NAEP is conducted every other year. Next Florida NAEP reading and mathematics results will be available after the 2019 administration. www. FLDOE. org 5

Schools that participate in NAEP help answer these questions: ü NAEP is considered the gold standard in educational assessments. ü NAEP data helps inform national and state education policy for current and future students. ü NAEP is the only assessment that measures student progress across states. www. FLDOE. org 6

NAEP 2019 Program (January 28 to March 8, 2019) Grade Subject Mathematics (Pilot) Grades 4 and 8 Reading (Pilot) Science Mathematics Grade 12 Reading Science Format Tablet √ √ √ √ Results Paper/Pencil √ √ National, State, TUDA N/A National TUDA: Trial Urban District Assessment (FL TUDA districts: Duval, Hillsborough, Miami-Dade) www. FLDOE. org 7

NAEP 2019 Sample Nationwide • 1, 000 Students • 19, 000 Public & Private Schools • 80 Jurisdictions (States + TUDAs) Florida • 44, 000+ Students • 768 Public Schools • 49 Districts www. FLDOE. org 8

NAEP Sampling Procedure Random Student Selection Student List Update January 2019 school enrollment Survey 2 data Provided by district Provided by FDOE Initial student sample is released on My. NAEP in early December 9 www. FLDOE. org Additional students may be added to the sample 9

NAEP Participation in Florida • Florida Statute 1008. 22(2) requires Florida districts and schools to participate in NAEP and international assessments • All selected students should participate • The only students who may be excluded: Ø Students with disabilities (SD) who participate in the Florida Standards Alternate Assessment Ø English Language Learners (ELL) who have been enrolled in U. S. schools for less than 1 full academic year Ø Students whose parents notify the school in writing that they will not participate www. FLDOE. org 10

NAEP Inclusion • Three inclusion rates are reported Remember! • States are required to include: ü Individual student performance is not reported and cannot impact student or school grades Ø 95% of all students Ø 85% of SD Ø 85% of ELL www. FLDOE. org ü NAEP is low stakes ü Not everyone is tested, so selected students represent other students like them across the nation 11

Florida Grade 4 Inclusion Rates (2011 -2017) GRADE 4 MATHEMATICS inclusion rates 100 95 98 96 91 percent 90 SD 98 ELL 98 93 All Students 97 100 91 91 90 87 85 80 75 70 98 85 90 SD ELL 98 97 95 percent All Students GRADE 4 READING INCLUSION RATES 96 93 92 89 90 89 85 85 85 81 80 75 2011 2013 Year 2015 2017 70 2011 2013 2015 2017 year www. FLDOE. org 12

Florida Grade 8 Inclusion Rates (2011 -2017) GRADE 8 MATHEMATICS INCLUSION RATES All Students 98 98 Percent All Students 98 88 100 97 95 95 90 ELL 89 87 86 85 80 75 70 98 SD 98 ELL 98 97 95 90 percent 100 SD GRADE 8 READING INCLUSION RATES 90 89 87 89 86 86 83 85 80 73 75 2011 2013 YEAR 2015 2017 87 70 www. FLDOE. org 2011 2013 year 2015 2017 13

NAEP 2019 Timeline Overview NAEP 2019 assessment window January 28 - March 8 2019 January Districts submit January 2019 student enrollment to FDOE Share. File; Schools verify submitted enrollment in My. NAEP December Schools gain access to student samples and begin Prepare for Assessment tasks in My. NAEP November FDOE submits Survey 2 data to NAEP for sampling (TUDA districts submit their own data) Schools register for My. NAEP and complete Provide School Information September - October 12 NAEP 2019 assessment dates are finalized; Districts receive NAEP folders for distribution to schools September July 2018 May District superintendents receive the list of NAEP 2019 schools and assessment dates Districts receive initial notification of schools in the 2019 sample www. FLDOE. org 14

NAEP School Folder Shipment ü Letter to School Principal ü Letter to School Coordinator Flash Drive Contents ü NAEP in Your School ü Space and Time Requirements ü School Coordinator Checklist Timeline ü My. NAEP Instructions ü Best Practices Strategies (for Grade 12 schools only) www. FLDOE. org 15

My. NAEP for Schools • Provides schools with information about NAEP and how they will participate in the assessment • Allows schools to complete multiple tasks in preparation for assessment day Task links are listed in the order they will be completed www. FLDOE. org 16

Deadline for School My. NAEP Registration: October 12 1. School coordinator receives My. NAEP Registration ID and instructions 2. School coordinator uses My. NAEP Registration ID to create an account 17 www. FLDOE. org 3. School coordinator logs in to My. NAEP and enters school information 17

NAEP 2019 Space & Time Requirements Tablet Location Assessment type Assessment subjects Sample size Number of test sessions Space requirements Digitally based assessment (DBA) Paper-and-pencil assessment Mathematics, reading, science 50 students 12 -30 students Two consecutive test sessions of 25 students each One test session • Ground floor or location accessible via • Must be separate from DBA session • Must have desks or tables; enough space for • Time requirements Paper Location ramp/elevator for transporting heavy rolling cases of tablets Must have flat desks or tables; enough space for 25 students to take NAEP on tablets with attached keyboards 12 -30 students to take NAEP in paper booklets • 60 minutes for NAEP staff setup before • 30 minutes for NAEP staff setup before • 120 minutes for each assessment session • 45 minutes for equipment refresh between • 90 minutes for assessment session assessment starts sessions Note: Requirements are for a typical school with both DBA and paper administrations. In some schools, only DBA may be administered. Each participating student will be assessed in only one subject and assigned to only one test session. Additional spaces may be needed for accommodation sessions. www. FLDOE. org 18

NAEP Administration Overview Video www. FLDOE. org 19

District Assessment Coordinator Role • Ensure that schools receive NAEP folders and all subsequent email communications • Submit January 2019 student enrollment for participating NAEP schools Ø Excel list must be submitted to FDOE Share. File within 5 days of your return from winter break Ø File template will be provided State School ID Student First Name Student Middle Name Student Last Name State Student ID Month of Day of Year of Birth • Encourage schools and students to fully participate in NAEP (including make-up administrations) www. FLDOE. org 20

NAEP Professional Development • 25 hours professional development/inservice credit available for NAEP school coordinators • FDOE can provide to districts for issue if inservice plans allow • An effort to thank, as well as incentivize, school coordinators for their time and effort preparing for the administration of NAEP • After NAEP administration, DACs who want certificates issued will be asked to verify names of school coordinators www. FLDOE. org 21

NAEP 2019 Field Trial Volunteers are Needed! • Two schools at each grade: 4, 8, 12 • Week of October 15 • Trial run of the operational assessment Ø Random sample of students Ø 120 minutes of student time including cognitive questions and student questionnaire Ø Two sequential DBA sessions • Schools that participate will receive a $200 gift card to an office supply store (Staples or Office Depot) • Schools cannot be selected for NAEP or international assessments in 2018 -2019 • Eligible schools must have at least 40 students in the sampled grade • Email volunteer schools to Tamika. Brinson@fldoe. org by September 15 www. FLDOE. org 22

International Assessments: Fall 2018 International Early Learning Study (IELS) Program for International Student Assessment (PISA) Survey/Assessment Window Oct. 15 – Dec. 7, 2018 Oct. 1 – Nov. 23, 2018 Participants 5 -year-old students Parents Teachers 15 -year-old students Teachers Principals Incentives School: $200 School Coordinator: $200 Teachers: $40 Parents: $20 Students: small gift School: $250 School Coordinator: $200 Teachers: $25 Students: $25 + 4 hrs comm. service Website myiels. us mypisa. us Districts with Participating Schools Broward, Lake, Nassau, Orange, Polk, Seminole, Volusia Alachua, Broward, Charlotte, Miami-Dade, Hillsborough, Okaloosa, Orange, Osceola, Pinellas, St. Johns www. FLDOE. org 23

International Assessments: Spring 2019 • Trends in International Mathematics and Science Study • Assessment window: April 1 – May 31 • Grades 4 and 8 • School registration website: mytimss 2019. com www. FLDOE. org 24

TIMSS 2019 Program Overview Participants Time Requirements Incentives Schools 18 grade 4 schools 17 grade 8 schools 30 minute online questionnaire School: $200 School Coordinator: $100 Teachers Of grade 4 classrooms Of grade 8 math and science classes 30 minute online questionnaire Teachers: $20 Students 2 intact classes at each grade level (math classes at grade 8) 72 minutes at grade 4 90 minutes at grade 8 (+ 30 minute questionnaire) Students: small gift www. FLDOE. org 25

TIMSS 2019 Timeline Overview April 1 2019 TIMSS 2019 assessment window begins Schools register and complete Prepare for Assessment activities on the My. TIMSS 2019 website January - March TIMSS 2019 assessment dates are finalized; Districts receive TIMSS folders for distribution to schools September July 2018 May District superintendents receive the list of TIMSS 2019 schools and assessment dates Districts receive initial notification of schools in the 2019 TIMSS sample www. FLDOE. org 26

NAEP Folders on FDOE Share. File https: //fldoe. sharefile. com K-12 Administration > NAEP > Districts and Schools (Special Districts) > District Name www. FLDOE. org 27

FDOE Website: NAEP and International Assessment Pages http: //www. fldoe. org/accountability/assessments/ www. FLDOE. org 28

www. FLDOE. org Tamika Brinson NAEP State Coordinator Tamika. Brinson@fldoe. org 850 -245 -0787 www. FLDOE. org 29