Test Chairpersons Orientation MiamiDade County Public Schools October

Test Chairperson’s Orientation Miami-Dade County Public Schools October 17 and 20, 2017

Agenda • • Welcome 2017 -18 Testing Calendar, Revised Accountability Update Office of Advanced Academics Office of Bilingual Education Office of Special Education Updates to the Testing Programs • FSA ELA and Mathematics • FCAT 2. 0 Science • NGSSS and FSA EOC 2

Agenda (cont. ) • Updates to the Testing Programs , continued • • SAT-10 Grade 3 Opportunities for Promotion FLKRS/STAR PERT • ACCESS for ELLs 2. 0 • Interim Assessments • NAEP • Test Security, Reporting Violations, and Responding to Inquiries • Gateway to Data (G 2 D) • Resources for Test Chairs – Test Chair 101 3

Welcome Sally Shay, Ph. D. District Director Assessment, Research, and Data Analysis 4

All About You! 5

2017 -18 Testing Calendar http: //oada. dadeschools. net/Testing. Calendar. asp 6

Changes Due to Hurricane Irma 7

School Grades Formula › Gisela Feild › Administrative Director › Assessment, Research, and Data Analysis 8

School Accountability Model • The grade is based on the percentage of total points earned, and combination schools are graded based only on the components for which they have sufficient data (Learning Gains were included beginning in 2015 -2016). • Provisions that may raise or lower a school’s grade beyond what the percentage of points would indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments). • Writing is included within the English language arts components. English Language Arts Mathematics Science Social Studies Achievement (0% to 100%) Learning Gains (0% to 100%) Blank Learning Gains of the Low 25% (0% to 100%) 9 Blank Graduation Rate Acceleration Success Overall, 4 -year Graduation Rate (0% to 100%) Lagged High School (AP, IB, AICE, dual enrollment or industry certification) (0% to 100%) Lagged Middle School (EOCs or industry certifications) (0% to 100%) IC Lagged

OFFICE OF ADVANCED ACADEMICS 10

OFFICE OF BILINGUAL EDUCATION 11

OFFICE OF SPECIAL EDUCATION 12

UPDATES TO TESTING PROGRAMS

Florida Standards Assessments (FSA), Florida Comprehensive Assessment Test (FCAT 2. 0), and End-of-Course (EOC) Assessments, 2017 -2018 Maria C. Bruguera, Director 1 Mara Ugando, Staff Specialist

House Bill (HB) 7069 Algebra 2 � Removes the provision for an Algebra 2 end-of-course (EOC) assessment Grade 3 ELA � Removes the requirement that the Grade 3 English Language Arts (ELA) assessment be computer-based in 2017 -18. Test Mode � Requires that grades 3– 6 ELA and Mathematics assessments be delivered only in a paper-based format no later than the 2018– 19 school year. Score Reports � Requires more comprehensive student score reports for statewide assessments (such as: an explanation of the student results; information on student strengths and weaknesses; specific actions that can be taken and resources that can be used for improving areas of weaknesses; comparative data) § One paper copy per subject will be provided to distribute to 15

Test Format by Year for Statewide Assessments 16

2017 -18 FSA CBT Assessments and Platform The following Spring 2018 FSA CBT will be administered online through the AIR Test Delivery System (TDS) platform: �FSA English Language Arts (ELA) – Writing (Grades 8– 10, Retake) �FSA ELA Reading (Grades 4– 10, Retake) �FSA Mathematics (Grades 3– 8) �FSA EOC Assessments § FSA Algebra 1 EOC (including spring retake) § FSA Geometry EOC 17

2017 -18 NGSSS CBT Assessments and Platform The following Spring 2018 Next Generation Sunshine State Standards (NGSSS) CBT will be administered online through the Pearson Test. Nav 8 platform: �FCAT 2. 0 Reading Retake �NGSSS EOC Assessments § Biology 1 § Civics § U. S. History 18

2017 -18 PBT Assessments The following Spring 2018 assessments will be administered on paper format: �FSA English Language Arts (ELA) Writing - (Grades 4 -7) �FSA ELA Reading - (Grade 3) �Florida Comprehensive Assessment Test (FCAT 2. 0) Science – Grades 5 and 8 19

Scheduling Guidance for PBT Administrations �District will select day(s) to administer paper-based tests district-wide. § Grades 4– 7 ELA Writing o Including Grades 8 -10/Retake paper-based accommodations must also adhere to this schedule § Grade 3 ELA Reading § Grades 5 and 8 Science �All schools must test on specified day(s) selected by the district. �Make-up PBT administrations may be scheduled 20 during the remaining days in the window.

Testing Changes � The Fall FSA and NGSSS EOC assessments and the FSA ELA Retake are administered in September. There is no longer an October Retake administration. � The last administration of the NGSSS Algebra 1 EOC assessment was in Summer 2017. § Students who have not yet passed this assessment for graduation purposes may participate in the FSA Algebra 1 EOC assessment and are eligible to use the alternate passing score (489) to satisfy this requirement. � Only two more FCAT 2. 0 Reading Retake administrations: Fall 2017 and Spring 2018 21

Concordant Score Status Update � The October 1, 2017 effective date to replace the current SAT/ACT/PERT concordant and comparative scores is NO LONGER IN EFFECT. � Existing concordant scores may be used until any changes are adopted by the state board. � FDOE continues to run additional analyses and to solicit input from stakeholders. § The dates of the additional public workshop and State Board meeting are yet to be determined. � After the analyses, FDOE will present any additional findings to the Commissioner for further consideration of changes to the recommendations, if any. 22

FLEID Requirement � The Florida Education Identifier (FLEID) is a code issued by the FDOE used to uniquely identify a person in Florida’s education data system. § The FLEID always begins with FL followed by a 12 numeric digit. FLEID replaced the Florida ID number that consisted of either a student’s social security number with an X or a 10 -digit district number (130 XXXXXXX). � Beginning with the Summer 2017 test administrations, the use of the FLEID is required for all students. Students who do not have an FLEID will not be able to test. � The FLEID number can be accessed from File Download Manager (FDM) and it is also available in DSIS under PF 3 (Student Information) and PF 20 (Miscellaneous Information). � New students to Florida will not have a FLEID. ITS will upload FLEIDs on a weekly basis. � § Check for FLEIDs on Mondays from prior week. 23

CBT Certification Tool � 2017– 18 ◦ ◦ School Year Both Pearson and AIR/FSA certifications required for Spring. Tool will be open from Jan. 8 – 26, 2018. �Weekly Briefing will be posted in mid December to provide instructions, deadlines, and screencast information. School-wide AIR/FSA Infrastructure Trial required, tentatively scheduled for the week of February 12, 2018. School-wide Pearson/NGSSS Infrastructure Trial required, tentatively scheduled for the week of March 12, 2018. 24

Calibration Schools • Schools selected for calibration sample will be notified in December. Schools may be selected for ONE grade-level/subject CBT test that they must complete during the first week of CBT testing. • § Calibration schools may schedule non-calibration CBT tests as they see fit throughout the rest of the CBT testing window. • Non-calibration schools may schedule CBT tests at any time during the established CBT testing window. Schools selected for Grade 3 Reading calibration will return materials early. (Calibration schools may continue to administer make-up tests through the end of the window. ) • 25

FSA Secure Browser 10. 0 � AIR has released a new secure browser for the 2017– 18 school year. (Weekly Briefing #21564) ◦ All desktops and laptops/tablets (Windows, Mac OS, and Linux operating systems) that will be used for testing this year must be updated with the new secure browser. ◦ Important Note: Secondary schools must have the new browser installed before the Fall 2017 FSA EOC and Retake administration. Elementary schools must have the new browser installed by the end of January 2018. ◦ Follow the instructions on FSA portal under Technology Resources to download the new secure browser and update your workstations. � Please note that the mobile apps have not been updated (i. OS, Android, and Chrome OS). 26

Pearson Test. Nav App (Optional) � Pearson has also released an updated Test. Nav app for the administration of the NGSSS assessment programs for the 2017– 18 school year. (Weekly Briefing #21564) � The Test. Nav app version 1. 6. x is optional for schools to download. § The updated Test. Nav apps are available at: http: //download. testnav. com/. � Pearson system requirements can be found here: https: //support. assessment. pearson. com/display/TN/Test. Nav +System+Requirements. � Please note: All computers and devices running the old Test. Nav app must be updated prior to testing, starting with the Fall 2017 NGSSS EOC and Retake administrations. 27

AIR and Pearson Specifications (Weekly Briefing #21564) 28

FSA Test Delivery System (TDS) New Features 2017 -2018 29

TA Interface – New Test Settings Layout Old Layout New Layout

Student Interface – New Test Settings Layout Old Layout New Layout

Student Interface – New Item Drop-down Menu (Spring 2018)

Student Interface – New Features Feature Description Chromebook Battery Indicator Shows the battery life and charging state of a battery on Chromebooks. Similar to what you see on a smart phone or laptop. Student Log In Improvements To reduce the number of login attempts, TDS will check forbidden apps running before a student types in all of their information. (Spring 2018) More Highlighting Colors More options for students to choose when highlighting text. (Spring 2018) Improved Line Reader More reliable across multiple devices. Print Essay Response (Practice Test Only) Print button allows for printing essay responses in a non-secure browser. Allows teachers to use TDS as an instructional tool. 33

FSA Test Information Distribution Engine (TIDE) New Features 2017 -2018 34

TIDE: Accommodations Section Updated to Match TDS

TIDE: New Feature - Upload Accommodations � Template provided (Excel and CSV) � Turn on/off multiple accommodations for multiple students � Available to CBT Coordinators 36

TIDE: New Feature - Upload Accommodations �Sample Excel Template contains dropdown options for Subject, Accommodation, and Value based on previous selection. 37

TIDE: Viewing Accommodations on Student Search Table ◦ Data only displays if the accommodation is turned on – will be blank otherwise

FSA TIDE Updates �Invalidations and Requests drop-down options ◦ Will allow FDOE to run reports and to standardize comments �TA Certification Course ◦ Slightly revised course for 2017– 18 ◦ All “TA Course Completed” statuses have been reset to blank 39

Accommodations Update � 2017 -2018 FSA Accommodations Guide § Updated for the 2017– 18 school year § Scripts have been taken out, only available on the FSA Portal � Health Monitoring Devices/Apps § Students who require access to an electronic device for health monitoring (e. g. , diabetes). § A test administrator must be able to monitor the student’s use of the device at all times during testing. § Added to Accommodations Guide and Appendix A in manual as an allowable accommodation. � Braille Transition (Weekly Briefing #21957) § Grades 3– 5: UEB only, other grades and subjects may choose § UEB Transition for Standards-Based Assessments 40

PBT Accommodations Portal App � New application on employee portal under Apps/Services/Sites tab � Order additional PBT Accommodations for FSA and NGSSS tests � For new students or new placements not captured by Pre. ID file ◦ For eligible students with PBT accommodations on IEP or Section 504 Plans (regular print, large print, braille, passage booklets, one-item-per-page) � Access to the PBT Accommodations application (WPBSPBA SCHOOLS) is assigned to the designated test chairperson via QUAD-A. ◦ QUAD-A User Guide is posted at http: //ehandbooks. dadeschools. net/user_guides/181. pdf � Weekly Briefing will go out in early November to provide further details 41

PBT Accommodations Portal App 42

PBT Accommodations Portal App 43

Reminders 44

Updating EOC Final Course Grades Florida Statute 1008. 22 requires that students enrolled in specified courses take an EOC assessment for the course and the EOC results must constitute 30 percent of the students’ final course grades. ◦ The courses included are: Algebra 1, Biology 1, Civics, Geometry and U. S. History. � In the spring administration of each school year, students enrolled in eligible EOC courses for the first time have the 30 percent automatically included in the final course grade computation. ◦ Final course grades for students who do not test or students whose tests are invalidated are reported as No Grade (NG). ◦ These students must participate in the next EOC administration to earn an EOC score so that the 30% can be applied to the final course grade. � For the fall, winter, and summer administrations, school staff must apply the 30% calculation using the EOC chart found in Weekly Briefing #21717, and update the students’ final course grades in DSIS, including: ◦ Any student who has an “NG” in an EOC eligible courses. ◦ Any first time EOC test takers in the fall, winter, or summer. � Schools should use the traditional grade change protocol to update the final course grade. � 45

17 -18 FSA Algebra 1 EOC Administrations Fall EOC Winter EOC First-Time Test Takers X X Retakers X X Spring Algebra 1 Retake X 46 Spring EOC Summer EOC X X X

FSA ELA Score �Students must participate in BOTH the ELA Writing and ELA Reading components to receive a FSA ELA score. �Student demographic information (Last and First name and FLEID #) must be the same for Writing and Reading records for the tests to be matched and one FSA ELA score reported. 47

Testing Accommodations � Paper-based Accommodations include: ◦ Contracted American Braille ◦ Uncontracted American Braille ◦ Contracted Unified English Braille (new) ◦ Uncontracted Unified English Braille (new) ◦ Large Print ◦ One-Item-Per-Page (OIPP) ◦ Paper based test in lieu of computer-based test (Regular Print) ◦ Unique Accommodation � Computer-based Accommodations include: ◦ ELA Reading and Writing passage booklets for CBT only - Regular Print or Large Print ◦ American Sign Language (ASL) videos for ELA Reading audio content (DHH) ◦ Closed captioning (CC) for ELA Reading audio content (DHH) ◦ Text-to-Speech - oral presentation of directions, prompts, items, and answer choices ◦ Masking - portions of the test may be masked to direct attention to uncovered item(s) 48

Paper-Based Testing FSA � ALL books must have a Pre. ID label. � Required information must be written on the cover (as directed in scripts). ◦ Student Name, Date of Birth, School Name, District Name, Today’s Date � Students must verify the Pre. ID label to ensure they have the correct preidentified book. Pearson � May still hand-grid demographic information or print Pre. ID labels. � Pearson’s pre-printed Pre. ID labels are smaller than the locally printed labels. An inset has been added to show where the smaller label should be placed. 49

PBT Practice Tests � Students who will take an FSA ELA Reading or Mathematics paper-based test are required to participate in a PBT Test Item Practice Session to familiarize themselves with the various item types they may encounter on the assessments. ◦ Grade 3 FSA ELA Reading ◦ Grades 4– 10 FSA ELA Reading PBT Accommodations ◦ Grades 3– 8 FSA Mathematics PBT Accommodations � Students taking PBT ELA Writing are not required to take a practice test, but are strongly encouraged to do so to become familiar with the amount of space they will have for their responses. 50

CBT Practice Tests �CBT students are required to participate in a practice test session prior to testing. ◦ Exception: Students retaking an assessment who previously completed this requirement for the test they will take (EOC or Retake) are not required to participate in another practice test. �Students with CBT accommodations must use the appropriate accommodated practice test. (Text to speech, masking) �Ensure test administrators do not start an Operational Session for practice. 51

Weekly Briefings �Upcoming weekly briefings include: ◦ Selected Calibration Schools by the FDOE ◦ Unique Accommodations Requests for Spring and Summer 2017 ◦ Requesting Medically Complex and Extraordinary Exemptions for Participation in Statewide Assessment Programs ◦ Notification of Procedures to Order Supplemental Accommodated FSA/NGSSS PBT Materials via the Employee Portal Application 52

Stanford Achievement Test, Tenth Edition (SAT-10) Grade 3 Opportunities for Promotion FLKRS (Star Early Literacy) Post Secondary Education Readiness Test (PERT) Iowa Tests (Plan B Gifted) Mayda Cabeza, Director I 53

SAT-10 • • • What is the SAT-10? Who is administered the SAT-10? • Grades K - 2, districtwide Important dates to remember • April 4 -10, 2018 54

SAT-10 Results v School Listing of Results (May-July) • Must be picked up at ITS v Individual Student Reports (August) • v Delivered to schools Results • (New) Available on the Parent Portal • Posted to SPI under the tab FCAT/SAT-10 Scores v Uses • Referral of students to the district’s gifted program • Early identification of students who would be considered at high risk for problems associated with reading comprehension 55

Grade 3 Opportunities for Promotion 56

Grade 3 Opportunities for Promotion Section 1008. 25, Florida Statutes (F. S. ), Eliminating Social Promotion. v Spring FSA English Language Arts v Spring Grade 3 Reading Student Portfolio v I-Ready assessment period 3, administered the last two weeks of school v Alternative Assessment for Grade 3 Promotion (AAGTP)— SAT-10, Primary 3, administered in Summer School v Grade 3 Mid-Year Promotion (GTMYP)—ITBS, Level 10, administered in November 57

Grade 3 Reading Student Portfolio v v v Administered during the 2 nd semester Participants: All grade 3 students complete a portfolio Scored at the school site Represents the 2 nd opportunity for a student to be promoted to grade 4 Student must demonstrate mastery of the standards Training conducted via Screencast 58

I-Ready v v Administered the last two weeks of schools. Participants: • • Students scoring level 1 , or students who did not participate in the Spring FSA English Language Arts, and Students without a passing Reading Portfolio Represents the 3 rd and last opportunity within the school year prior to retention. v Students must score at or above the 50 th percentile to be considered for promotion. v Training conducted via Screencast v 59

Alternative Assessment for Grade 3 Promotion (AAGTP) v Administered at the end of the summer Reading camp. v Participants: Retained grade 3 students v SAT-10, Primary 3 is scored locally through ITS v Represents 4 th opportunity for students to be promoted to grade 4 v Students must score at or above a given cut score on the SAT-10 to be considered for promotion 60

Grade 3 Mid-Year Promotion (GTMYP) v v v Administered mid-November Participants: Students who “just missed” passing the AAGTP, or other students at the principal’s discretion ITBS, Level 10 will be scored via Thinkgate securely. Represents 5 th opportunity for retained 3 rd grade students to be promoted to grade 4 Students must have a passing score on the ITBS, 61 th representing 4 grade work.

Florida Kindergarten Readiness Screener (FLKRS) �New screener (Star Early Literacy) ◦ Administered within the first 30 school days. ◦ Computer adaptive �Results ◦ Provides information on a child’s readiness for school ◦ Determines the VPK programs readiness rate for 2017 -2018 62

Post-Secondary Education Readiness Test PERT 63

Postsecondary Education Readiness Test (PERT) v Results of the assessment will be used to advise students. v PERT may still be used to meet the Algebra I graduation test requirement. v A comparative score of 97 or higher on the PERT Math may be used for either the NGSSS Algebra I or FSA Algebra I (PERT retesting policy is minimum 6 weeks with remediation) v Dual Enrollment Eligibility 64

PERT Score Repository • • • Houses all PERT scores across the state Miami-Dade College (MDC) is able to access PERT test scores for students participating in Dual Enrollment and incoming students interested in enrolling at MDC after graduation. Miami-Dade County Public Schools uploads PERT test scores on SPI for school access. 65

Iowa Tests of Basic Skills IOWA TESTS 66

Iowa Tests �Used only for students lacking standardized test scored to determine eligibility for the Gifted Plan B Program. �Answer sheets available via G 2 D on the “secure” tab �March 2, 2018 is the deadline to use the Iowa Tests for those students participating in the Spring FSA or SAT-10 administrations 67

ACCESS for ELLs 2. 0 Suite of Assessments Felicia Mallory, Executive Director Denetra Collins, Staff Specialist

Purposes of ACCESS for ELLs 2. 0 The results can provide: • Data useful for charting student progress over time, • Diagnostically useful information about students’ strengths and weaknesses in English, • One of multiple measures used to determine whether students are prepared to exit from English for Speakers of Other Languages (ESOL) programs. • Identifies the proper ESOL level with respect to English Language Development Standards

70 Students To Be Tested All students enrolled in the district (grades K-12) and classified ELL, with a code of “LY” on the 1 st day of the test administration window, must be administered the English language proficiency assessment: v Kindergarten ACCESS for ELLs v ACCESS for ELLs 2. 0 v Alternate ACCESS for ELLs

71 ACCESS for ELLs 2. 0 assesses students’ English language proficiency in five areas: Access for ELLs 2. 0 is reported in four domains listening, speaking, reading, and writing.

Domains & Grade Level Clusters *Note: Kindergarten will remain an interactive, paper-based kit. WIDA Consortium

73 Tiers for ACCESS for ELLs 2. 0 (grades 1 -12) and Proficiency Levels Within each grade-level cluster ACCESS for ELLs 2. 0 consists of three test forms: Tier A (beginner), Tier B (intermediate), and Tier C (advanced).

74 Tier Relationship to ESOL Level Tier A – Corresponds to ESOL Level 1 ▫ For ELLs who have arrived in the U. S. or entered school in the U. S. within this academic school year without previous instruction in English; ▫ currently receive literacy instruction only in their native language; and/or ▫ have recently tested at the lowest level of English language proficiency. Tier B – Corresponds to ESOL Level 2 ▫ For ELLs who have social language proficiency and some, but not extensive, academic language proficiency in English; and/or ▫ have acquired some literacy in English, though have not yet reached grade-level literacy. Tier C – Corresponds to ESOL Level 3 or 4 ▫ For ELLs who are approaching grade-level literacy and academic language proficiency in the core content areas; and/or ▫ will likely meet the state’s exit criteria for support services by the end of the academic year. Note: If in doubt, place the student in a higher tier.

Trainings and Certification(New Test Administrators) Training Tracks Key Elements Outcome Administration Procedures: Listening, Reading, Writing, Speaking Online procedural modules via Training Course and checklists Certificate of Completion Scoring Speaking Test Speaking Scoring module via Training Course Certification (upon completion of Speaking scorer quiz) ACCESS for ELLs Kindergarten Test Administrators Administration modules via Training Course Certification (upon completion of Kindergarten quiz) Alternate ACCESS for ELLs Test Administrators Administration modules via Training Course Certification (upon completion of Alt ACCESS quiz) ACCESS for ELLs 2. 0 Paper Test Administrators (Grades 1 -12) 75

76 New Training and Certification Requirements for Test Coordinators v Complete the Test Coordinator Checklist v Review applicable sections of the Accessibility and Accommodations Supplement v Review the online training available via the WIDA Secure Portal for each assessment being administered in your school v Complete the ACCESS for ELLs 2. 0 Paper Administration Quiz with a passing rate of 80% or higher

77 New Training and Certification Requirements for Test Administrators v Complete the Test Administrator Checklist v Access online training modules on WIDA’s secure website v Read Test Administration Manual(s) v Complete Kindergarten, Speaking, Paper Administration, and/or Alternate ACCESS for ELLS Quiz(zes) with a passing rate of 80% or higher to become certified to administer the assessment. Test Administrators only need to be certified in the test that they are administering.

Important Dates for 2018 ACCESS for ELLs Suite of Assessments Administration: January 29 – March 23, 2018 Mandatory Test Chairperson Training Meetings: December 4, 2017 – Miami Lakes Educational December 12, 2017 – G. Holmes Braddock Senior December 19, 2017 – Robert Morgan Educational

79 ACCESS for ELLs 2. 0 - 2017 • Individual student reports (ISR) from the 2017 administration were delivered to school sites August 30 – September 20, 2017. • ISR received should be sent home with the student.

Proficiency Criteria ACCESS for ELLs 2. 0 (Grades K– 12) ▫ Proficiency criteria requires a student to achieve an Overall English Language Proficiency Level of 4. 0 or greater AND a Proficiency Level of 4. 0 or greater on the Reading domain. Alternate ACCESS for ELLs (Grades 1– 12) ▫ Proficiency criteria requires a student to achieve an Overall English Language Proficiency Level of P 1 or greater.

81 WIDA Assessment Management System www. wida-ams. us

ACCESS for ELLs 2. 0 Division of Bilingual Education and World Languages North Region Deland Innocent, Supervisor 305 -995 -2977 Dinnocent@dadeschools. net South Region Mercy Abadie Lux, Supervisor 305 -995 -2098 Mabadie@dadeschools. net Central Region Alina Plasencia, Supervisor 305 -995 -2433 Aplasencia@dadeschools. net

National Assessment of Educational Progress (NAEP) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist

NAEP 2018 Assessment Window January 29 - March 9, 2018

Features of NAEP v Provides district-level data to participating urban districts v Provides a common yardstick to measure student achievement in comparison to • • • Other urban districts States Large Central Cities National Public Schools Census Regions

Purpose of NAEP v A common nationwide measure of student performance v Reports changes over time v Provides results for the nation, states, and some urban districts v Secondary indicator for state progress and allows national comparisons between states and large urban districts v Used by the President, Congress, and state leaders to set education policy

Overview of NAEP v A representative sample of schools and students are selected v Randomly selected students in grades 4 and 8, and are assessed in reading, mathematics, writing, and the arts v Assessments include multiple-choice and constructed responses v Assessments are administered by NAEP field staff v Assessments are 90 to 120 minutes, which include testing and answering background questions v Accommodations are offered for ELL and SWD students v Results are reported by scale scores, subscales, achievement levels, subgroups, and geography

2018 Assessment Components Digital Based Assessments Grades Mathematics or Reading 4 Mathematics, Reading, and Writing 8 Paper and Pencil Assessments Grades Mathematics or Reading 4

Important Dates for NAEP 2018 Event Date Task(s) Flash Drive Provide School Information Form (Register and Complete) By October 20, 2017 • Go to http: //www. mynaep. com to register your school. • Complete the Provide School Information Form online. Documents 1 and 2 Prepare for Assessment NAEP representative My. NAEP website December 2017 • NAEP Pre-assessment packets arrive • Review and verify the list of students selected for NAEP on My. NAEP • Complete information about how students with disabilities and English language learners will participate in NAEP • Notify parents of selected students • Manage questionnaires • Plan assessment day logistics Documents 3. 0 – 3. 7 Prepare for Assessment – Part 2 January 2018 • Update Student list • Pre-assessment review call with NAEP representative • Finalize assessment arrangements Document 4 NAEP Testing Administration Window January 29– March 9, 2018 • Visit the Support Assessment Activities page to print appointment cards for students, teacher notification letters, and a list of sampled students for teachers one week before assessment. Wrap-Up By May 1, 2018 • Visit the Wrap Up page at http: //www. mynaep. com to obtain directions for final disposal of materials. Document 5

90 International Assessments Trends in International Mathematics and Science Study (TIMSS) March 2018 International Computer and Information Literacy Study (ICILS) May 2018

Interim Assessment Program Formative Classroom Assessment Felicia Mallory, Executive Director Denetra Collins, Staff Specialist

Overview of the Interim Assessment Program v Baseline Assessments in Science – Grades 5 and 8 v Mid-Year Assessments in: v ELA, Grades 9, 10 v Science, Grades 5, 8 v EOC-eligible courses in Algebra 1, Geometry, Biology, Civics, and US History v Alignment with the Florida Standards and Next Generation Sunshine State Standards and the District’s pacing guides v Data analysis and disaggregation, score reports, and item analysis are available in Gateway to Data (G 2 D)

Purpose of the Interim Assessment Program v To monitor student progress on the Reading, Mathematics, Science and Social Studies - Florida Standards and the Next Generation Sunshine State Standards (Mid-Year) v To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction v To provide students with information on their progress on specific benchmarks v To provide schools with a reliable and valid assessment tool for state progress reporting.

Interim Assessment Program Administration Windows 2017 -2018 Administration Windows Subjects and Grade Levels Baseline Benchmark Assessment August 21, 2017– September 16, 2017 (varied) - Science: Grades 5 and 8 Mid-Year - ELA: Grades 9 -10 Mathematics: Algebra 1 and Geometry - Science: Grades 5, 8, and Biology 1 United States History Civics November 20, 2017 – December 22, 2017 Mid-Year January 22, 2018 – February 16, 2018

Mid-Year Administration Format Content- Area Paper-Based Tests Computer-Based Tests English Language Arts Grades 9 and 10 Math Algebra I and Geometry Science Social Studies Grades 5 and 8 Biology U. S. History Civics Students MUST take the test corresponding to the grade level in which they are listed in ISIS (unless they are enrolled in an EOC course in same content area).

96 Ordering Additional Interim Assessment Materials from the Test Distribution Center

Approximate Testing Times Before the Test Approximately 10 minutes to pass out testing materials Administration Time ELA*: Approximately 75 minutes Mathematics*: Approximately 75 minutes After the Test Approximately 10 minutes to collect testing materials Science*: Approximately 112 minutes Civics*: Approximately 90 minutes U. S. History*: Approximately 90 minutes * It is suggested that longer assessments be administered over a two-day time period.

Performance Levels The mid-year performance levels for grades 5 and 8 Science, Biology, Civics, and U. S. History is as outlined: Satisfactory Progress Students who are likely to score in FCAT levels 3 and above Limited Progress Students whose performance was not sufficient to predict success Insufficient Progress Students who are likely to score below FCAT level 3 This student demonstrated a satisfactory level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated a limited level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive targeted interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated an insufficient level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive intensive interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level.

Score Reports v. Useful reports that can be retrieved via G 2 D: • • • Report Card by Test Progress Report Item Analysis Distractor Analysis Score Analysis Proficiency Report At-Risk Students by Standard Report Card by Standard (classes) Test Summary Demographic Item Performance

Test Security, Reporting Violations, and Responding to State Inquiries Dr. Sally A. Shay

Security v Standards, Guidelines, and Procedures for Test Administration and Test Security available at http: //oada. dadeschools. net/Te st. Chair. Info/Info. For. Test Chair. asp • General guidelines adopted by School Board v Florida Test Security Statute and Rule

Security Procedures �Caveon Data Forensics: ◦ FSA ◦ FCAT 2. 0 ◦ EOCs (FSA and NGSSS) �Scan/Score Quality Control and Audit ◦ SAT-10 102

FSA, FCAT 2. 0, EOC Caveon Data Forensics • The FLDOE has contracted with Caveon Test Security to provide its Caveon Data Forensics™ for all statewide assessments. • Caveon will analyze data to identify highly unusual test results for two primary groups: • Students with extremely similar test responses; and • Schools with improbable levels of similarity, gains and/or erasures. • Flagging only the most extreme results.

Caveon Goals and Scope �Ensure fairness of all results reported. �Maintain confidence in students achieving scores independently. �Make sure no widespread impropriety goes unchecked. �Provide two types of analysis: student-level and school-level. �Analyze ALL K-12 Assessments (FSA and NGSSS) excluding ELLs and FLKRS. 104

Caveon Similarity Index �Most powerful statistic �Measures degree of similarity between 2 or more test instances (same test, school, and admin). �Compares each test instance against all other test instances in the school. �Extremely high similarity may indicate threats to validity. ◦ Answer Copying ◦ Test Coaching ◦ Collusion among students/educators 105

Changes - Similarity �Similarity - Methodology ◦ Same analysis for paper-and-pencil and online tests �Similarity – TEI (Technology Enhanced Items – beginning 2016) ◦ Many more incorrect answer choices ◦ Increased sensitivity ◦ Uses exact matches (Ex. -4/2 is NOT the same as -2) ◦ Thoughtless responding patterns no longer 106

Student Level Flag – M 4 Similarity Observed Agreement Expected Agreement 5% 12% 38% 57% 73% Identical Incorrect Identical Correct Non-Matching Expected Identical Incorrect Expected Identical Correct Expected Non-Matching Observed versus Expected Response Matching Extreme Similarity – Index = 12. 5 107

Visual Representation of Matching by Item Index 0. 3 Different Correct Match Incorrect Match 2 1 0 0 10 20 30 40 50 60 70 Question Index 28. 0 Different Correct Match Incorrect Match 2 1 0 0 10 20 30 40 50 Question 108

Caveon Erasure Analyses �Erasure analysis (WTR and WTR-RTW statistics) ◦ Detect potential coaching by educators. ◦ Detect potential sharing of content during test session breaks (i. e. , restroom or end-of-day). �Based on estimated answer changing rates from ◦ Wrong-to-Right ◦ Right-to-Wrong �Identify answer sheets with anomalous answer changing. �Extreme statistical outliers could involve test Important! No student–level score invalidations based on erasure fraud. analysis; erasure analysis limited to school-level flagging for additional review. 109

Individual Student Appeals Do’s and Don’ts �Do – Include any and all relevant information. For example, when vouching for a student’s academic record, include ALL students’ academic history, not just for the one student you are appealing. �Don’t – Appeal for all students in a group when the investigation found no cause for the anomaly. The exception to this is if the parent requests an appeal. �Do – Call SAET if you have any questions or concerns about an appeal investigation. 110

District Resources �Assessment, Research, and Data Analysis Website: http: //oada. dadeschools. net/ �Test Chairperson Website: http: //oada. dadeschools. net/Test. Chair. Info/Info. For. Test. Chair. asp �Testing Calendar (check for updates regularly) http: //oada. dadeschools. net/Testing. Calendar. asp �Guidelines and Tips for School Test Chairpersons http: //oada. dadeschools. net/Test. Chair. Info/27 Guidelinesand. Tipsfor. School. Test. Chairpersons. pdf �Standards, Guidelines, and Procedures for Test Administration and Test Security: http: //oada. dadeschools. net/Test. Chair. Info/Standards. Guidelinesand. Procedures �Test Security Screencast http: //oada. dadeschools. net/Screencasts/Test. Security. html. May 2013. pdf

Contact v Student Assessment and Educational Testing: • Dr. Sally A. Shay, District Director v Florida Standards Assessments (FSA), Next Generation Sunshine State Standards (NGSSS): • Maria C. Bruguera, Director I • Mara Ugando, Staff Specialist v Stanford Achievement Test-Tenth Edition (SAT-10), Grade 3 Promotion Opportunities, and Post Secondary Education Readiness Test (PERT): • Mayda Cabeza, Director I v ACCESS to ELLs 2. 0, Interim Assessment, and National Assessment of Educational Progress (NAEP): • Felicia Mallory, Executive Director • Denetra Collins, Staff Specialist v Florida Standards Alternate Assessment (FSAA) • Kathleen Sierra, Supervisor v Test Distribution Center • Magaly Hernandez, Supervisor • Darma Rodriguez, Curriculum Support Specialist