Test Chairpersons Orientation MiamiDade County Public Schools October
Test Chairperson’s Orientation Miami-Dade County Public Schools October 1 and 2, 2018
2 Agenda • Welcome • 2018 -19 Testing Calendar • Office of Advanced Academics • Updates to the Testing Programs • SAT-10 • Grade 3 Opportunities for Promotion • PERT • Iowa Tests of Basic Skills • ACCESS for ELLs 2. 0 • Interim Assessments
3 Agenda (cont. ) • Updates to the Testing Programs , continued • NAEP • PISA • FSA ELA and Mathematics • FCAT 2. 0 Science • NGSSS and FSA EOC • TDC Procedures • School Grades Formula • Test Security, Reporting Violations, and Responding to Inquiries
4 Welcome Sally Shay, Ph. D. District Director Assessment, Research, and Data Analysis
5 All About You! School Level Number of Years as a Test Chair School Type Traditional 303 Charter 80 Grand Total 383 Mean: 5. 56 Median: 4 Minimum: 1 Maximum: 30 Other Roles Number of Classes Taught in the Spring Elementary Middle Combination (ex. , K-8, 6 -12, K-12) Senior Adult Alternative Education Total Percentage 0 145 25 1 4 2 2 4 1 3 1 2 4 1 5 5 4 1 65 26 6 5 272 78. 2% 5 3 2 11 3 2 1 1 2 5 1 6 7 6 2 1 1 1 8 18 Assistant Principal Guidance Counselor Academic Coach 1 1 16 20 6 9 11 7 4 2 1 4. 6% 5. 7% 1. 7% 2. 6% 3. 2% 2. 0% 1. 1% 0. 6% 0. 3% Teacher Other
6 2018 -19 Testing Calendar http: //oada. dadeschools. net/Testing. Calendar. asp
High School Test Chairpersons Meeting Department of Advanced Academic Programs Dr. Lisette T. Rodriguez, Executive Director Montserrat Paradelo, Supervisor 305 -995 -1934 7
Advanced Academics Testing Updates 2018 -2019 PSAT/NMSQT Wed. October 10 § WB#22643 - $16. 00 § Grade 9 – student/parent, principal, EESAC § Grade 10 – FLDOE (FREE) § Grade 11 – fee waivers, student/parent, principal, EESAC 8
Advanced Academics Testing Updates 2018 -2019 PSAT/NMSQT Wed. October 10 § WB#22643 § Pre-printed labels only for 10 th grade - NEW § Other students: Last name, first name, 130 followed by the MDCPS Student ID#, DOB, District, and the school’s AI Code (CEEB #) 9
Advanced Academics Testing Updates 2018 -2019 PSAT/NMSQT – Wed. October 10 § WB#22643 - NEW § New concordant score for Algebra 1 – MATH 430 § TOS updates/corrections/misgrids ONLY between Monday, Dec 3, 2018 – Fri, Jan 11, 2019 10
Advanced Academics Testing Updates 2018 -2019 PSAT 8/9 – Wed. October 10 § WB#22643 – $10. 00 § 15 Middle Schools – 8 th grade § 2 High Schools will administer to 9 th grade 11
PSAT 8/9 PSAT/NMSQT 240 -1440 320 -1520 How long is it? 2 hrs 25 min. 2 hrs 45 min. # of Reading Qs 42 47 # of Writing Qs 40 44 # of Math Qs 38 48 Can your score qualify you for a National Merit Scholarship? No Yes What is the range of possible scores? 12
Advanced Academics Testing Updates 2018 -2019 Advanced Placement (AP) WB# 23269 - Friday, October 19, 2018 – College Board FREE AP Coordinator/Test Chair – Pompano High School. You must register with the CB and the My. Learning. Plan. The College Board’s perspective on organizing your AP Program and your AP 13
Advanced Academics Testing Updates 2018 -2019 Advanced Placement (AP) WB# 23088 - Friday, October 26, 2018 – AP Teacher Curriculum Review - AP Coordinator/Test Chair Session – Miami Coral Park Senior High School. Must register on My. Learning. Plan. M-DCPS’ perspective on organizing your AP Program and your AP Exam administration. 14
Advanced Academics Testing Updates 2018 -2019 Advanced Placement (AP) Ordering exams: work closely with your AP Coordinator and ESE Chairperson Remember FLVS students both FT/PT Credit Acceleration Program (CAP) District is required to permit a student who is not enrolled in the AP course or who has not completed the course to take the assessment during its regular administration. Student pays. 15
Advanced Academics Testing Updates 2018 -2019 PSAT/NMSQT & AP § ESE Accommodations: ◦ to 7 weeks to process and students may not be in your building ◦ In 16 -17, the College Board streamlined the process for requesting accommodations by allowing the upload of the 504 to the CB DASHBOARD. See your SPED school site coordinator. 16
Advanced Academics Testing Updates 2018 -2019 PSAT/NMSQT/AP/AICE/IB § ESE Accommodations: ◦ No standard form, procedures, or timelines ◦ Across all tests there are no standard processes. ◦ Work with your AICE, IB, AP Coordinator, ESE Chair and the parent. 17
Advanced Academics Testing Updates 2018 -2019 FSA/EOC/AP/AICE/IB Simultaneous administrations will take place spring 2019 ◦ AP Exams - May 6 -17, 2019 ◦ AICE – Late April – June 2019 ◦ IB – May 2019 We are meeting with AP/IB & AP/AICE schools to bring this to the forefront 18
Advanced Academics Testing Updates 2018 -2019 FSA/EOC/AP/AICE/IB Some protocols to follow: ◦ Distance between seats ◦ Electronic devices, including SMART watches, should be collected ◦ Administering on the wrong date ◦ Timing of exams ◦ Storage/Access of testing materials ◦ Incorrect accommodations to students ◦ Proctor has taught course before (AP) ◦ Attention to Key Times (AICE) 19
Stanford Achievement Test, Tenth Edition SAT-10 Mayda Cabeza, Director I 20
SAT-10 21 • • • What is the SAT-10? Who is administered the SAT-10? • Grades K - 2, districtwide Important dates to remember • April 9 -12, 2019
SAT-10 Results 22 v School Listing of Results (May-July) • Must be picked up at ITS v Individual Student Reports (August) • v Delivered to schools Results • Available on the Parent Portal • Posted to SPI under the tab FCAT/SAT-10 Scores v Uses • Referral of students to the district’s gifted program • Early identification of students who would be considered at high risk for problems associated with reading comprehension
Grade 3 Opportunities for Promotion Mayda Cabeza, Director I 23
24 Grade 3 Opportunities for Promotion Section 1008. 25, Florida Statutes (F. S. ), Eliminating Social Promotion. v Spring FSA English Language Arts v Spring Grade 3 Reading Student Portfolio v I-Ready assessment period 3, administered the last two weeks of school v Alternative Assessment for Grade 3 Promotion (AAGTP)— SAT-10, Primary 3, administered in Summer School v Grade 3 Mid-Year Promotion (GTMYP)—ITBS, Level 10, administered in November
25 Grade 3 Reading Student Portfolio v v v Administered during the 2 nd semester Participants: All grade 3 students complete a portfolio Scored at the school site Represents the 2 nd opportunity for a student to be promoted to grade 4 Student must demonstrate mastery of the standards Training conducted via Screencast
I-Ready 26 v Administered the last two weeks of schools. v Participants: • Students scoring level 1 , or students who did not participate in the Spring FSA English Language Arts, and • Students without a passing Reading Portfolio v Represents the 3 rd and last opportunity within the school year prior to retention. v Students must score at or above the 50 th percentile to be considered for promotion. v Training conducted via Screencast
27 Alternative Assessment for Grade 3 Promotion (AAGTP) v Administered at the end of the summer Reading camp. v Participants: Retained grade 3 students v SAT-10, Primary 3 is scored locally through ITS v Represents 4 th opportunity for students to be promoted to grade 4 v Students must score at or above a given cut score on the SAT-10 to be considered for promotion v Training conducted via Screencast
Grade 3 Mid-Year Promotion (GTMYP) 28 v v v Administered mid-November Participants: Students who “just missed” passing the AAGTP, or other students at the principal’s discretion ITBS, Level 10 will be scored via Performance Matters securely. Represents 5 th opportunity for retained 3 rd grade students to be promoted to grade 4 Students must have a passing score on the ITBS, representing 4 th grade work.
PERT Post-Secondary Education Readiness Test Mayda Cabeza, Director I 29
30 Postsecondary Education Readiness Test (PERT) v Results of the assessment will be used to advise students. v PERT may still be used to meet the Algebra I graduation test requirement for current students in grades 10 -12. v A comparative score of 97 or higher on the PERT Math may be used for either the NGSSS Algebra I or FSA Algebra I (PERT retesting policy is minimum 6 weeks with remediation) v Dual Enrollment Eligibility
PERT Score Repository 31 • Houses all PERT scores across the state • Miami-Dade College (MDC) is able to access PERT test scores for students participating in Dual Enrollment and incoming students interested in enrolling at MDC after graduation. • Miami-Dade County Public Schools uploads PERT test scores on SPI for school access. • • PERT file template Briefing 23095
IOWA Tests Iowa Tests of Basic Skills Mayda Cabeza, Director I 32
33 Iowa Tests § Used only for students lacking standardized test scored to determine eligibility for the Gifted Plan B Program. § Answer sheets will be available on Performance Matters § March 1, 2019 is the deadline to use the Iowa Tests for those students participating in the Spring FSA or SAT-10 administrations
ACCESS for ELLs 2. 0 Felicia Mallory, Executive Director Denetra Collins, Staff Specialist 34
35 Suite of Assessments ACCESS for ELLs Paper Kindergarten ACCESS for ELLs Alternate ACCESS for ELLs Purpose Summative Audience Grades 1 – 12 Kindergarten Grades 1 -12 Individual, Small Group, Speaking Domain – Individual 185 minutes 60 minutes 80 minutes Scoring Locally, Centrally Score Type Scale, Proficiency Level Test Administration Total Test Time
36 Purposes of ACCESS for ELLs 2. 0 The results provide: • Data useful for charting student progress over time, • Diagnostically useful information about students’ strengths and weaknesses in English, • Information about the language proficiency levels of individual students that can be used in making decisions regarding exit from the English for Speakers of Other Languages (ESOL) program • Identifies the proper ESOL level with respect to English Language Development Standards
37 Students To Be Tested § All students enrolled in the district (Grades K-12) and classified ELL, with a code of “LY” on the 1 st day of the test administration window, must be administered one of the following English language proficiency assessments: v Kindergarten ACCESS for ELLs v ACCESS for ELLs 2. 0 (Paper) v Alternate ACCESS for ELLs
38 ACCESS for ELLs 2. 0 assesses students’ English language proficiency across five areas: ACCESS for ELLs results are reported in four domains: listening, speaking, reading, and writing.
39 ACCESS for ELLs 2. 0 - 2018 • Individual student reports (ISR) from the 2018 administration were delivered to school sites August 13 – 17, 2018 and September 4 – 7, 2018. • ISRs received should be sent home with the students.
40 WIDA Website wida. wisc. edu
41 WIDA Assessment Management System www. wida-ams. us
42 Important Dates for 2019 ACCESS for ELLs Suite of Assessments Administration: January 28 – March 29, 2019 Mandatory Test Chairperson Training Meetings: December 5, 2018 – Miami Lakes Educational December 6, 2018 – Ruben Dario Middle December 7, 2018 – Miami Killian Senior
43 ACCESS for ELLs 2. 0 Division of Bilingual Education and World Languages North Region Deland Innocent, Supervisor 305 -995 -2977 Dinnocent@dadeschools. net South Region Mercy Abadie Lux, Supervisor 305 -995 -2098 Mabadie@dadeschools. net Central Region Alina Plasencia, Supervisor 305 -995 -2433 Aplasencia@dadeschools. net
National Assessment of Educational Progress (NAEP) Trial Urban District Assessment (TUDA) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist 44
45 NAEP/TUDA 2019 Assessment Window January 28 - March 8, 2019
46 Purpose of NAEP/TUDA • A common nationwide measure of student performance. • Reports changes over time. • Provides results for the nation, states, and some urban districts. • Secondary indicator for state progress and allows national comparisons between states and large urban districts. • Used by the President, Congress, and state leaders to set education policy.
47 Features of NAEP/TUDA v Provides district-level data to participating urban districts v Provides a common yardstick to measure student achievement in comparison to • • • Other urban districts States Large Central Cities National Public Schools Census Regions
48 Overview of NAEP/TUDA v A representative sample of schools and students are selected v Randomly selected students in grades 4, 8, and 12 are assessed in reading, mathematics, and science. v Assessments include multiple-choice and constructed responses v Assessments are administered by NAEP field staff v Assessments are 90 to 120 minutes, which include testing and answering background questions v Accommodations are offered for ELL and SWD students v Results are reported by scale scores, subscales, achievement levels, subgroups, and geography
49 Trial Urban District Assessment (TUDA) Districts 2017 www. nagb. gov
50 H 17 TS 0 2 IGH L H G I 17 S 20 IGHT HL G I H
51 2019 Assessment Components National Grades Assessed State Grades Assessed TUDA Grades Assessed Mathematics or Reading 4, 8, 12 4, 8 Science 4, 8, 12 4, 8 Digital Based Assessments High School Transcript Study 12
Important Dates for NAEP 2019 52 Event Date Provide School Information Form (Register and Complete) By October 19, 2018 Prepare for Assessment December 2018 NAEP representative My. NAEP website Task(s) • Go to http: //www. mynaep. com to register your school. • Complete the Provide School Information Form online. • NAEP Pre-assessment packets arrive • Review and verify the list of students selected for NAEP on My. NAEP • Complete information about how students with disabilities and English language learners will participate in NAEP • Notify parents of selected students • Manage questionnaires • Plan assessment day logistics Prepare for Assessment – Part 2 January 2019 • Update Student list • Pre-assessment review call with NAEP representative • Finalize assessment arrangements NAEP Testing Administration Window January 28– March 8, 2019 • Visit the Support Assessment Activities page to print appointment cards for students, teacher notification letters, and a list of sampled students for teachers one week before assessment. Wrap-Up By May 1, 2019 • Visit the Wrap Up page at http: //www. mynaep. com to obtain directions for final disposal of materials.
53 Trends in International Mathematics and Science Study (TIMSS) April 1 – May 31, 2019 Program for International Assessment (PISA) Fall 2018
Interim Assessment Program Formative Classroom Assessment Felicia Mallory, Executive Director Denetra Collins, Staff Specialist 54
55 Performance Matters Testing Platform Oada. dadeschools. net/IAP. asp
56 Performance Matters Testing Platform Technical Consultants testplatform@dadeschools. net 305 -995 -2345 Marva Wilks, Project Manager mwilks@dadeschools. net Marlene Lorie, Education Consultant mlorie@dadeschools. net Rose. Mary Stephens, Education Consultant rstephens@dadeschools. net
57 Overview of the Interim Assessment Program v Baseline Assessments in Science – Grades 5 and 8 v Mid-Year Assessments in: v ELA, Grades 9, 10 v Science, Grades 5, 8 v EOC-eligible courses in Algebra 1, Geometry, Biology, Civics, and US History v Alignment to the Florida Standards, Next Generation Sunshine State Standards, and the District’s pacing guides v Student Item Analysis reports are available in Performance Matters
58 Purpose of the Interim Assessment Program v To monitor student progress on the English Language Arts, Mathematics, Science and Social Studies - Florida Standards and the Next Generation Sunshine State Standards (Mid-Year) v To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction v To provide students with information on their progress on specific benchmarks v To provide schools with a reliable and valid assessment tool for state progress reporting.
59 Interim Assessment Program Administration Windows 2018 -2019 Administration Windows Subjects and Grade Levels Baseline Benchmark Assessment August 20, 2018– September 14, 2018 - Science: Grades 5 and 8 Mid-Year - ELA: Grades 9 -10 Mathematics: Algebra 1 and Geometry - Science: Grades 5, 8, and Biology 1 United States History Civics November 19, 2018 – December 21, 2018 Mid-Year January 22, 2019 – February 20, 2019
60 Mid-Year Administration Format Content- Area Paper-Based Tests Computer-Based Tests English Language Arts Grades 9 and 10 Math Algebra I and Geometry Science Social Studies Grades 5 and 8 Biology 1 United States History Civics
61 Approximate Testing Times Before the Test Approximately 10 minutes to pass out testing materials Administration Time ELA*: Approximately 75 minutes Mathematics*: Approximately 75 minutes After the Test Approximately 10 minutes to collect testing materials Science*: Approximately 112 minutes Civics*: Approximately 90 minutes U. S. History*: Approximately 90 minutes * It is suggested that longer assessments be administered over a two-day time period.
62 Performance Levels: District Default Approaching Developing Satisfactory Proficient
63 Performance Levels: Science and Social Studies Satisfactory Progress Students who are likely to score in FCAT levels 3 and above Limited Progress Students whose performance was not sufficient to predict success Insufficient Progress Students who are likely to score below FCAT level 3 This student demonstrated a satisfactory level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated a limited level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive targeted interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated an insufficient level of achievement on the content focus of the Next Generation Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive intensive interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level.
Florida Standards Alternate Assessment (FSAA) Kathleen Sierra, Supervisor 64
65 Assessment Participation Checklist Who should be assessed with the FSAA? § Individual IEP teams are responsible for determining whether students with disabilities will be assessed through administration of the general statewide standardize assessments or instructed in access points and assessed via the FSAA § IEP teams will use the Assessment Participation Checklist to make this determination Checklist available on page 3 of the Assessment Planning Resource Guide for IEP Teams
FSAA Performance Task Datafolio
67 FSAA Performance Task vs. Datafolio § How a student will participate in the statewide alternate assessment program is an IEP team decision that must be documented on the IEP. § Use the Assessment Planning Resource Guide for IEP Teams, located on the FSAA Portal, to help in the decisionmaking process. § An IEP that indicates "FSAA" would only need to be changed if the decision is that the Datafolio is the most appropriate method to assess the student.
68 2018 -2019 FSAA-Performance Task Overview § Administered to each student individually by the student’s teacher, a certified teacher, or other licensed professional who has worked extensively with the student and is trained in the assessment procedures § Designed to show student mastery of Florida Standards Access Points and Next Generation Sunshine State Access Points § Students typically select an answer to a question from three response options represented by pictures, text, numbers, and/or symbols § Students use their primary mode of communication § Responses are recorded in the test booklet and then later transcribed into the online test platform.
69 2018 -2019 FSAA-Datafolio Overview § For students with the most significant cognitive disabilities who typically do not have a formal mode of communication and are working at pre-academic levels § Designed to show student progress on a continuum of access toward academic content rather than mastery of academic content § For students being assessed via Datafolio, teachers submit student work samples across three collection periods throughout the school year § Samples are teacher-developed from typical classroom activities/tasks that are aligned to Access Point Standards § Student evidence from all three collection periods is submitted by the teacher via an online system and independently scored to determine the student’s progress
Content and Grades Assessed 70 Grade Level ELA Math 3 X X 4 X X 5 X X 6 X X 7 X X 8 X X 9 X 10 X High School Science Algebra 1 EOC Geometry EOC Biology 1 EOC Civics EOC USH EOC X X X X
71 FSAA Portal https: //fsaa-training. onlinehelp. measuredprogress. org/ § Training resources, important dates and information available through the FSAA Portal § 2018 -19 Test Administration Manual § Access to FSAA Online System (available in February 2019) § Performance Task Training Modules § Practice Materials
72 FSAA-Datafolio Important Dates For Late registration after Collection Period #1 – Contact the Alternate Assessment Coordinator (AAC) – Yvonne Leon : Yvonneleon@dadeschools. net
73 Performance Task – Important Dates
74 School Level Coordinator (SLC) § All Principals with students participating in the 2018 -19 FSAA are required to designate a School Level Coordinator (SLC), please refer to WB 23533 for details § The SLC can be an administrator, Test Chair, ESE Program Specialist, ESE Department Chair, or ESE teacher. § The SLC will be responsible for overseeing all aspects of the FSAA including § the storage and secure distribution of test materials § managing users in the test platform § ensuring teachers have been trained prior to administration § ensuring all responses have been entered into the online system prior to the deadline. A mandatory face-to-face meeting for SLCs will be held in the Spring 2019.
75 Training for Test Administrators § All teachers who will administer the FSAA – Performance Task for the first time must receive face-to-face training § Teachers who administered the assessment last year can participate in training through online modules and tutorials § All training must be completed prior to administering the assessment. Ms. Yvonne Leon from the Office of Special Education will be announcing the dates and times for the Fall FSAA face-to-face training for new test administrators. Please make sure an SLC is listed for your school.
76 Contact Information Yvonne Leon, Instructional Supervisor Alternate Assessment Coordinator (AAC) Department of Exceptional Student Education Phone: 305 -995 -2735 E-mail: yvonneleon@dadeschools. net Kathleen Sierra, Supervisor District Assessment Coordinator (DAC) Office of Student Assessment Phone: 305 -995 -7520 E-mail: ksierra@dadeschools. net
Florida Standards Assessments (FSA) and Next Generation Sunshine State Standards (NGSSS) 2018 -2019 Maria C. Bruguera, Director 1 Mara Ugando, Staff Specialist 77
78 FSA CBT Assessments and Platform The following FSA CBT will be administered online through the AIR Test Delivery System (TDS) platform: § FSA English Language Arts (ELA) – Writing (Grades 7– 10, and Retake) § FSA ELA Reading (Grades 7– 10, and Retake) § FSA Mathematics (Grades 7– 8) § FSA EOC Assessments § FSA Algebra 1 (including spring retake) § FSA Geometry
79 NGSSS CBT Assessments and Platform The following NGSSS CBT will be administered online through the Pearson Test. Nav 8 platform: § NGSSS EOC Assessments § Biology 1 § Civics § U. S. History
80 CBT Preparations (Weekly Briefing #23230) New FSA Secure Browser • All desktops and laptops/tablets (Windows, Mac OS, and Linux operating systems) that will be used for testing this year must be updated with the new secure browser. § Follow the instructions on the Secure Browser page to download the new secure browser and update your devices: https: //fsassessments. org/technology-resources/securebrowsers. stml. New Test. Nav Application • All schools administering NGSSS tests must download and install this new app if they are not using the browser-based version of Test. Nav. § The updated Test. Nav apps are available at: http: //download. testnav. com/. CBT Technical Specifications • Schools should pay special attention to the operating systems and browsers that will no longer be supported. • Additionally, schools should not update operating systems on testing devices throughout the school year before checking that updated versions are supported by both AIR and Pearson.
81 CBT Certification Tool • 2018 -2019 School Year • Both Pearson/NGSSS and AIR/FSA CBT certifications required for Spring. • Tool will be open from December 14 – January 25. • Weekly Briefing will be posted in mid December to provide instructions, deadlines, and screencast information. • School-wide AIR/FSA Infrastructure Trial required, tentatively scheduled for the week of February 11, 2019. • School-wide Pearson/NGSSS Infrastructure Trial required, tentatively scheduled for the week of April 15, 2019.
82 House Bill (HB) 7069 NEW Test Mode § Requires that grades 3– 6 ELA and Mathematics assessments be delivered only in a paper-based format, and the testing windows cannot exceed two weeks. Statewide Assessment Schedules § The grade 3 ELA assessment and the Writing component of the ELA assessment for grades 4 through 10 cannot start earlier than April 1. § Assessments other than the grade 3 ELA assessment and the Writing component of the ELA assessment must be administered no earlier than May 1. Assessment Results § Assessment results for the statewide, standardized ELA and mathematics assessments and all statewide, standardized EOC assessments must be made available no later than June 30, except for results for the grade 3 statewide, standardized ELA assessment, which must be made available no later than May 31.
83 Spring 2019 CBT Schedules § Retakes: FSA ELA Writing, FSA ELA Reading, FSA Algebra 1 (February 25–March 15) § Grades 7– 10 Writing (April 1– 12) § Must be scheduled during week one across the district. § Only ONE make-up window for Grades 4 -6 PBT and Grades 7 -10 CBT in May for (NO Writing Retake). § Grades 7 -10 Reading and Grades 7 & 8 Math (May 1 -29) § FSA EOCs (May 1– 29) § NGSSS EOCs (May 1– 29) § All CBT tests must be completed within the least number of days to the greatest extent possible. § Schools may schedule these assessments at any time during the established windows. § Paper-based accommodations must be completed and returned by the established dates to be in regular reporting.
84 Paper-Based Transition for Grades 3 -6 • In Spring 2019, the following tests are paper-based only: NEW § Grades 4– 6 ELA Writing § Grades 3– 6 ELA Reading and Mathematics § Grades 5 & 8 Science • Combined Test and Answer Book for ELA/Mathematics • Separate Test Book and Answer Book for Science • Grade 7 ELA Writing moves online
85 Paper-Based Transition for Grades 3 -6 § School Staff § Security and Forms § Check on locked storage plan now, limited access to no more than three people. § Schools may prepare secure materials five (5) working days prior to testing. § Only school assessment coordinator and other authorized school personnel may prepare materials and affix Pre. ID labels. Sealed test and answer books MUST NOT be opened. § Ensure to maintain “Test Materials Chain of Custody Form” at all times. § Pre. ID Labels § Test and answer books with no Pre. ID labels will NOT be processed. § Packaging and Returns § Schools will return materials directly to the contractor by deadlines. § Students § Item types § Test Item Specifications and Practice Tests will be updated this fall. § New Practice Resources
86 Paper-Based Transition for Grades 3 -6
87 Spring 2019 PBT Schedules Grade 3 Reading and Grades 4 - 6 Writing APRIL 1 8 G 3 R Make-up Gr 4 -6 W Make-up 2 9 G 3 R Make-up Gr 4 -6 W Make-up 3 4 Gr 3 Reading Gr 4 -6 Writing Gr 3 Reading Gr 4 -6 W Make-up 5 G 3 R Make-up Gr 4 -6 W Make-up 10 G 3 R Make-up Gr 4 -6 W Make-up 11(Early Release) G 3 R Make-up Gr 4 -6 W Make-up 12 G 3 R Make-up Gr 4 -6 W Make-up Grades 4 -6 Reading, Grades 3 -6 Mathematics, and Grades 5 and 8 Science MAY 1 2 Gr 4 -6 Reading 6 7 8 9 (Early Release) Gr 3 -6 Math Grades 3 -6 Math Gr 5, 8 Science Gr 5 Science Gr 4, 6 R MU Gr 3 -4, 6 M MU Gr 8 S MU 16 13 Gr 4 -6 R MU Gr 3 -6 M MU Gr 5, 8 S MU 14 Gr 4 -6 R MU Gr 3 -6 M MU Gr 5, 8 S MU 15 3 Gr 4 -6 R MU 10 Gr 4 -6 R MU Gr 3 -6 M MU Gr 5, 8 S MU 17
88 Test Security Guidelines § Verify counts of materials against packing slip within 24 hours of receipt. Contact our office immediately to report discrepancies. § Secure materials can only be delivered to or picked up by test administrators immediately before the beginning of each test session. § Written documentation of the security number ranges must be maintained at all times during distribution and return of secure materials. § Signatures of test administrator and school assessment coordinator § Unique security numbers of secure documents assigned to each student § Dates and times when secure materials are received and returned § Test materials may not be left unattended. § Test materials must be collected if a break occurs in the testing session. § Secure materials must never be left unsecured and must not remain in classrooms or be taken off the school’s campus overnight. § After any administration, initial or make-up, secure materials must be returned immediately to the school assessment coordinator and placed in locked storage.
89 Calibration § Calibration school selection is a scientific process that creates a sample that is representative of the entire state. § This includes demographics and a range of performance § School cooperation § Is crucial to complete the calibration analyses in a timely fashion for scoring and reporting. § Contributes towards Florida having valid and reliable assessments and results.
90 Calibration § Grades 3– 5 ELA/Mathematics § Entire school selected § Materials return with striped labels § Grades 6– 10 ELA/Mathematics § One subject/grade level test per school § Grade 6 – materials return with striped labels § Grades 7– 10 – test during week one (May 1 -10) § Calibration return dates: Grades 4 -6 Writing Grade 3 Reading April 8 Gr. 4 -6 Reading, Gr. 3 -6 Math May 8
91 Writing Domain Scores NEW § Starting with Spring 2018, if the ELA score is reported, the Writing Domain Scores can be found on the Individual Student Reports and the Excel file of the School Report of Students. § Principals can download the School Report of Students excel file from the FSA Reporting System to access these domain scores.
92 Accommodations Update NEW Auditory Presentation of FSA ELA Writing and Reading Passages § Unique accommodation for students who are severely visually disabled and: § Without tactile or manual abilities, or § Are newly blind and have not yet learned braille, or § The students’ disabilities severely limits their ability to learn braille. § A human reader is required to provide the accommodation for both paper -based and computer-based tests. § Begin identifying eligible students for spring § Unique Accommodations weekly briefing will be posted to provide instructions and deadline.
93 Concordant/Comparative Scores Weekly Briefings #23052 & 23095 NEW
NEW 94 Upgraded File Download Manager (FDM) § FDM is used by schools and District offices to obtain either prepared or customized data files for use by designated school staff. (Weekly Briefing #23120) § The application has been upgraded, to include a modern, mobile-ready user interface which allows easy selection and de-selection of elements using streamlined categories, including the following new features: § District users can pull data for the entire district instead of having to select one school at a time § A custom selection can be saved as “Favorites” by any user and re-used or shared with other users at the school § A search feature gives insight into where elements are located § For a demonstration of the application, please click on the following screencast § https: //eduvision. tv/l? e. Aege. R
95 Updating EOC Final Course Grades § Florida Statute 1008. 22 requires that students enrolled in specified courses take an EOC assessment for the course and the EOC results must constitute 30 percent of the students’ final course grades § FSA/NGSSS and FSAA (see Weekly Briefing #23735) NEW § The courses included are: Algebra 1, Biology 1, Civics, Geometry and U. S. History. § In the spring administration of each school year, students enrolled in eligible EOC courses for the first time have the 30 percent automatically included in the final course grade computation. § Final course grades for students who do not test or students whose tests are invalidated are reported as No Grade (NG). § These students must participate in the next EOC administration to earn an EOC score so that the 30% can be applied to the final course grade. § For the fall, winter, and summer administrations, school staff must apply the 30% calculation using the EOC chart found in Weekly Briefing #23522, and update the students’ final course grades in DSIS, including: § Any student who has an “NG” in an EOC eligible courses. § Any first time EOC test takers in the fall, winter, or summer. § Schools should use the traditional grade change protocol to update the final course grade.
96 FLEID § The Florida Education Identifier (FLEID) is a code issued by the FDOE to uniquely identify a person in Florida’s education data system. § The FLEID always begins with FL followed by a 12 numeric digit. § FLEID replaced the Florida ID number that consisted of either a student’s social security number with an X or a 10 -digit district number (130 XXXXXXX). § The use of the FLEID is required for testing. Students who do not have an FLEID will not be able to test. § The FLEID number can be accessed from File Download Manager (FDM) and it is also available in DSIS under PF 3 (Student Information) and PF 20 (Miscellaneous Information). § New students to Florida will not have a FLEID. ITS will upload FLEIDs on a weekly basis. § Check for FLEIDs on Mondays from prior week. § Important: If you receive a duplicate student message in TIDE or Pearson. Access: § Check to ensure you’ve typed the name and FLEID correctly. § Contact our office for guidance.
Test Distribution Center (TDC) Procedures Darma Rodriguez, District Coordinator 97
What Does TDC do? § Receive materials from vendors and distribute to schools. § Store, pack and provide additional testing materials to schools. § Distribute and process § Climate Survey § The Stanford Achievement Test (SAT-10) § The Alternate Assessment for Grade 3 Promotion § Pick up, process and store recording records (aka District Assessment Coordinator (DAC) boxes in the TAMs) — District Specific: Administrative Records (AR) and Student Work Records (SWR). § Communicate approaching delivery and return deadlines to schools. § Monitor and report material returns.
TDC Document Web Page www. dadeschools. net • Click on “Calendars. ” • Select “Testing Calendar. ” • On the new window that pops up, click on “TDC Documents. ”
TDC Documents (continued) § General Testing Information § Order Forms § Request materials for paper based assessments. § Request ancillary materials for all assessments (TAMs, work folders, vendor labels, etc. ) NOTE: Accommodated (PBT) materials for CBT exams must be requested via the Assessment Services application’s PBT Accommodations screen. § FSA & NGSSS Required Forms & Information for all returns (Fall, Winter, Spring and Summer). § Fillable forms and labels (DAC – AR & SWR Labels, Administrative Cover Sheets, PBT Accounting Forms, School Procedural Checklist, and Test Material Chain of Custody). § Packing Instructions. § Instructions to access TIDE Order History for tracking information.
TDC Documents (continued) § Required Forms & Information for all Other Assessment Returns § ACCESS 2. 0, FSAA, AAGTP, and SAT-10. § PBT Accounting Forms § School Procedural Checklists § Test Material Chain of Custody § Packing Instructions § TDC Resources § Delivery Details for SACs § Dates/Times of material deliveries to school (locate material and complete Chain of Custody. § Friendly Reminder Chart § Materials delivery & return information for all assessments § Student Assessment and Education Testing (SAET) Office Contact Chart § Program staff and contact information
Assessment Services app. Located in Apps│Services│Sites § School Assessment Team Identification and Contact Information § Only principals have access. § Used to Identify School Assessment Team and designate TDC ID card-holders. § Must be updated throughout the year to reflect updated/accurate information. § PBT Accommodated Materials § Principal to assign the School Assessment Coordinator “WPBS” access through QUAD A § SAC to order PBT Accommodated materials for CBT assessments and Special Document materials (Braille, Large Print & One-Item-Per-Page) for CBT & PBT assessments. Allow minimum 5 days for orders to arrive at TDC if placed before the window opens. Allow minimum 2 days for orders to arrive at TDC if placed during the testing window. BEST PRACTICE: Track and review materials at FSA’s TIDE “Orders” (instructions on TDC Documents page).
TDC ID Cards § Issued annually § Principal determines who will be issued cards § Limited number of cards per location § Must present when receiving/returning materials § Must not be shared
Where to Return Materials § DATA RECOGNITION CORPORATION (DRC) § WIDA ACCESS 2. 0 for ELLs § FSA ELA § FSA EOCs § PEARSON § NGSSS EOCs § FCAT 2. 0 Science (Grades 5 & 8) § TDC § Winter Retakes § Climate Survey Materials § Stanford Achievement Test (SAT-10) § Alternative Assessment for Grade 3 Promotion (AAGTP) § PERT PBTs § All DACs (AR & SWR)
Common Errors Reported by Vendors Due to tight processing deadlines, the following could result in late reporting: BOOKS LABELED INCORRECTLY § No Pre. ID label § Unusable Pre. ID labels: poor print quality, smudged/creased/wrinkled, barcode missing, incorrect administration (mathematics label on Algebra 1 or Geometry), incorrect label size, and/or pencil marks in barcode. § Test ticket used as Pre. ID label § Pre. ID label applied to student information box § Return Vendor Label (for boxes only) applied to test and answer book Missing Barcode Misplaced Label Wrong Label Size Unusable Labels
Common Errors Reported by Vendors (cont) BOXES RETURNED INCORRECTLY § NTBS books in a box labeled TBS or TBS books in a box labeled NTBS. § EOC materials returned with WRM return vendor labels or vice versa. § NGSSS boxes with Pearson return vendor labels, but DRC UPS-RS labels or vice versa. § NGSSS EOC return vendor label, but FSA EOC box contents or vice versa. § No return vendor box label. § Duplicate return vendor box label (only 1 vendor label and 1 UPS label per box). § Packing test books, passage booklets or answer sheets in AR and/or SWR (DAC) boxes.
DRC Vendor Return Labels § To be used for the return of all TBS FSA materials. Always confirm Assessment Title and School Location/Name. Record all alpha-numeric sequences on the required Spring Material Return Form (TDC Documents webpage) when returning materials. § To be used for the return of all NTBS FSA materials. Always pay close attention to Grade 3 Calibration Writing Calibration Read/Math Calibration ELA Retake EOC Assessment Title and Vendor Name. Confirm Assessment Title, School Location/Name and Vendor Information Record the alpha-numeric sequence on the required 2019 Spring Material Return Form (TDC Documents webpage) Braille LP/OIPP
Pearson Vendor Return Labels (samples) § To be used for the return of all TBS NGSSS & FCAT 2. 0 materials. Actual labels will include barcodes and the Science alpha-numeric sequence that are to be recorded on the required Spring Material Return Form. EOC § To be used for the return of all NTBS NGSSS & FCAT 2. 0 materials. Pay close attention to assessment title/vendor name. Actual labels will include barcodes and the alpha-numeric sequence that is to be recorded on the required Spring Material Return Form. LP/OIPP Check School Location/Name Alpha-numeric sequence and Barcode will appear here. Not to be Scored Braille
Common Errors Reported by Vendors (continued) OTHER COMMON RETURN ISSUES § Post-it notes left on books § Loose sheets inside books. § Moldy, biohazardous, or damaged test and answer books. § Return of USED FCAT 2. 0 Science test booklets as To Be Scored (TBS), instead of NTBS. § Mistakenly using the “Orange” FSA ELA Reading and Mathematics label for TBS FSA EOCs.
PBT Accounting Form Completing this form ensures that you have accounted for all secure paper-based tests. n You must conduct a PHYSICAL COUNT of the materials. n Check your physical counts against all packing slips (vendor’s initial shipment plus any additional shipments, as well as materials packaged by TDC). n The form is found on the TDC Documents web page. Use the forms provided by the vendors for WIDA ACCESS 2. 0 for ELLs and FSAA.
Keep Records Create a Material Return Log and collect the following information before sealing and shipping your TBS and NTBS boxes: • • • Assessment material title Box Numbers Vendor Return Label Numbers UPS Label Tracking Numbers Book Count BEST PRACTICE: Record Test Book Security Numbers & UPS pick-up dates. It is highly recommended that your school purchase a hand-held barcode scanner to reduce packing errors and increase recording accuracy.
Pack, Label & Return TBS to Vendor — DRC (all FSA materials) TBS FSA LABELS Writing G 4 -10 – green* Reading G 3 – gray* Reading G 4 -10 Mathematics G 3 -8 Algebra 1 Geometry orange* purple FSA ELA Retakes – red * Labels with blue stripes are for calibration materials. A. Gather TBS Test and Answer Books, place inside DRC bag and close with a zip-tie. B. Place the bag in the box. Use fill to avoid shifting or damaging of materials. Close box so that the flaps that read “A” and “B” are visible and place correct label in the indicated space. Ensure the box is securely sealed.
Pack, Label & Return TBS to Vendor — Pearson (NGSSS EOCs & FCAT 2. 0) TBS PEARSON LABELS NGSSS EOC – brown • Biology • Civics • U. S. History FCAT 2. 0 Science – red B. Use fill to avoid A. NGSSS EOC (Bio, Civics, USH): shifting or Gather TBS Test & Answer Books damaging of and place in the box. FOR FCAT materials. 2. 0 SCIENCE, pack only TBS Answer Books. (Never pack Test Books in this box). C. Close box so that the flaps that read “Apply return shipping label here” are visible and place correct label in the indicated space. Ensure the box is securely sealed.
Pack, Label & Return TBS to Vendor — DRC & PEARSON (Special Docs ) § Complete student information on TBS Special Document return envelope. § Place all material received in the Special Docs KIT, including the regular print book, in the envelope. Do not fold envelopes. § Place the envelope inside the box in which the materials arrived. § Place the corresponding “vendorspecific” blue or pink label on the designated box flaps. (DRC) (PEARSON)
Check for Errors one type of material (TBS or NTBS). § Do not place multiple TBS labels on a box. Each label has a unique barcode number that is used to record and track your materials by both TDC and the vendor. Placing multiple labels makes it difficult to track your box. NGSSS EOC § Do not place a TBS label and an NTBS label on the same box. Each box must only contain SCIENCE label and 1 UPS Shipping Return label ONLY. FSA § Never place more than one vendor return label on a box. Each box should have 1 vendor
Confirm Boxes are Ready for Return § 5 -way Label confirmation has been made: • • • FSA Reading/Mathematics NGSSS EOC SCIENCE Correct School Location/Name Correct Assessment Title Correct Label Color Correct Vendor (DRC vs. PEARSON) Correct Material Type (TBS vs. NTBS) § Only 1 vendor return label is placed on designated box flap. § All Test and Answer Books have been accounted for. § Material serial numbers and vendor return label barcode number(s) have been recorded on the Spring Material Return Form for every box being returned.
Add the UPS Return Label Place the CORRECT vendorspecific UPS return label on the box flap opposite of the vendor return label. Vendor name and address appears next to “Ship To” on the top portion of the UPS label. Call UPS, or complete the online “Schedule a Pick-up” form, to schedule pick-up. Record the UPS Tracking # on the Spring Material Return Form.
Submit the Required Forms are due 24 hours prior to each material return deadline and must document all materials being returned (TBS and NTBS). Example: The return window for the FSA ELA Reading Grade 3 TBS material is April 15 -17. Therefore, the form must be completed and submitted by April 16. Schools with multiple locations must complete separate forms for each location.
Form Submission Deadlines TBS PBT Materials Return: return of materials from paperbased administrations directly to the vendors. TBS Accommodated PBT Materials Return: return of paper-based accommodated materials from computerbased administrations directly to the vendors. TBS RETURN DATE(S) FORM DUE DATE FSA Reading (Grade 3) CALIBRATION 4/8 4/5 ASSESSMENT FSA ELA Writing (Grades 4 -6) CALIBRATION 4/8 4/5 FSA Reading (Grade 3) 4/15 -4/17 FSA ELA Writing (Grade 4 -6) FSA ELA Reading (Grades 4 -6) & Mathematics (Grades 3 -6) CALIBRATION FSA ELA Reading (Grades 4 -6) & Mathematics (Grades 3 -6) ASSESSMENT TBS RETURN DATE(S) FORM DUE DATE FSA EOC Algebra 1 Retake 3/11 3/8 4/16 FSA ELA Retake 3/18 3/15 4/15 -4/17 4/16 FSA ELA Writing (Grade 7 -10) 4/15 -4/17 4/16 5/8 5/7 FSA ELA Reading (Grades 7 -10) 5/22 5/21 FSA ELA Writing Make-Ups (Grades 7 -10) TBA 5/13 -5/15 5/14 FSA EOCs (Algebra 1 and Geometry) 5/22 5/21 FCAT 2. 0 Science (Grade 5 & 8) 5/16 5/15 FSA Mathematics (Grades 7 -8) 5/22 5/21 FSA ELA Writing Make-Ups (Grades 4 -6) TBA NGSSS EOCs (Biology, Civics, and U. S. History) 5/22 5/21 ALL NTBS PBT Materials Return: all paper-based assessments must be returned, directly to the vendors, by Friday, May 31 st and forms must be submitted by Thursday, May 30 th.
Location & Hours of Operation ADDRESS 13135 SW 26 Street, Miami, FL 33175 OFFICE HOURS Monday through Friday 7: 30 a. m. – 4: 00 p. m. MATERIAL PICK-UP & RETURN HOURS Monday through Friday 7: 30 a. m. to 2: 00 p. m. Wednesdays 7: 30 a. m. to 1: 00 p. m. TDC POLICIES: • All testing materials must be securely stored at the school site. Please refrain from picking up materials on your way home. • When requesting orders through TDC Documents’ “Order Forms, ” please be advised that orders placed before 3: 00 pm will be available for pick up within 24 hours. Otherwise, allow 48 hours for processing. Notification emails will be sent only if materials are on backorder. • All testing materials must be inventoried and discrepancies reported to TDC within 48 hours of material delivery. • ONLY TDC ID card holders are authorized to receive or return materials. Staff must be assigned by the school principal through the Assessment Services’ “School Assessment Team Identification and Contact Information” screen.
School Grades Formula Gisela Feild Administrative Director Assessment, Research, and Data Analysis 121
School Accountability Model • The grade is based on the percentage of total points earned, and combination schools are graded based only on the components for which they have sufficient data (Learning Gains were included beginning in 2015 -2016). • Provisions that may raise or lower a school’s grade beyond what the percentage of points would indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments). • Writing is included within the English language arts components. English Language Arts Mathematics Science Social Studies Achievement (0% to 100%) Learning Gains (0% to 100%) Blank Learning Gains of the Low 25% (0% to 100%) Blank Graduation Rate Acceleration Success Overall, 4 -year Graduation Rate (0% to 100%) Lagged High School (AP, IB, AICE, dual enrollment or industry certification) (0% to 100%) Lagged Middle School (EOCs or industry certifications) (0% to 100%) IC Lagged 122
Test Security, Reporting Violations, and Responding to State Inquiries Dr. Sally A. Shay, District Director 123
124 Security § Standards, Guidelines, and Procedures for Test Administration and Test Security available at http: //oada. dadeschools. net/Test Chair. Info/Standards. Guidelines. An d. Procedures. February 2015. pdf § General guidelines adopted by School Board § Florida Test Security Statute and Rule
125 Security Procedures § Caveon Data Forensics: § FSA § FCAT 2. 0 § EOCs (FSA and NGSSS) § Scan/Score Quality Control and Audit § SAT-10
126 FSA, FCAT 2. 0, EOC Caveon Data Forensics • The FLDOE has contracted with Caveon Test Security to provide its Caveon Data Forensics™ for all statewide assessments. • Caveon will analyze data to identify highly unusual test results for two primary groups: • Students with extremely similar test responses; and • Schools with improbable levels of similarity, gains and/or erasures. • Flagging only the most extreme results.
127 Caveon Goals and Scope § Ensure fairness of all results reported. § Maintain confidence in students achieving scores independently. § Make sure no widespread impropriety goes unchecked. § Provide two types of analysis: student-level and school-level. § Analyze ALL K-12 Assessments (FSA and NGSSS) excluding ELLs and FLKRS. § Beginning in Spring 2019, FLDOE Inspector General will make site visits.
128 Individual Student Appeals Do’s and Don’ts Do : Include any and all relevant information. For example, when vouching for a student’s academic record, include ALL students’ academic history, not just for the one student you are appealing. Don’t : Appeal for all students in a group when the investigation found no cause for the anomaly. The exception to this is if the parent requests an appeal. Do : Call SAET if you have any questions or concerns about an appeal investigation.
129 District Resources § Assessment, Research, and Data Analysis Website: http: //oada. dadeschools. net/ § Test Chairperson Website: http: //oada. dadeschools. net/Test. Chair. Info/Info. For. Test. Chair. asp § Testing Calendar (check for updates regularly) http: //oada. dadeschools. net/Testing. Calendar. asp § Guidelines and Tips for School Test Chairpersons http: //oada. dadeschools. net/Test. Chair. Info/27 Guidelinesand. Tipsfor. School. Test. Chairpersons. pdf § Standards, Guidelines, and Procedures for Test Administration and Test Security: http: //oada. dadeschools. net/Test. Chair. Info/Standards. Guidelines. And. Procedures. February 2015. pdf § Test Security Screencast http: //oada. dadeschools. net/Screencasts/Test. Security. html
130 Contact § Student Assessment and Educational Testing: § Dr. Sally A. Shay, District Director § Florida Standards Assessments (FSA), Next Generation Sunshine State Standards (NGSSS): § Maria C. Bruguera, Director I § Mara Ugando, Staff Specialist § Stanford Achievement Test-Tenth Edition (SAT-10), Grade 3 Promotion Opportunities, and Post Secondary Education Readiness Test (PERT): § Mayda Cabeza, Director I § ACCESS to ELLs 2. 0, Interim Assessment, and National Assessment of Educational Progress (NAEP): § Felicia Mallory, Executive Director § Denetra Collins, Staff Specialist § Florida Standards Alternate Assessment (FSAA) § Kathleen Sierra, Supervisor § Test Distribution Center § Darma Rodriguez, District Coordinator
- Slides: 130