2019 MCAS Grade 10 Reporting and CD Requirements

2019 MCAS Grade 10 Reporting and CD Requirements for the Class of 2021 September 10, 2019

Presenters • Bob Lee, MCAS Chief Analyst • Scott Kelley, Data & Reporting Specialist • Jodie Zalk, Test Administration Coordinator Massachusetts Department of Elementary and Secondary Education 2

Logistics for This Session • Questions may be asked at any time using the Questions feature on the Go. To. Webinar screen. o Questions about a specific student should be sent by email to mcas@doe. mass. edu. o Some questions may be covered during the course of the presentation. o We will answer some questions at the end of this session. o After the session, we will email questions and answers to participants. • This session is being recorded and will be available online in about one week at the MCAS Resource Center. Massachusetts Department of Elementary and Secondary Education 3

Today’s Discussion 1. High school Competency Determination (CD) requirements during the transition to next-generation MCAS tests and achievement levels • Yes, it is true that some students in the class of 2021 may be in the “Not Meeting Expectations” level but still earn their CD. 2. John and Abigail Adams & Koplik scholarship eligibility during the transition 3. Special reporting and retesting considerations related to the grade 10 ELA voided essay prompt 4. Review of the MCAS reporting schedule and November retest registration timeline Massachusetts Department of Elementary and Secondary Education 4

01 High School CD Requirements

Interim CD Regulations (Adopted in February 2018) • As determined in 2018, in order to earn their CD, the classes of 2021 and 2022 (this year’s juniors and sophomores) must earn a nextgeneration MCAS scaled score that is equivalent to a legacy MCAS scaled score of at least 240 on the grade 10 ELA and Mathematics tests or earn the next-generation MCAS equivalent of a legacy scaled score between 220 and 238 and fulfill the requirements of an Educational Proficiency Plan. Massachusetts Department of Elementary and Secondary Education 6

Interim CD Regulations (Adopted in February 2018) continued • The interim standard was identified in summer 2019 through: o A statistical linking process, and o Validation by a panels of experts • Provides members of the classes of 2021 and 2022 with timely notice of the passing standard and time to become familiar with the new tests and expectations before a new passing standard is established. • Provides time to conduct outreach to students, parents, educators, administrators, and other stakeholders as we move toward a new CD. Massachusetts Department of Elementary and Secondary Education 7

Statistical Equipercentile Linking Model (ELA) 100 13% Exceeding Expectations 90 % of students 80 70 60 51% Adv 48% Meeting Expectations 40% Prof 31% Partially Meeting Expectations 50 40 30 20 10 0 6% NI 3% F 8% Not Meeting Expectations 2018 ELA Gr 10 Level 1 Level 2 Massachusetts Department of Elementary and Secondary Education Next Gen Gr 10 Level 3 Level 4 8

Statistical Equipercentile Linking Model (ELA) continued 100 13% Exceeding Expectations 90 % of students 80 70 48% Meeting Expectations 51% Adv 60 Advanced 50 40 30 20 10 0 6% NI 40% Prof 31% Partially Meeting Expectations CD Passing 3% F 2018 ELA Gr 10 Level 1 Level 2 Massachusetts Department of Elementary and Secondary Education 8% Not Meeting Expectations Next Gen Gr 10 Level 3 Level 4 9

A Closer Look at the ELA Cut Score for Passing/Failing 10 9 472 CD 240 % of students 8 470 6% Needs Improvement 7 6 5 4 3 5% Passing & Not Meeting Expectations 455 3% Not Passing & Not Meeting Expectations 3% Failing 1 0 Passing 220 2 EPP required 440 2018 ELA Gr 10 Level 1 Massachusetts Department of Elementary and Secondary Education Partially Meeting Expectations Next Gen Gr 10 Level 2 Level 3 10

Interim CD Standard for the Classes of 2021 and 2022 Legacy PASSING but requires an Educational Proficiency Plan (EPP) Legacy Next Gen PASSING and PASSING met the MCAS but requires an graduation EPP requirement Next Gen PASSING and met the MCAS graduation requirement ELA 220– 238 240+ 455– 471 472+ Mathematics 220– 238 240+ 469– 485 486+ 220+ TBD - Summer 2020 STE Massachusetts Department of Elementary and Secondary Education 11

MCAS Achievement Levels Legacy Advanced (260 -280) Students at this level demonstrate a comprehensive and in-depth understanding of rigorous subject matter, and provide sophisticated solutions to complex problems. Proficient (240 -258) Students at this level demonstrate a solid understanding of challenging subject matter and solve a wide variety of problems. Needs Improvement (220 -238) Students at this level demonstrate a partial understanding of subject matter and solve some simple problems. Failing (200 -218) Students at this level demonstrate a minimal understanding of subject matter and do not solve simple problems. Massachusetts Department of Elementary and Secondary Education Next-Generation Exceeding Expectations (530 -560) A student who performed at this level exceeded grade-level expectations by demonstrating mastery of the subject matter. Meeting Expectations (500 -529) A student who performed at this level met grade-level expectations and is academically on track to succeed in the current grade in this subject. Partially Meeting Expectations (470 -499) A student who performed at this level partially met grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should consider whether the student needs additional academic assistance to succeed in this subject. Not Meeting Expectations (440 -469) A student who performed at this level did not meet grade-level expectations in this subject. The school, in consultation with the student's parent/guardian, should determine the coordinated academic assistance and/or additional instruction the student needs to succeed in this subject. 12

Current CD Requirements for ELA and Mathematics, by Class School Year Class of 2020 Class of 2021 Class of 2022 Class of 2023 2017 -18 2018 -19 2019 -20 Grade 11 Grade 12 Grade 9 Grade 10* Grade 11 Grade 9 Grade 10 Grade 9* 2020 -21 Grade 12 Grade 11 Grade 10 2021 -22 Grade 12 Grade 11 CD requirements 2022 -23 Legacy (240 or 220+EPP, per Board vote in October 2016) Interim (standard on new test that represents similar level of achievement as 240, or 220+EPP) Grade 12 Future (to be determined after results of new tests are considered by the Board in the 2019 -2020 school year) * First administration of next-generation grade 10 tests with new CD requirement in ELA/Mathematics Massachusetts Department of Elementary and Secondary Education 13

How will this appear on the Parent/Guardian Report? Front Page Massachusetts Department of Elementary and Secondary Education Inside (Page 2) 14

02 Adams and Koplik Scholarship Eligibility

Class of 2021 and 2022 Adams and Koplik Scholarships Adams Scholarship Koplik Scholarship • Score equivalent to Advanced in at least one subject • Score equivalent to Proficient or higher in the remaining subjects • Combined scores in the top 25 percent in their district when they enter 12 th grade • Meet Koplik standards on 2 AP, SAT II or other tests Massachusetts Department of Elementary and Secondary Education • See website for details 16

Interim Adams and Koplik Cut Scores for the Classes of 2021 and 2022 Legacy Proficient Legacy Advanced Next-Gen Proficient Advanced Equivalent ELA 240 -258 260 -280 472 -500 501 -560 Math 240 -258 260 -280 486 -503 504 -560 STE 240 -258 260 -280 Massachusetts Department of Elementary and Secondary Education N/A 17

03 Special Reporting and Retesting Considerations Related to the Gr. 10 ELA Voided Essay Prompt

Special Reporting Issues Related to the Voided ELA Prompt • The third operational essay question on the spring 2019 grade 10 test (about a passage from the novel The Underground Railroad) was voided during test administration. o Students who had not finished the essay were told to skip it. o Student essays were not scored. o The ELA operational test was reduced from 59 to 51 points. o An independent study was conducted to see if the performance of African American students declined after the voided prompt. Massachusetts Department of Elementary and Secondary Education 19

Study Results • The independent study concluded that the question: o showed that while black students experienced a small difference (approximately 0. 006 standard deviations) in performance as compared to white students on the second day of the MCAS ELA test, that small difference was within the normal variation of such differences on past MCAS tests. Massachusetts Department of Elementary and Secondary Education 20

Special Considerations • The Department gave scores of 455, the minimum passing score, to all students in the state who were on track to pass prior to the prompt. (This applied to 61 students. ) • Other students who believe they were affected by the prompt will be allowed to take the November 2019 MCAS ELA retest for consideration for the Adams and Koplik scholarships. o Additional guidance on this opportunity will follow shortly. Massachusetts Department of Elementary and Secondary Education 21

04 Review of the MCAS Reporting Schedule and November Retest Registration Timeline

Preliminary Release – Data Currently Available August 30 Preliminary School and District Results available in Dropboxes; includes scaled scores, achievement levels, growth, CD status September 4 Preliminary School and District Results available in Edwin Analytics; includes curriculum, item analysis, achievement, growth, and classroom reports Massachusetts Department of Elementary and Secondary Education 23

Upcoming Release Dates (Tentative) September 18 September 19 September 20 September 24 September 30 Official school and district results available in Dropboxes/Edwin Analytics conference call with superintendents Official embargoed school and district results available in Edwin Analytics MCAS results conference call with principals and test coordinators Register here: http: //doe. mass. edu/conference/? Conference. ID=10090 Public release of official MCAS results on Profiles District offices receive printed Parent/Guardian Reports Massachusetts Department of Elementary and Secondary Education 24

Student Registration for the November Retests • Schools will complete the Student Registration/Personal Needs Profile (SR/PNP) for the November retests: o September 23–October 4: Regular registration period o October 7 – 10: Window to register additional students retesting for ELA (if needed) • Guidance will be provided in the next Student Assessment Update. • SR/PNP training session on September 19 o Register at http: //www. doe. mass. edu/conference/? Conference. ID=10087 Massachusetts Department of Elementary and Secondary Education 25

Questions & Answers (Use the “Questions” feature to ask questions. ) Massachusetts Department of Elementary and Secondary Education 26

Next Steps • Today: Complete the evaluation form. o Responses associated with the name and email address used to log in o Email your input to mcas@doe. mass. edu if you have problems accessing or completing the form. • Later this week/early next week: o Receive an email with the Q&A from this session o Recording will be available Massachusetts Department of Elementary and Secondary Education 27

THANK YOU The Office of Student Assessment Services 781 -338 -3625 www. doe. mass. edu/mcas@doe. mass. edu 75 Pleasant Street, Malden, MA 02148