Arizonas New Assessment AZMERIT Arizona Measurement of Educational

Arizona’s New Assessment AZMERIT – Arizona Measurement of Educational Readiness to Inform Teaching 12/12/2021 Tempe School District 1

Az. MERIT What We Know Ø Created by American Institutes for Research (AIR) a non-for-profit organization Ø Will replace AIMS Reading, Writing and Mathematics tests Ø Will be administered: ØStatewide for the FIRST TIME in Spring 2015 Øin the content areas of English Language Arts and Mathematics Øto students in Grades 3 through 8 and to students enrolled in high school level English and Mathematics courses Ø No Grade 2 assessment 12/12/2021 Tempe School District 2

Az. MERIT What We Know Ø Arizona will control the decision making for all aspects of the exams including test design, test and item content, scoring, and reporting 12/12/2021 Tempe School District 3

Az. MERIT What We Know ØAligned to English Language Arts and Mathematics of the Arizona College and Career Ready Standards ØTest blue prints specific to Az. Merit were developed. 12/12/2021 Tempe School District 4

12/12/2021 Tempe School District 5

12/12/2021 Tempe School District 6

An Arizona Test • ADE Assessment staff reviewed thousands of test items • Selected items and proposed test forms for 2015 • Week of 12 -8 -14 Arizona educators will: – Review proposed test items – Approve items that will move to production – Review thousands of items for bias and content alignment • In future, Arizona Educators will write test items 12/12/2021 Tempe School District 7

Az. MERIT What We Know Ø The computer-based assessments provide innovative tools that provide accommodations for a wide array of students with special needs Ø Will offer computer-based tools which will better measure students’ mastery of the Arizona College and Career Ready Standards including problem solving and critical-thinking skills Ø Districts may identify schools that may take the online assessments or the paper-based assessments. 12/12/2021 Tempe School District 8

Az. MERIT What We Know Ø Students will test for about 7 hours across multiple days during April (like AIMS) Ø Student test scores will be comparable regardless of the testing format Ø Reports will identify students’ areas of strength and weakness 12/12/2021 Tempe School District 9

Az. MERIT What We Know • Students taking Algebra or Geometry for high school credit will take the End-Of-Course tests in addition to grade level test Advantages of EOC testing – More information about student readiness for college and career upon graduation – Measures a broader range of high school content – Taken when enrolled in course regardless of student’s grade 12/12/2021 Tempe School District 10

Az. MERIT What We Know Ø Az. MERIT results will be comparable to results in Utah, Florida, and the Smarter Balanced States (California, Nevada, Oregon, Washington, Idaho, Wyoming, etc. ) See list of Smarter Balanced State Members here: Smarter Balanced Member States 12/12/2021 Tempe School District 11

How Do They Do That?

Az. MERIT What We Know Ø Like AIMS, Az. MERIT is untimed Ø The testing sessions for paper and computer-based tests will be the same Ø The mode of testing (paper-based or computer-based) has little effect on the testing time 12/12/2021 Tempe School District 13

Az. MERIT What We Know Ø The online System technical requirements Ø AIR’s testing platform requires minimal bandwidth Ø Az. MERIT is usable on a wide variety of devices (e. g. , Chromebooks, i. Pads, PC Computers, etc. ) Ø Az. MERIT is easy to install and use Ø AIR is experienced in transitioning state testing programs from paper-based testing to computer-based testing Ø ADE is currently in discussions with AIR and will share more details about the test 12/12/2021 Tempe School District 14

Az. MERIT What We Know Testing System • Az. MERIT Portal - used to access the Az. MERIT sample tests, the computer-based Az. MERIT tests, test related resources, and the other two AIR systems. • Test Information Distribution Engine (TIDE) – the system that has the information about the districts, schools, and students expected to participate in Az. MERIT. • Test Delivery System (TDS) – the testing platform used to deliver the computer-based test. – Test Administrator Interface and the Secure Browser 12/12/2021 Tempe School District 15

Videos demonstrating platform • Expected end of week (possibly Dec 12) 12/12/2021 Tempe School District 16

Az. MERIT What We Know Ø Sessions must be given in sequence Ø Sessions are the same for online and paper • Test sessions are untimed, but a session must be completed before the end of the day. The upper end of the suggested times represents the expected time needed for at least 95% of the students to complete the session. 12/12/2021 Tempe School District 17

Az. MERIT What We Know • Sessions for students in Algebra or Geometry courses taken for high school credit. • • The test is untimed. The upper end of the suggested times represents the expected time needed for at least 95% of the students to complete the test. 12/12/2021 Tempe School District 18

What We Have Done 12/12/2021 Tempe School District 19

Online Technical Requirements for Az. Merit • Student Support and IT are reviewing minimum requirements – Computers, Chromebooks • Processing speed, Hard drive space, screen dimensions, resolution, etc. – Operating systems – Web Browser – Lock down browser 12/12/2021 Tempe School District 20

Computer-Based Testing Readiness Report • Completed Computer-Based Testing Readiness Report – Device types – Operating system – Screen resolution – Numbers of computers, keyboards, microphones, etc. – Download and upload speeds – Number of students testing 12/12/2021 Tempe School District 21

Testing Readiness Indicators • Began reviewing the readiness status of our schools – Green – indicates the school has sufficient bandwidth and a sufficient number of acceptable devices. – Yellow – indicates the school has sufficient bandwidth and just barely enough acceptable devices. – Red – indicates the school has insufficient bandwidth or an insufficient number of acceptable devices or both. 12/12/2021 Tempe School District 22

Device capacity 12/12/2021 Tempe School District 23

Proposed Testing Window • Online Grade Level Tests – Testing: Monday March 30 – Monday April 20 – Make ups included • Paper Grade Level Tests – Testing: Monday April 13 – Wednesday April 15 – Make ups: Thursday April 16 – Monday April 20 • Paper End of Course Tests – Tuesday, April 21 – Make-ups: Wednesday, April 22 and Thursday April 23 • 12/12/2021 The window conforms to all the timing requirements for starting and finishing testing (see 2014 -15 Detail Calendar). Tempe School District 24

Online Grade Level Test Schedule March 30 March 31 April 2 April 3 Gr 3/6 Writing Gr 3/6 ELA Gr 3/6 Make-up Holiday Gr 3/6 Math Gr 3/6 Make-up April 6 April 7 April 8 April 9 April 10 AM Gr 3/6 Make-up Gr 4/7 Writing Gr 4/7 ELA Gr 4/7 Make-up PM Gr 3/6 Make-up Gr 4/7 Math Gr 4/7 Make-up April 13 April 14 April 15 April 16 April 17 AM Gr 4/7 Make-up Gr 5/8 Writing Gr 5/8 ELA Gr 5/8 Make-up PM Gr 4/7 Make-up Gr 5/8 Math Gr 5/8 Make-up AM PM April 20 AM Gr 5/8 Make-up PM Gr 5/8 Make-up 12/12/2021 Expected amount of testing time: Writing 60 -90 ELA 45 -75 (each session) Math 60 -85 (each session) Tempe School District 25

Paper Grade Level Test Schedule Grades test simultaneously April 13 April 14 April 15 April 16 April 17 AM Writing ELA Make-up PM Make-up Math Make-up April 20 April 21 April 22 April 23 AM Make-up EOC Math 1 Make-up PM Make-up EOC Math 2 Make-up Suggested testing minutes Grade level tests: Writing 60 -90 ELA 45 -75 (each session) Math 60 -85 (each session) 12/12/2021 Suggested testing minutes EOC Math tests: Math 1 50 – 85 Math 2 45 -75 Tempe School District 26

12/12/2021 Tempe School District 27

Az. MERIT What We DON’T Know Az. MERIT testing accommodations available for the paper and the computer-based test versions Ø The number of score levels of Az. MERIT is under discussion. Ø ØADE expects Az. MERIT to have at least two passing score levels. Ø A passing score on Az. MERIT will mean a student is on track for college or career upon graduation. Ø The scale scores associated with each level Ø Standard setting will be done in summer Ø Details of End-of-Course testing 12/12/2021 Tempe School District 28

Az. MERIT What We DON’T Know Ø How the results of the Az. MERIT will be used for various accountability purposes including: a) A-F School Letter Grades b) Teacher and Principal Evaluations c) Move on When Reading, and d) the potential use of End-of-Course results in high school course grades (The State Board is expected to discuss in December the establishment of a “safe harbor” year for accountability measures. The Board may vote not to hold back third graders based on their reading scores on the Az. MERIT for school year 2014 -2015) 12/12/2021 Tempe School District 29

What is coming from ADE üList of available testing accommodations for paper-based and computer-based testing (detailed guidance will follow) üComputer-based practice items specific to Az. MERIT will be available in January. üPre-test Training by ADE for Coordinators (January 26 Airport/Tempe) üInformational Conference for school and district administrators 12/12/2021 Tempe School District 30

AIMS 2015 Science Test Schedule Testing: March 25 Make-up: March 26 -27 12/12/2021 Grades Approximate Times 4 and 8 2 hours Tempe School District 31

TD 3 Advantages for online testing • Students used to taking tests online • Students exposed to a variety of technology enhanced items • Lab Techs and teachers can leverage skills learned on Web. MAP • Excellent technology infrastructure and technical support 12/12/2021 Tempe School District 32

WHAT CAN WE DO TO PREPARE NOW? 12/12/2021 Tempe School District 33

Standards • Continue teaching the standards 12/12/2021 Tempe School District 34

Review the blueprints 12/12/2021 Tempe School District 35

Make use of Sample Items/Tests • Interactive resources are currently available on the ADE website. ADE Assessment Support Materials • SAGE Training Tests http: //sageportal. org/training-tests/ • AIR Innovative Item Types http: //demo. tds. airast. org/AIRAssessment • Az. Merit computer based items in January 12/12/2021 Tempe School District 36

Keyboarding • Two free resources available that will provide reports on accuracy and words per minutes for the teachers, while providing specific practice on correct finger placement in EPIC, under Technology > Keyboarding: 12/12/2021 Tempe School District 37

Writing on computer • Have students complete: – a Thinking MAP to organize their thoughts – a final draft of a paper on a computer • Have students do a sample writing task on SAGE – http: //sageportal. org/training-tests/ 12/12/2021 Tempe School District 38

Attend Trainings • Az. Merit Overview by Research, Evaluation and Assessment for District and School Administrators, IE Staff, Test Coordinators and Coaches – Could be January 28 or February 23, Board Room 2 -4 pm (date depends on information available) – Lab assistants and School Support /IT 8 -10 am • Bustoz Main conference room Jan 28 • Board room Feb 23 • March 17 Pre-test workshop, Board Room 3 -6 pm • ADE informational meetings in January – Watch for email from ADE, possibly Friday December 12. 12/12/2021 Tempe School District 39

Testing platform • Become familiar with the AIR testing platform – View videos 12/12/2021 Tempe School District 40

Test Schedule • When you know your testing format, begin discussions and planning for a testing schedule – Who, when, how? – What support might you need? 12/12/2021 Tempe School District 41

Understand the Challenges Ahead: Timeline

Challenge: The Percent Passing Will Drop

Challenges Ahead: Test Scores Late • The Az. MERIT test needs to be scaled once we get results back and cut points for passing and other performance levels need to be set. • This is summer work and the ETA for results is in September.

What is our role moving forward? • Be flexible • Know there will be glitches and work through them – Pitch In • Prepare your students, staff and system (e. g. , technology) for the new test • Expect lower scores because of increased expectations • Communicate to your community and constituent groups the importance of raising expectations and the long term benefits to our students and society

State Assessments 2015 Q&A 1. Are there any sample items of accommodations offered to special needs students in the computer based testing? NO. This information will be posted as soon as it is available. 2. How can students prepare for the computer-based testing? Interactive resources are currently available on the ADE website. ADE Assessment Support Materials Computer-based practice items specific to Az. MERIT will be available by February 2015. 12/12/2021 Tempe School District 46

State Assessments 2015 Q&A 3. Do you know if the Paper-based assessment option will be offered next school year (2016) too? Yes, but each school needs to be working on getting ready. computers 4. Are we going to be allowed to test some grades online and other grades on paper and pencil in one school? NO. Each school must either select all paper tests or all online tests. 12/12/2021 Tempe School District 47

State Assessments 2015 Q&A 5. During the administration of the computer-based assessment: a) What is going to be the student login? ADE. We will provide this information when it is available. b) Are there any number of attempts for student login before the student is locked out? ADE. We will provide this information when it is available. c) Any of the assessments administration require headphones/ microphones? Yes. 12/12/2021 Tempe School District 48

State Assessments 2015 Q&A 6. Is there a product or software that is highly correlated with Az. MERIT that can help students to practice through the year? ADE. We will provide this information when it is available. 7. Is there going to be an Az. MERIT computer-based Pilot testing? NO. There is not pilot testing. 8. Is there a Plan B in computer-based testing in case technology doesn’t work properly the day of testing (ie. Host sever at Az. MERIT crashing, software not working, etc. ? ADE. We will provide this information when it is available. 12/12/2021 Tempe School District 49

State Assessments 2015 Q&A 9. For Az. MERIT computer-based testing. It's going to be a required schedule with a sequence of subject areas that need to be tested during the testing window (with AIMS, the first day was writing and science, the following day was reading and math, etc. ) YES. This information will be provided once we get the results of a survey. Remember the testing sessions for both modes (paper and computer-based) will be the same. 12/12/2021 Tempe School District 50