Winter 2005 MEAP Test Administration Thursday January 6

Winter 2005 MEAP Test Administration Thursday, January 6, 2005 1

Edward Roeber Senior Executive Director, Office of Educational Assessment & Accountability Welcome and Overview 2

Highlights § § § § Preparations for 2005 -2006 Revisions to MEAP Reporting Select Future OEAA Contractors MEAP Listserv Professional Standards for Assessment High School Testing Dates Combined OEAA Technical Advisory Committee 3

Highlights § § § § High School Reform Committee Cherry Commission High School Assessment Program Changes Ungraded Students Changes to Education YES! Revised School Performance Indicators Questions during the video conference 4

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 5

Michael Radke Supervisor, Michigan Educational Assessment Program Winter 2005 Test Designs 6

Winter 2005 MEAP § Operational assessments with embedded field testing: w all students and all schools § Freestanding field tests: w students within selected schools 7

Winter 2005 Operational Assessments § ELA: 4 th and 7 th grades § Mathematics: 4 th and 8 th grades § Social Studies: 5 th and 8 th grades § Science: 5 th and 8 th grades 8

Winter 2005 Operational Assessments § Embedded field test items: Multiple choice items, and/or w Constructed response or extended response items w § Encourage all students to do their best on all items 9

Winter 2005 Freestanding Field Tests § ELA: Grades 3, 5, 6 and 8 § Mathematics: Grades 3, 5, 6 and 7 § Only in schools selected for field testing § Administer consistent with standard MEAP testing principles § Teachers complete FT feedback forms 10

Winter 2005 Freestanding Field Tests § Provide item information to teacher review teams: § What happens to field-test items? w w w Selected for future operational tests Sent back for revision and more field testing Rejected § Encourage all students to do their best on all items 11

English Language Arts Update: Winter 2005 Operational assessments § Writing, reading and optional listening § 4 parts including embedded field test items § 35 -55 MC items, 2 -3 CR items § Parts must be administered in order 12

Winter 2005 ELA § Freestanding field tests at grades 3, 5, 6 and 8 w w Writing and reading components 3 -4 parts Up to 60 MC items, 1 to 3 CR items Grade 3 students answer in TEST BOOKLET 13

English Language Arts Design For FALL 2005 § Continue use of authentic texts § Increase number of texts, items and points § Use theme for one pair of passages; discontinue use of single theme across entire ELA assessment § Second, shorter Writing item and Writing MC items added § Sections administered in any order 14

Reading Tests for FALL 2005 § One or more narrative texts with MC items § One or more informational texts with MC items § Two or more passages with comprehension and cross-text MC items § Word Study MC items § Response to Reading CR item § Field test and linking items 15

Writing Tests for FALL 2005 § One extended Written Response item § One brief Written Response item § MC Writing revising and editing items § Field test items 16

Mathematics Update: Winter 2005 § Operational assessments at 4 th grade and 8 th grade § 3 parts including embedded field test items § 54 to 57 MC items, 3 CR items 17

Winter 2005 Mathematics freestanding field tests § Administered at grades 3, 5, 6 & 7 w w w 3 parts 46 to 53 MC items, 0 to 4 CR items Grade 3 students answer in TEST BOOKLET § Content is based on the grade level content expectations 18

Mathematics Tests for FALL 2005 § Five components: w w w Core assessment (up to 24 GLCE’s) Extended core (other GLCE’s at each level) Future core (GLCE’s formerly at higher grade levels) Replacement items (to field test and replace above) Linking items (from higher/lower grade) § Approximately 2 hours 19

Science Update § Winter 2005 operational assessments include embedded field test items § Winter 2005 content and format is unchanged § Science teachers and leaders meeting with MDE w w w Standards and Benchmarks are being “unpacked” Content expectations are being created Future test design yet to be finalized 20

Social Studies Update § Winter 2005 operational assessments include embedded field test items § Winter 2005 content and format is unchanged § State Board task force recommendations received § Grade level content expectations being finalized § Add Revolutionary war period to 6 th grade and Civil war period to 9 th grade fall 2005 tests 21

Future MEAP results reporting § Reports being redesigned with parent and educator input § Improve timeliness: Is four weeks possible? § Provide more valuable information to help each student and to guide instruction, curriculum and professional development § Release (core) items starting next year, Fall 2005 § Provide growth scores 22

Future with MEAP § 2004 -5 (this year) w HST legislation creates Michigan Merit Examination (MME) § 2005 -6 w w Grades 3 -8 assessments in ELA and Math Fall 3 -9 assessments and new performance level cut scores established for ELA, Math, science and social studies Social studies and science: Redesign and field testing High school alignment studies: MEAP to MME 23

Future with MEAP and MME § 2006 -7 w w Implement new social studies (6 th & 9 th) and science assessments (grades 5, & 8) High school: final MEAP (12 th grade only) and new MME § 2007 -8 w High school: MME fully implemented 24

The future with MEAP and MME § Move toward integration of administration w Coordinate assessment for general education, SWD and ELL students w Coordinate pre-ID registration: CEPI based w Closer link between assessments and accountability § Implement proposed changes then stabilize, monitor and tweak to improve 25

Comments and Suggestions Mike Radke. M@mi. gov (517) 241 -0206 Michigan Department of Education 608 W. Allegan St. P. O. Box 30008 Lansing, MI 48909 26

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 27

Jim Griffiths Manager, Test Administration & Reporting Dave Judd Senior Business Project Manager Test Administration and Secure Web Site Enhancements 28

Winter 2005 MEAP Test Cycle Materials due in districts January 10, 2005 Testing Dates January 24 to February 11, 2005 Deadline return of all materials February 18, 2005 Tested Roster posted March 11, 2005 Test results available April 2005 29

Receipt of Materials § Check in materials ASAP § Additional materials request form (Pg 9 in administration manual) § Multiple forms of assessments – field test § Form 1 – Use for accommodated versions of the test 30

Test Administration § Who tests? All students in grades 4, 5, 7, and 8 w Students in ungraded programs w Students who are repeating a grade are to be tested again w Stand-alone field tests in selected schools in grades 3, 5, 6, 7, 8 w 31

Test Administration § Winter Test Administration Manual § Keep test booklets and answer documents secure § Test monitoring to avoid potential problems § Improper use of highlighters and pens § Importance of sticking to the script § Accommodated versions – Form 1 32

Test Administration § No additional sheets § No copying or retaining of student answer folders § Use of MEAP scores for other purposes § Less than Full Academic Year § Scheduling sufficient time for a complete session § Field testing 33

Testing Practices § § § Irregularities Prevention Limits of assistance No debriefing of teachers and students No person other than testing students may be allowed to take or review the tests § No copying of answer folders or test booklets § Use of unethical practice bubble 34

Testing Practices § Administrative Errors/Unethical Practices (Pg 18 – 19 in manual) § Self - Reporting § Districts responsible for direct costs of providing and scoring emergency tests 35

Report Codes § § Not Tested – Absent Home Schooled Formerly LEP How are parent exemptions handled? There are none. 36

Student Roster Step 1 After signing in to the secure site, click on Student Roster from the menu at the left. 37

Student Roster - Continued Step 2 After selecting ISD, district, school and test cycle, you have option to view or download the student roster. 38

Tested Roster Step 1 Click on the Tested Roster link, on the left side of the web-page. 39

Tested Roster - Continued The following page will appear: Step 2 Select ISD, District, School and Test Cycle from the drop downs. Then click the Search button. You can filter by many different demographic fields. 40

Tested Roster - Continued Step 3 - Verify that all students that tested are accounted for. Look for duplicate students, students who tested at other schools, and missing students. 41

Tested Roster - Continued • For duplicate students, you may enter a “Combine” request • For students who did not test at your school, you may enter a “Move Student” request • For missing students, you may enter a “Missing Student” request 42

Student Demographic Changes Making changes to Student Demographics. You can update student demographics through the tested roster page by simply clicking on the student’s name in blue. This will take you to the student’s demographic page where you can make additions or corrections. 43

Roster Issues You can view the status and outcome of your request on the Roster Issues page. Step 1 Click on the Roster Issues from the menu at the left of the page. 44

Roster Issues - Continued Step 2 To generate a list of issues that were submitted for your school (district) to the MEAP office from the tested roster, select the Test Cycle, your ISD, District and School. Then click the Search button. 45

Barcode Labels You should print barcode labels for all students that did not come pre-identified. Step 1 Click Barcode Labels from the menu on the left on the web page. You should then see this: 46

Step 2 Barcode Labels - Continued To generate a list of all the students assigned to the given test cycle, select from the drop down menus the ISD, District, School, Grade and Test cycle. Then click the Search button. Step 3 Above the list of student names, you have the option to select the number of labels that you want to print for the selected students and also the starting position on the labels. 47

Barcode Labels - Continued You may use the Select All button to select all of the students listed. If you are missing a student from your list, doublecheck your search criteria. Step 4 When you have selected the students and are ready to print, click the Submit button. Adobe Acrobat will open a new window and display an image of your labels. Step 5 If everything looks correct, click on the printer icon, which normally is located near the top left corner of 48 the window.

Barcode Labels - Continued On the Printer Dialog window that appears next, ensure the shrink oversized pages or fit to page (depending on your version of Adobe) option is NOT checked. If you have an auto-rotate and center pages option, please make sure that is checked. Step 6 Click on OK to print. 49

Mass Demographics Update You can use the Mass Demographic Update function during the pre-identification process, during testing, or after testing through the end of the tested roster period. Step 1 Click on the Mass Demo Updates to the left on the web page. The following page will be displayed: 50

Mass Demographics Update – Cont’d Step 2 To generate a list of all the students assigned to a given test cycle select your ISD, District, School and the Test Cycle from the drop downs. Then click the Search 51 button.

Mass Demographics Update – Cont’d Step 3 After performing your search, a new section to the page will appear called Update Fields, followed by the students in your search results. This section is where you will indicate what demographic data you wish to change for a selected group of students. 52

Mass Demographics Update – Cont’d Decide first which demographic data you are going to change. For example, to update less than a full academic year (LTFAY), select the students who have been in the school for less than a full academic year by clicking on the checkbox to the left of the student’s name (the first column). Once you have selected all the students, ensure that the LTFAY field in the Update Fields Section is marked ‘Yes’, then click on the Save button and these students will now be marked in the database as LTFAY. You do this for all demographic data listed on the page. 53

Return of Materials § Organization § MEAP vs Stand Alone Field Tet § Returning blank or nearly blank answer folders – how are they scored? 54

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 55

Marilyn Roberts Director, Office of Educational Assessment and Accountability Assessment Of English Language Learners 56

Who is an English language learner (ELL)? § ELL is recognized as acceptable replacement for the term Limited English Proficient (LEP) § LEP Definition on Page H-3 of the MEAP Administration Guide 57

What are the Title I Assessment requirements for ELL students? § All LEP students are to be tested annually in mathematics and reading/language arts. 58

What are the Title I Assessment requirements for ELL students? § Assessments are provided in native languages, where possible. § In Michigan, Accommodations have been expanded to provide broader access to assessments published in English. 59

English language learners: Who can be exempted from taking MEAP assessments? 60

ELL students enrolled in US School for less than 1 year— § May be exempted from the MEAP ELA assessment if assessed with an ELP test. § ELP participation counts towards 95% participation for AYP. § Must participate in MEAP Math. Performance will not count for AYP. 61

What are the MEAP Accommodations for ELL? § Standard ELL Accommodations are listed on pages 11 through 16 of the MEAP Administration manual. § Those marked with a diamond apply to ELL students. 62

What are the MEAP Accommodations for ELL? Scheduling --Additional testing time --Frequent or extended supervised breaks --Administration of test at a beneficial time to the student 63

What are the MEAP Accommodations for ELL? Location --MEAP administration in an English as a Second Language (ESL) Classroom 64

What are the MEAP Accommodations for ELL? MEAP Directions --Read in English --Read in native language if ELL student is receiving native language instruction at least part of the time 65

What are the MEAP Accommodations for ELL? MEAP Directions --Student restatement of directions in own words --Clarification of directions by asking students to restate them 66

What are the MEAP Accommodations for ELL? During MEAP Assessment --Administration by ESL Staff --Reading the Math, Social Studies, Science & Writing assessment content and questions in English or Student’s native language (provided that the student receives native language instruction part of the time) 67

What are the MEAP Accommodations for ELL? During MEAP Assessment --Use of bilingual word-for-word translation dictionary (no dictionaries that define or explain words or terms) 68

How are Formerly Limited English Proficient (FLEP) students reported for AYP? § Students who are classified as FLEP can be included in ELL student groups for two years 69

Contacts Mazin Heiderson. M@mi. gov (517) 373 -6066 Marilyn Roberts. M@mi. gov (517) 335 -0567 Michigan Department of Education 608 W. Allegan St. P. O. Box 30008 Lansing, MI 48909 70

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 71

Newly Revised Professional Assessment & Accountability Practices for Educators 72

Why are there newly revised assessment & accountability practices? § Establishes standards for educators who administer assessments and report results § State Board of Education Approval, November 2004. 73

How were the newly revised assessment & accountability practices developed? § Guidelines provided by professional organizations (AERA, APA, NCME) § Field representatives, ISD staff, administrators, teachers, students 74

Location of the Newly Revised Document § Electronic versions of the newly revised Professional Assessment & Accountability Practices for Educators can be accessed at: www. michigan. gov/meap § Hard copy version will be delivered to each public school building 75

How is the new document organized? § Roles and Responsibilities (before, during, after assessment) § Assessment Security § Assessment Administration § Irregularities 76

Roles and Responsibilities § District Assessment Coordinator § Building Assessment Coordinator § Assessment Administrator § Assessment Proctor Adjustments in designated roles depend on district size and needs 77

District Assessment Coordinator Highlights § Develop a districtwide assessment plan § Train Building Assessment Coordinators § Report any irregularities or administrative procedure errors to OEAA immediately § Return all materials according to timelines 78

Building Assessment Coordinator Highlights § Develop & disseminate an assessment plan (schedule, staff, accommodations) § Conduct inventory & secure materials § Clear rooms of materials that provide assistance to students § Ensure that answer docs are filled in correctly 79

Assessment Administrator Highlights § Current or past holder of certificate § Read the Assessment Administrator Manual prior to the start of MEAP § Read directions exactly as they appear in the manual § Remind students to turn off electronic devices and put away 80

Assessment Proctor Highlights § Teacher’s aide, paraprofessional, or other paid or school personnel § Read directions exactly as they appear in the manual § Remind students to turn off electronic devices and put away 81

Assessment Security Highlights § Keep assessment materials in a locked and secure location § Refrain from examining actual assessment items or discussing items with colleagues 82

Assessment Security Highlights § Use or retain booklets or answer documents for any purpose § Read student responses after assessments or attempt to score items 83

Assessment Security Highlights § Keep assessment materials in a locked and secure location § Refrain from examining actual assessment items or discussing items with colleagues 84

Assessment Preparation Highlights Do— Incorporate subject area objectives in the local curriculum throughout the year. 85

Assessment Preparation Highlights Do— Integrate and teach assessment-taking skills in regular classroom instruction Create a positive assessment-taking environment 86

Assessment Preparation Highlights Do not— Use secure, unreleased or altered questions for practice Use assessments of the same content as state assessments 10 days prior to test window 87

Assessment Administration Highlights Do— Closely supervise the assessment process Read oral instructions verbatim Train students with appropriate assessment practices 88

Assessment Administration Highlights Do not— Alter or transfer a student’s response (unless prescribed by IEP or 504 Plan) Schedule a break during an individual assessment session. 89

Types of Irregularities § Allegations/complaints § Accountability data § Assessment data irregularitiesscoring alerts 90

Irregularities: Possible resolutions Report any possible irregularity to OEAA immediately— 3 scenarios 1 -Irregularity resolved. No action 2 -Irregularity did not jeopardize assessment – recommendation for corrective action 3 -Irregularity verified – possible consequences 91

Contacts for Ethics Issues Jim Griffiths P. O. Box 30008 Lansing, MI 48909 griffithsj@mi. gov (517) 373 -4322 Marilyn Roberts robertsm@mi. gov (517) 335 -0567 92

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 93

Peggy Dutcher Coordinator, Assessment for Students with Disabilities Program MEAP Assessment Accommodations 94

MEAP with Assessment Accommodations § Special education students and Section 504 students § ONLY the IEP Team or 504 Plan team can determine accommodations 95

MEAP with Assessment Accommodations § MEAP Manuals w Test Admin. Manual: Pages 11 – 16 w Coordinator Handbook: Pages D-1 thru D-6 www. mi. gov/meap 96

Standard Accommodations § Do NOT change the construct being assessed § Scores DO count towards NCLB participation rate and AYP 97

Nonstandard Assessment Accommodations § DO change the construct being assessed § Scores are NOT eligible for the Merit Award 98

Nonstandard Assessment Accommodations New! Student will count as NOT ASSESSED! 99

State Provided Assessment Accommodations Braille w Bubble in “Sp Ed Braille” on the answer folder & Large Print Bubble in “Sp Ed Large Print” & 100

State Provided Assessment Accommodations CDs or Audio tapes - Page D-4: Coordinator Handbook ²MUST be administered individually!!! ²Bubble in Sp. Ed. Audio § Ordering information: Page 9 of the Test Administrators Manual 101

Scribes, Tape Recorders, and Braille Writers § Page D-5 from Coordinator Handbook § A school staff member MUST transcribe into answer folder § Spelling, punctuation, indentation and so forth MUST be transcribed EXACTLY 102

Word Processors § Page D-5 from Coordinator Handbook § Spell check, grammar check, dictionary, and thesaurus MUST be deactivated § Do NOT need to be transcribed 103

Returning Word Processed Documents § EACH page MUST have: • Birth date • Student MIT number • District name and code • School name and code • Testing window • Student name • Grade • Content area 104

Returning Word Processed Documents § Insert in completed student answer folder § Do NOT staple, tape, paper clip, or glue to answer folder § Envelope with bright orange label – “Special Handling/Word Processed” § Put on top of materials in “ 1 of X” box being returned 105

Rapid Onset of Medical Disability § Such as w w Broken arm Undergone surgery and is homebound § Document in student’s file w w w Disability Accommodation provided Bubble in “Standard accommodation” 106

MEAP Field Test § NO IEP? § Accommodations? 107

Contact Information Peggy Dutcher Coordinator, State Assessment for Students with Disabilities 8 Dutcherp@mi. gov ' (517) 241 -4416 108

Questions during the video conference… Email: answers@resa. net FAX: 734 -334 -1857 109

Thank you! § Video conference sites around Michigan § Wayne RESA § TCOM Consortium, Mistreamnet and the Sustained Learning Regions § Sam Lo. Presto § Presenters and staff § And You! 110

§ VHS Copies: $10. 00 + $4. 00 S & H DVD Copies: $15. 00 + $4. 00 S & H Contact: Brenda Hose, 734 -334 -1437 hoseb@resa. net § Rebroadcast archived at http: //www. mistreamnet. com § Powerpoint and attachments available on MEAP website: www. michigan. gov/meap 111