Intro to aimsweb Plus Secondary Edition September 20

+ Intro to aimsweb Plus (Secondary Edition) September 20, 2016 Jane Sturgell, S. Psy. S. , NCSP School Psychologist & MTSS Consultant

+ Today’s Agenda Overview of Admin / Scoring aimsweb Plus assessments 1. n n Online assessment (Test. Nav) Digital Record Form (DRF) 2. Adding Survey Level Assessments 3. Adding Monitoring / Goals

OVERVIEW of AIMSWEB PLUS • • • All NEW measures with strong technical adequacy “Digital record forms” for Kindergarten / First Grade “Digital record forms” for Oral Reading Fluency (Grades 1 -8) Online, Group administered assessments for Grades 2 -8 in “Test Nav” Eliminates paper / hand scoring Eliminates calculating raw scores Eliminates data entry! Reporting capabilities

Estimated Benchmarking Time for Fall aimsweb Plus n Benchmarks Grade Reading Math 7 *10 -15 minutes/class 25 -35 minutes/class 8 *10 -15 minutes/class 25 -35 minutes/class * All measures in grades 7 -8 are completed whole group on i. Pad except Oral reading Fluency

SEVENTH GRADE Fall Reading • • • SRI aimsweb Plus Vocabulary SBA (student identifies meanings of words – multiple choice, untimed – 4 -8 minutes in Test Nav) aimsweb Plus Silent Reading Fluency (student reads 3 stories divided into 4 parts and answers multiple choice questions about each story in Test Nav – untimed – 4 -6 minutes) M-Step (Fall only) Fall Math • • • aimsweb Plus Number Comparison Fluency – Triads (student mentally solves multiple choice magnitude problems for 3 minutes in Test Nav) aimsweb Plus Mental Computation Fluency (student solves multiple choice math computation problems for 4 minutes in Test Nav) aimsweb Plus Concepts & Applications SBA (student mentally solves various types of math problems in Test Nav, untimed - 7– 25 min) M-Step (Fall only)

EIGHTH GRADE Fall Reading • • • SRI aimsweb Plus Vocabulary SBA (student identifies meanings of words – multiple choice, untimed – 4 -8 minutes in Test Nav) aimsweb Plus Silent Reading Fluency (student reads 3 stories divided into 4 parts and answers multiple choice questions about each story in Test Nav – untimed – 4 -6 minutes) M-Step (Fall only) Fall Math • • • aimsweb Plus Number Comparison Fluency – Triads (student mentally solves multiple choice magnitude problems for 3 minutes in Test Nav) aimsweb Plus Mental Computation Fluency (student solves multiple choice math computation problems for 4 minutes in Test Nav) aimsweb Plus Concepts & Applications SBA (student mentally solves various types of math problems in Test Nav, untimed - 7– 25 min) M-Step (Fall only)

Overview of aimsweb Plus n http: //www. aimswebplus. com n Customer ID: 4982 User Name: Jane. Sturgell Password: Auto-generated n n

Why use General Outcome Measurement? n Medicine measures height, weight, temperature, and/or blood pressure n Federal Reserve Board measures the Consumer Price Index n Wall Street measures the Dow-Jones Industrial Average n Companies report earnings per share n Mc. Donald’s measures how many hamburgers they sell

+ Curriculum-Based Measurement n CBM is one type of Curriculum-Based Assessment. n n CBM is a standardized set of methods for assessing students’ skills in different areas. n n CBA is the direct assessment of what is taught in the classroom. Reading, Spelling, Mathematics and Writing Most helpful in lower elementary grades and struggling learners through grade 8 n Oral Reading Fluency is the single best predictor of general reading achievement through 8 th grade

Overview of the Measures n n “How Can We Help” Measures Videos How To’s

Number Comparison Fluency – Triads (Group) n n n Second Grade to Eighth Grade Student mentally solves MC math problems, each requiring assessment of magnitude while comparing a set of three numbers, for 3 minutes on the i. Pad 2 practice items (self-paced)

Mental Computation Fluency (Group) n n n Second Grade to Eighth Grade Student mentally solves math computation problems for 4 minutes on the i. Pad 2 practice items (self-paced)

Concepts & Applications (Group) n n Kindergarten to Eighth Grade Benchmark ONLY Student solves various types of math problems (1: 1 in K/1 and on the i. Pad in 2 -8) – untimed but estimated to take 7 -25 minutes 1 practice item

Oral Reading Fluency (1: 1) n n First Grade to Eighth Grade For Benchmarking - Student reads TWO stories aloud, for one minute each

Vocabulary (Group) n n n Second Grade to Eighth Grade Student identifies the meanings of target words (MC on i. Pad), untimed but estimated to take 4 -8 minutes 1 practice item & Grade 2 = 18 questions, Grades 3 – 8 = 24 questions Audio available for all students (directions / text) Student can go back to change responses Benchmark ONLY

Silent Reading Fluency (Group) n n n n Fourth Grade to Eighth Grade 2 practice items Directions only able to be read aloud Student reads three stories, each divided into four brief sections and answers MC questions about each story on the i. Pad – untimed but estimated to take 4 -6 minutes Student cannot go back to change answers (system indicates whether each question was correct or incorrect) The time students spend on each screen is captured to determine reading rates for each story Student cannot go back to change a response

Silent Reading Fluency (Group)

Passage Reading Comprehension SBA (Group) n n n Second Grade to Eighth Grade Benchmark ONLY Student reads six passages of text and answers 4 MC questions about each passage on their i. Pad – untimed, but estimated to take 15 -25 minutes (24 questions total) Students are able to go back to correct a response Text is visible when answering questions

Passage Reading Comprehension SBA (Group)

+ What questions might you have so far?

Administration: General Considerations n n Altering instructions or presentation of test forms, providing hints, giving corrective feedback or using test forms as teaching tools will invalidate results 1: 1 & Online testing completed in a quiet space (limited distractions) 1: 1 – position yourself so you are across from a student at a small table or the corner of a larger table If testing is spoiled (interrupted during fluency measures), students can retake the test a few days later

Administration: General Considerations n Accommodations – changes made to test setting, timing, presentation format or response format that minimize obstacles to perceiving / respond to test content WITHOUT changing the test – are permitted n n Test. Nav – has a menu of special accommodations tools / features for SWD (contract settings, magnifier, answering masking, show / hide line reader ORF – enlarging / modifying Special lighting, adaptive furniture, etc. Modifications – changes made to the testing process or content – are not permitted n n n Hints Corrective feedback Extended time on timed measures (ORF, MCF, etc. )

Administration: Math Grades 2 - 8 n n n No calculators are permitted on any measure Number Comparison Fluency – Triads (NCF-T) & Mental Computation Fluency (MCF) are fluency measures with strict time limits Concepts & Applications (screening only) n n n Students are allowed scratch paper and pencil Untimed Audio available

Administration: Math Grades 2 -8 n Online measures (NCF-T, MCF and C&A) – all test directions & content are presented on i. Pad using the Test. Nav app (Self-Service) n n Each student will need headphones / ear buds (have student test audio before beginning) Examiners present and supervise (proctor) sessions

Administration: Math Grades 2 -8 n NCF-T – comparison of a set of 3 numbers. Student determines if the top number in the triad is closer to the value of the bottom left number, the bottom right number or exactly in between the numbers n n MCF – 1 or 2 step mental computation problems n n Directions / audio included 2 practice items Attempts as many as possible for 3 minutes (max 40 items – 4 items per screen) Directions / audio included 2 practice items Attempts as many as possible for 4 minutes (max 42 items – 2 items per screen) Scoring Rules: NCF-T is combined with MCF and reported as a Number Sense Fluency (NSF) score (40 points max)

Administration: Math Grades 2 -8 n C&A – one & two step word problems n n n 1 practice item No time limit Student attempts all items Allowed to use scratch paper / pencil to solve test items Audio is available 29 -31 items (depending on grade)

Math: Online Test Sessions n n n Encourage students to take any bathroom or water breaks before testing begins Consider using a DND sign Be an active proctor n n n n Do not allow students to talk Address questions individually by going TO the student with a question Do not answer any questions about the test items themselves Encourage students to answer test items based on what they think each item is asking and to the best of their abilities Students should complete each assessment at his / her own pace Test sessions consist of several sections. Be sure each student completes all sections assigned Read script (found in Appendix A in Administration & Scoring Guide) n Walk around the room to make sure students are progressing through the test and answer any questions that arise (students should remain seated)

Administration: Reading Grades 2 -8 n Online measures (VO, RC, SRF) – all test directions & content are presented on i. Pad using the Test. Nav app (Self-Service) n n n Each student will need headphones / ear buds (have student test audio before beginning) Examiners present and supervise (proctor) sessions Oral Reading Fluency – examiner uses a DRF to admin / score, but students need a stimulus book (2 stories each for benchmarking) n n Directions pop up / stop watch built in Score as you go including SC and score is automatically generated

Reading: Online Test Sessions n n n Encourage students to take any bathroom or water breaks before testing begins Consider using a DND sign Be an active proctor n n n n Do not allow students to talk Address questions individually by going TO the student with a question Do not answer any questions about the test items themselves Encourage students to answer test items based on what they think each item is asking and to the best of their abilities Students should complete each assessment at his / her own pace Test sessions consist of several sections. Be sure each student completes all sections assigned Read script (found in Appendix A in Administration & Scoring Guide) n Walk around the room to make sure students are progressing through the test and answer any questions that arise (student should remain seated)

Oral Reading Fluency (ORF) n n n n n MUST complete online portions (Grades 2+) before you can assess ORF 1: 1 using a Digital Record Form (DRF) - just like AIMSweb 1. 0 Live) Directions appear in bold on screen Preview student passage to make sure it matches Begin when student begins reading Allow 3 seconds for the student to respond (timer in top right corner) Allow 10 seconds for student to sound out / subvocalize before saying the word and marking it incorrect Mark skipped lines, but do not redirect or give corrective feedback If student self-corrects within 3 seconds, record response as correct (reclick word)

ORF n n n “When I say Begin, start reading aloud at the top of this page. Read across the page (demonstrate by moving finger across the page). Try to read each word. Ready? Begin. ” After 1 minute, say “Stop” & record last word student read. For Benchmarking, have student turn to the second story page and say: “Let’s try another one. Be sure to do your best reading. Ready? Begin. ” n n Note: if a student finishes in less than one minute, click the pause button and select “Score Completed Form” from the pop-up menu Discontinue rule: if student reads 10 or fewer words on the first story, do not administer the second story. Click the pause icon and select “Discontinue Form” from the pop-up menu

ORF n n Words are incorrect if: n n n n A word is skipped Any sound in a word is mispronounced A different word is substituted A word is not read in its proper sequence An abbreviation is read rather than the full word it presents The student self-corrects after 3 seconds have elapsed, or No attempt is made within 3 seconds n n n Self-corrections made within 3 seconds Repeated words Inserted words Regional dialects, or Articulation disorders Do not penalize for:

To assess ORF: Open Digital Record Form n Click “Students” & “Benchmark Comparison”

ORF

ORF

aimsweb Plus Terms (PLAAFP & SLA) Percentile Range Descriptor Color 90 – 99 Well Above Average Blue 75 – 89 Above Average Turquoise 26 – 74 Average Green ***11 – 25*** ***Below Average*** ***Yellow*** 0 – 10 Well Below Average Orange PM slightly below proficient (Below Average range)