Academic Return on Investment Final Presentation West Saint

Academic Return on Investment: Final Presentation West Saint Paul, Mendota Heights, Eagan School District - 197 Leveled Literacy Intervention (LLI) A-ROI TEAM: NANCY ALLEN-MASTRO, SUPERINTENDENT MARCY DOUD, DIRECTOR OF SPECIAL PROGRAMS CARI JO KIFFMEYER, DIRECTOR OF CIA BRIAN SCHULTZ, DIRECTOR OF FINANCE [In

The goal for students receiving the LLI intervention curriculum is to be reading at grade level by the end of the school year. Leveled Literacy Intervention (LLI): Description and Definition of Success Program Description • LLI is a small group, supplemental intervention designed for children who have reading and writing difficulty. • LLI teachers provide explicit instruction in phonemic awareness, phonics, early reading behaviors, comprehension, fluency, and vocabulary. • LLI is being used in tiered intervention programs (Basic Skills, Title One, and ADSIS), English as a Second Language Program, and Special Education. Definitions of Success Metrics Kindergarten 1 st Grade 2 nd Grade 3 rd Grade 4 th Grade LLI Progress Monitoring (PM) Min. 3 Instructional LLI Recording Forms/Assessments Min. 3 Instructional LLI Recording Forms/Assessments BAS Spring Criteria Instructional Level D Instructional Level J Instructional Level M Instructional Level P Instructional Level S Meets NWEA RIT Spring Reading N/A 182 195 205 214 2

LLI is most effective as a Tier II Intervention. Leveled Literacy Intervention (LLI): Analysis Results Overall, how well did the program perform? • Although most students in LLI did not meet targets for reading on MCA scores, overall 41% of students met the aggressive growth target on MAP (spring to spring). For whom did the program work best? • Students who were 0 -0. 9 years behind in reading as measured by the BAS, had higher rates of achievement on the reading MCA test than students further behind in reading. For whom did the program have the least impact? • Approximately 3% of special education students met their expected MCA scores in contract to the 15% of general education student who met their expected MCA scores. Per Pupil Cost SY 14 -15: $3, 033 SY 15 -16: $3, 108 What were the key factors in the cost per student? • • • Salary and benefits equal 1. 4 million for the 14 -15 school year Material/ supplies start up costs equal $154, 310 Each LLI teacher needs at least 10 hours of training to meet proficiency on the QFIC Fidelity Rubric. 3

To increase student outcomes, modification of the LLI program is needed. Leveled Literacy Intervention (LLI): Recommendations for Action Recommendation 1 2 3 Analysis driving recommendation Measuring impact A deep dive into the growth data, specifically those students that made 150% of growth or more. Although most student segments did not met targets on MAP and MCA, 41% of students met aggressive growth targets on MAP. The ability to identify students for whom LLI is most effective as an intervention curriculum. Discontinue using the Benchmark Assessment System (BAS) as a measure of the program’s effectiveness. The varying reliability of teacher implementation along with contrasting results with the MAP, indicates that the BAS should only be used to guide instruction. Results that are consistent and reliable for future recommendations. Analyze and revise the QFIC Fidelity Rubric. Teachers with over 90% implementation on the QFIC Fidelity Rubric did not produce higher outcomes on students meeting expected targets. The ability to identify structural components, pacing, and instructional strategies that increase the program’s effectiveness. 4