2010 2011 Assessment Data Management System ADMS Review

2010 -2011 Assessment Data Management System (ADMS) Review & Evaluation Conducted by the Assessment Data Management System Committee in collaboration with the Assessment, Research and Evaluation Department and Curriculum Council ADMS Recommendation_Board of Education_030111 1

2 ADMS Committee Recommendation ¡After a thorough review of our current provider and four potential replacement vendors, the ADMS committee strongly recommends the adoption of Illuminate Education as the provider of our district’s ADMS. Data Wise Performance Matters e. School PLUS (Performance Plus) Data. Director New Interface Total 1005 360 51 48 18 1482 Percent of Weighted Points Received 68% 24% 3% 3% 1% 100% Number of Ballots Ranked Number One 18 2 1 1 22 Percent of Ballots Ranked Number One 82% 9% 5% 5% 0% 100% Illuminate Education Weighted Points Received ADMS Recommendation_Board of Education_030111

3 Why Have an ADMS? ¡Facilitates teaching and learning by making student-centered information available to teachers and staff …. easily … and when it is needed. ¡ Classroom Assessments ¡ Demographic Lists ¡ Online K-6 Report Cards ¡ Placement and Intervention Eligibility Lists ¡ English Proficiency Identification and Fluency Reports ¡ California Standardized Test Reports ¡ Program Evaluation Reports ¡ District Assessments ADMS Recommendation_Board of Education_030111

4 Our Journey ¡LUSD has been using Data. Director, our current ADMS provider since March 2008. ¡Data. Director is scheduled to undergo a significant user interface change in the late summer that would require significant training of our district’s users. ¡Under Data. Director’s new management, customer service and system reliability quality has declined significantly. ¡Frequent down times for the system’s servers, especially at the end of each quarter, and programming errors have become the norm. ADMS Recommendation_Board of Education_030111

5 Our Journey ¡Our current contract for Data. Director expires on June 30, 2011. ¡In response to several wide-spread concerns regarding Data. Director, the Assessment, Research, and Evaluation (ARE) Department facilitated a review and evaluation of the district’s ADMS needs in collaboration with teachers, site instructional leaders, and district leadership teams ADMS Recommendation_Board of Education_030111

ADMS Review Timeline / Process Date Action September 2010 Vendor customer service issues, site concerns discussed at Instructional Leadership Team October 2010 Data. Director survey developed in collaboration with LEA November 2010 District ADMS review process formulated at Cabinet District ADMS review process shared at Curriculum Council ADMS Committee members, including teachers, administrators, technology, and ARE staff, recruited to make a recommendation regarding the replacement or extension of the contract with our current provider (see ADMS Committee Membership in Appendix) Potential replacement vendor demonstration by PERFORMANCE MATTERS* December 2010 Potential replacement vendor demonstration by DATA WISE* Potential replacement vendor demonstration by ILLUMINATE EDUCATION* Potential replacement vendor demonstration by SUNGARD (a. k. a. e. School. PLUS)* January 2011 Riverside Publishing cancels January 27 demonstration of new interface for Data. Director; demonstration postponed until March 1 (at the earliest) ADMS Committee members electronically polled and unanimously agree to continue on without Data. Director new interface demonstration ADMS meeting to discuss and rank vendors; recommendation received* *Each of these five meetings were scheduled for 2 hours from 3: 30 -5: 30 PM. ADMS Recommendation_Board of Education_030111 6

ADMS Review Timeline / Process (continued) Date Action February 2011 Recommendation shared with Cabinet and Curriculum Council Illuminate Education demonstrations at selected LUSD sites March 2011 Recommendation to LUSD Board of Education April 2011 Implementation process meetings held with vendor Begin data conversion scheduling May 2011 Data conversion and data import schedule finalized June 2011 Illuminate Education available in Lodi USD July 2011 Teachers receive initial training ADMS Recommendation_Board of Education_030111 7

8 Significant Features of Illuminate Education ADMS ¡Camera-based scanning resulting in cheaper printing costs, easier data entry, and increased student engagement. ¡Promotes student-centered assessments by allowing students to scan their own assessments and receive instant feedback ¡Provides more flexibility over the annual k-6 report card revision process ¡Facilitates nightly upload to ESP Grade book ¡Includes similar, but more user-friendly user interface over Data. Director ADMS Recommendation_Board of Education_030111

9 Related Tasks ¡Based on ADMS Committee recommendation, ARE staff has been conducting the following tasks: ¡Facilitate resale of Fujitsu fi-6130 scanners in collaboration with Purchasing Department ¡Verify web / document camera scanning options for short (20 question), medium (40 question), and long (100 question) assessments. ¡Determine proposed budget impacts ADMS Recommendation_Board of Education_030111

10 Related Tasks Sale of Existing Scanners ¡Conservative estimate provided by Purchasing is that LUSD could receive $500 per existing Fujitsu fi-6130 scanner ¡This amounts to $31, 000 based on the 62 verified units at school sites ¡Scanners to be sold at end of 2010 -11 or in early 2011 -12; the projected amount will be deposited into the district’s General Fund ADMS Recommendation_Board of Education_030111

Results of ARE Follow-Up Tasks Verify web / document camera scanning ability for assessments ¡ Short, medium and long assessments could be scanned simply by placing them on a Grade. Cam camera. ¡ This process has been successfully tested in classrooms at the following sites: Elementary Middle High Clairmont (Grade 3) Christa Mc. Auliffe (Grade 8) Lodi High (Grade 11) Heritage (Grade 6) Julia Morgan (Grade 6) Larson (Grade 3) ADMS Recommendation_Board of Education_030111 11

12 Related Tasks Proposed Budget Impacts ¡Assumptions ¡Gr K-1 teachers continue to hand-enter assessment data; cameras not provided ¡Cameras provided for: ¡ 446 Gr 2 -6 classroom teachers ¡ 179 Gr 7 -12 ELA teachers ¡ 124 Gr 7 -12 Math teachers ¡ 104 Gr 7 -12 Science teachers ¡ 113 Gr 7 -12 Social Science teachers ADMS Recommendation_Board of Education_030111

Related Tasks Proposed Budget Impacts 13 2011 -2012 Costs Related to Data. Director Illuminate Education $115, 050 $111, 203 $15, 000 (Est. for Report Card revisions) $28, 600 (Net costs after scanner sales and Camera purchases) 2011 -2012 Costs $130, 050 $139, 803 2012 -2013 Costs $115, 050 $111, 203 2013 -2014 Costs $115, 050 $111, 203 Annual Contract Net One-Time Funding Source: District Program Improvement Funds ADMS Recommendation_Board of Education_030111

14 Appendix ¡ADMS Committee Membership ADMS Recommendation_Board of Education_030111

15 ADMS Committee: Classroom Teachers Site Name (First - Last) Position Grade Level Cindy Mettler Classroom 9 -12 Lisa Fromm Classroom 6 Christa Mc. Auliffe Middle Charles Taylor Classroom 7 -8 Christa Mc. Auliffe Middle Martha Snider Classroom 7 -8 Chris Funge Classroom 3 Shelley Liechty Classroom 3 Nancy Gonzalez Classroom 1 Lodi High George Krukis Classroom 9 -12 Lois E. Borchardt Elementary Joe Velasquez Classroom 6 Manlio Silva Elementary Vanessa Eddy Classroom 2 Adriano Dobrescu Classroom 7 -8 Nichelle Bartlett Classroom 5 Tammie Rich Classroom 3 Ronald E. Mc. Nair High Amy Lundeberg Classroom 9 -12 Tokay High Jamie Anaforian Classroom 9 -12 Tokay High Mark Hughes Classroom 9 -12 Bear Creek High Beckman Elementary Ellerth E. Larson Elementary Julia Morgan Elementary Live Oak Elementary Morada Middle Oakwood Elementary Podesta Ranch Elementary ADMS Recommendation_Board of Education_030111

16 ADMS Committee: Coaches / Intervention / LEA President Site Name (First - Last) Position Grade Level Beckman Elementary Christina Dunn Coach k-6 Creekside Elementary Jennifer Plaster Intervention k-6 Oakwood Matt Hummel Intervention K-6 District Kathryn Odell Coach k-12 District Luann Casey Coach k-6 District Nanci Webber-Johnston Coach k-6 District Jeff Johnston LEA President 7 -12 ADMS Recommendation_Board of Education_030111

17 ADMS Committee: Site Administrators / ARE / Technology Site Name (First - Last) Position Grade Level Christa Mc. Auliffe Middle Randy Malandro Admin 7 -8 Clairmont Elementary Susan Hitchcock Admin k-6 Matthew Ray Admin k-6 Lois E. Borchardt Elementary Janis Morehead Admin k-6 Millswood Middle Sheree Flemmer Admin 7 -8 Martha Dent Admin 9 -12 District Debra Ladwig ARE k-12 District Ed Eldridge ARE k-12 District Jim Sherblon ARE k-12 District Susan Martin Technology k-12 Erma B. Reese Elementary Tokay High ADMS Recommendation_Board of Education_030111