SUMMER YOUR LIBRARY IMPLEMENTING CALIFORNIAS OUTCOME AND OUTREACHBASED

SUMMER @ YOUR LIBRARY IMPLEMENTING CALIFORNIA’S OUTCOME- AND OUTREACHBASED EVALUATION FRAMEWORK March 1, 2018 Summer @ Your Library

Overview: The value of conducting outcome-based program planning and evaluation California’s Statewide Outcomes Importance of Summer Reading Outreach Case Studies: Los Angeles Public Library and Glendora Public Library Resources available from the Summer @ Your Library project Summer @ Your Library| Summer 2018 March 1, 2018

So What? Outcomes answer the important question, So What? What are the positive changes or benefits that people experience as a result of a library program or service? Setting outcomes helps librarians turn outward and focus on the impact that their programs and services have on their users. Summer @ Your Library| Summer 2018 March 1, 2018

Benefits of Outcome-Based Evaluation User-based evaluation data. Improve existing program, terminate what’s not working, design new programs. Develop marketing and outreach strategies for reaching specific populations. Useful information for stakeholders and policymakers about how library services and programs benefit their constituents. Summer @ Your Library| Summer 2018 March 1, 2018

Why Do We Have Statewide Outcomes? Help the California library community take an outcomebased approach. Gather consistent data. Demonstrate the impact of programs across the state. Summer @ Your Library| Summer 2018 March 1, 2018

California’s Statewide Summer Outcomes 1. 2. 3. Young children, and their parents and caregivers, and school age children, feel part of a community of readers and library users. Teens make connections at the library. Adults find value and enjoyment at the library. Summer @ Your Library| Summer 2018 March 1, 2018

Outreach We have an obligation to bring the benefits of summer reading and learning programs to underserved people in our communities who may not be aware of them. Summer @ Your Library| Summer 2018 March 1, 2018

Los Angeles Public Library Summer @ Your Library| Summer 2018 March 1, 2018

Los Angeles and Summer Outcomes Planning outcomesbased summer programs since 2011! Right? ! Summer @ Your Library| Summer 2018 March 1, 2018

Why Outcomes? Summer @ Your Library| Summer 2018 March 1, 2018

I can see clearly now… Summer @ Your Library| Summer 2018 March 1, 2018

Yikes Summer @ Your Library| Summer 2018 March 1, 2018

The choice is obvious Summer @ Your Library| Summer 2018 March 1, 2018

Those gorgeous Outcomes Young children and their parents and caregivers, and school age children, feel part of a community of readers and library users. Teens make connections at the library. Adults find value and enjoyment at the library. Summer @ Your Library| Summer 2018 March 1, 2018

Community, connection, and enjoyment! Summer @ Your Library| Summer 2018 March 1, 2018

Community, connection and enjoyment Summer @ Your Library| Summer 2018 March 1, 2018

Community, connection and enjoyment Summer @ Your Library| Summer 2018 March 1, 2018

Quality Principles! Summer @ Your Library 1. Builds strong communities 2. Provides opportunities for learning 3. Celebrates reading and literacy 4. Is designed to reach and engage everyone Summer @ Your Library| Summer 2018 March 1, 2018

Yep, get your pencils ready Summer @ Your Library| Summer 2018 March 1, 2018

Survey results – kids, teens, adults Adults Kids Summer @ Your Library| Summer 2018 Teens March 1, 2018

What we learned “Offer parts of the program outside the library” (Building Strong Communities) least chosen indicator “Engage community partners” (Building Strong Communities) 2 nd least chosen indicator Also chosen less often were “Enable people to set and meet individual reading and learning goals” (Celebrating the Reading Experience) and “Activities are designed with specific learning objectives in mind” (Providing Learning Opportunities) Summer @ Your Library| Summer 2018 March 1, 2018

Summer 2018 – key indicators All staff contribute to the program (Building Strong Communities) Staff offers elements of the program in locations beyond the walls of the library (Building Strong Communities) The program encourages self-directed learning, discovery and creativity (Providing Learning Opportunities) The library enables people to set and meet individual reading and literacy goals (Celebrating Reading and Summer @ Your Library| Summer 2018 March 1, 2018 Literacy)

Summer 2018 Summer @ Your Library| Summer 2018 March 1, 2018

Summer 2018 – Game board Completion = 1, 000 points 1 minute of reading = 1 point At-home activity = 50 points At-the-library activity = 100 points Out and about in LA = 100 points Customize your summer reading and learning! Summer @ Your Library| Summer 2018 March 1, 2018

Summer 2018 Summer @ Your Library| Summer 2018 March 1, 2018

Glendora Public Library Summer @ Your Library| Summer 2018 March 1, 2018

What is the Glendora Summer Reading Challenge? City-wide challenge Open-ended to allow for all types of reading Programs and events for readers and library users of all ages Located on- and off-site 150 student strong volunteer program Summer @ Your Library| Summer 2018 March 1, 2018

How Did We Get Started? 2012: Glendora Library launches Outcomes Measures Survey CLA survey and Outcomes Children belong to a community of readers and library users Additional Glendora specific Outcomes Participation in SRC helps to maintain or improve reading scores Participation in SRC helps make reading a habit Summer @ Your Library| Summer 2018 March 1, 2018

Getting Started, continued 2013: Glendora Library located underserved population CLA Outcome Underserved community members participate in the summer reading program Summer @ Your Library| Summer 2018 March 1, 2018

Building a Community of Readers and Library Users Started with making no changes to our summer programs Readers began to add their names to the wall (this year, readers will get a car magnet ) Once readers reach a defined (easy to reach) level, they receive a Library-branded backpack Once readers reach a defined (more challenging) level, they receive a yard sign Summer @ Your Library| Summer 2018 March 1, 2018

Underserved Community Members Participate in the Summer Reading Program Glendora’s underserved community Started with 3 sites Now 6 sites and growing Summer @ Your Library| Summer 2018 March 1, 2018

Participation in SRC Helps Make Reading a Habit Program designed to encourage every day reading Incentives along the way to encourage regular Library visits Summer @ Your Library| Summer 2018 March 1, 2018

Participation in SRC Helps to Maintain or Improve Reading Scores Based on input from local teachers Reading goals are set in 30 minute increments In addition to survey data, reading test score study was completed Summer @ Your Library| Summer 2018 March 1, 2018

Survey Logistics Survey created by CLA staff Input from Glendora includes 3 extra questions added each year (stay the same every year to measure differences) Print vs. Online vs. Email EPIC FAIL!!! Summer @ Your Library| Summer 2018 March 1, 2018

Lessons from SRC Readers/library users want to be included in a community and feel a part Including all age groups in similar areas helps to build unity Library users are proud of their Library use SRC attracts new Library users People LOVE to inflict torture on the Librarian Summer @ Your Library| Summer 2018 March 1, 2018

The surveys are in, now what? Communicate with stakeholders Community Members Library Board Donors (and future donors) School Districts Community Groups Update programs continuously Summer @ Your Library| Summer 2018 March 1, 2018

What difference has it all made? Increase in donor funds Increase in the number of readers from 2, 200 to over 3, 300 Increase in the amount of reading completed 45, 000 hours last summer Summer @ Your Library| Summer 2018 March 1, 2018

Is it worth it? Summer @ Your Library| Summer 2018 March 1, 2018

SERVICES PROVIDED BY THE SUMMER @ YOUR LIBRARY PROJECT March 1, 2018 Summer @ Your Library

Summer Reading Outcomes Surveys Personalized survey links for participating libraries Timeline Set up surveys in spring Survey period runs through summer Custom reports returned to libraries in fall Summer @ Your Library| Summer 2018 March 1, 2018

Summer Reading Outcomes Surveys How to Participate Inform Summer @ Your Library project staff Select which groups you’d like to survey Early learners and their caregivers School-Age Children Teens Adults Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Customization Customized survey links will include: Summer @ Your Library statewide outcomes questions Options for respondents to report which branch they visited Up to three questions of your choice Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Measure Local Outcomes Add questions to measure local outcomes Sample questions How did you hear about summer reading? Did you participate in SRP online or by turning in a paper log? Did participating in SRP encourage you to read more? What was your favorite/least favorite part of SRP? Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Evaluating Outreach Data Resources available on calchallenge. org website Outreach evaluation folded into statewide outcomes questions Community needs assessment Identifying underserved groups Is this the first time you took part in the summer reading program? Use surveys or conduct focus groups to gather information about target group Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Reporting Outreach Data Let us know who you’re reaching out to! (Stay tuned for more info) Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Getting participants Paper surveys at summer activities and events Link on your summer reading platform or library webpage Requirement for summer reading program completion Providing small incentives or recognition Teens –community service time Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: How to Submit Data Unique Survey. Monkey link provided Ways to collect Online surveys Paper surveys SRP participants fill out surveys directly into Survey. Monkey link SRP participants fill out paper surveys collected by library staff/volunteers Hybrid Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Sample Report –LAPL 2017, Children Statewide outcome question: Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Sample Report –LAPL 2017, Children Local outcome question: Summer @ Your Library| Summer 2018 March 1, 2018

Surveys: Reports Summary Survey links sent in spring Submit data at end of summer Receive personalized report(s) in fall Use report(s) to demonstrate impact Summer @ Your Library| Summer 2018 March 1, 2018

Using the Summer Reading Outcomes –Getting Started Pilot with one group Consider an underserved group Start with the statewide outcomes questions Summer @ Your Library| Summer 2018 March 1, 2018

Contact: Natalie Cole, California State Library: natalie. cole@library. ca. gov Eva Mitnick, Los Angeles Public Library: emitnick@lapl. org Cindy Romero, Glendora Public Library: cromero@glendoralibrary. org Shana Sojoyner, California Library Association: ssojoyner@cla-net. org Virginia Walter, UCLA Professor Emerita: vwalter@ucla. edu The Summer @ Your Library Program: Explore, Learn, Read, Connect is a program of the California Library Association, supported by the U. S. Institute of Museum and Library Services under the provisions of the Library Services and Technology Act, administered in California by the State Librarian. Summer @ Your Library| Summer 2018 June 22, 2012