LOGIC MODEL A Program Performance Framework New Educator

LOGIC MODEL: A Program Performance Framework New Educator Orientation April 26, 2011 Oklahoma State University Stillwater, OK

New Educator Thought for the Day “People don’t care how much you know until they know how much you care. ” » Unknown This will serve you well as you begin your career in Extension

OCES Program Planning • OCES works within broad program guidelines. – Long Range Plan of Work • Rolling Plan of Work – Typically 3 years or more, but is flexible – Short term Planning to Accomplish Longer Term Goals • Annual Implementation Timeline – This is your roadmap

Just What Is A LOGIC Model? • The program logic model is defined as: – A picture of how our organization does its work—the theory and assumptions underlying the program. A program logic model links outcomes (both short- & long-term) with program activities/processes and theoretical assumptions/principles of the program.

What is a Logic Model? • A simplified picture of a program, initiative or intervention in response to a given situation. • Shows the logical relationships among the resources that are invested, the activities that take place and the benefits or changes that result. – Some call this ‘program theory’ • Logic modeling is really a way of thinking! • A bridge between where you are and where you want to be with your programs.

What is a Logic Model? • A systematic and visual way (road map) to present and share your understanding of the relationships among: – Resources you have to operate your program – The activities you plan to do – The changes or results you hope to achieve – It’s a map of how you think your program will work from start to finish.

LOGIC • If you don’t know where you’re going, how are you gonna’ know when you get there? – Yogi Berra

Brief History • Logic Models Aren’t New – Date back to the 1970 s • Suchman (1967), Weiss (1973, Bennett (1976), others • Used Many Places: – Private Sector • TQM – Public Sector • Govt. Performance Results Act 1993 – Set Standards for Measuring Performance – Non-Profit Sector • United Way – International Donor Agencies – Evaluators

Goals for Today • Learn about LOGIC Models – A basic introduction to the logic model as an action-oriented tool for program planning and evaluation • Practical Applications of LOGIC Models in your programs

WHY LOGIC MODELS? • Shows difference • • between what we do and impact we are having Provides a common vocabulary Focus on quality and continuous improvement

Logic Model Common Vocabulary S I T U A T I O N INPUTS OUTCOMES Government reports, OCES reports, Grant applications

Everyday Logic Model H E A D A C H E Get pills Take pills Logical progression, common sense Feel better

Everyday Logic Model H U N G E R Find Food Eat Food Logical progression, common sense Feel better

Logic Model • OCES Logic Models will be somewhat more complicated, but remembering the simple examples should keep them from becoming overwhelming or intimidating.

An Extension Example: Healthy Eating for Oklahoma Youth Extension invests time and resources A variety of educational activities are provided to youth who participate (outputs) These owners gain knowledge and change practices resulting in improved nutrition and better long-term health. (outcomes) Value to Society? ?

Another Example • Situation: Cattle Stocking Rates are generally considered too great for the carrying capacity of the land, resulting in weed encroachment and poor cattle performance. • Outputs: A series of educational programs regarding determining and implementing appropriate stocking rates is developed, marketed, promoted, delivered, and evaluated. • Outcome: Stocking rates are reduced to the carrying capacity of the land, resulting in better cattle performance and increased potential for profit. – Value to Society? ?

INPUTS Faculty Staff Money Time Volunteers Partners Equipment Technology

OUTPUTS What we do ACTIVITIES Workshops Counseling(Consulting? ? ) On-farm research Facilitation Product development Curriculum design Trainings Field days Conferences Media Who we reach PARTICIPATION Participants Clients Customers Users

LOGIC MODEL: Program Performance INPUTS Program investments What we invest OUTPUTS Activities Participation What we do Who we reach OUTCOMES Short Medium What results Longterm

IF : THEN • The IF: THEN relationship provides for the development of the LOGIC MODEL. • The Logic MODEL is important to OCES because our current( 07 -11) federal Plan of Work is designed around it. • So…Logic tells us the Logic Model is important at the local level.

Logical Linkages: Series of If-Then Relationships IF THEN OCES invests time & money INPUTS IF THEN Resource inventory can be developed OUTPUT IF THEN Clients will know what is available IF Clients will access services OUTCOMES – What is the Value to All Society? ? THEN Clients will have needs met

IF : THEN • “IF: the purpose of youth groups is to develop leadership and citizenship skills (Wylie, 1990), and • IF: we know that skills developed in one’s youth carry into adulthood (Ladewig & Thomas, 1987), • THEN: youth leadership organizations should be able to document how their alumni are impacting the communities in which they reside…” (Pennington & Edwards, 2004)

LOGIC MODEL: Program Performance Framework S I T U A T I O N OUTPUTS OUTCOMES-IMPACT Activities Participation Short What we invest What we do Who we reach What the short term medium term ultimate results are impact(s) is Staff Volunteers Time Money Materials Equipment Technology Partners Workshops Meetings Counseling Facilitation Assessments Product dev. Media work Recruitment Training Learning Action Conditions Awareness Knowledge Attitudes Skills Opinions Aspirations Motivations Behavior Practice Decisions Policies Social action Social Economic Civic Environmental INPUTS Participants Customers Citizens Reactions Medium ENVIRONMENT Influential factors Long-term

Environment–Influential Factors • Extension program does not exist in a vacuum (other educational sources) • Context of the program (other sources of behavior changes) – politics, family circumstances, cultural milieu, demographics, economics, values, biophysical environment, policies, services • What affects the program over which you have little control?

Do the Outcomes First • I definitely advocate doing the outcomes first! I find that people come up with much more effective activities when they do. Use the motto, “ plan backward, implement forward. ” – Beverly Anderson Parsons, WKKF Cluster Evaluator

PLANNING INPUTS Programmatic investments OUTPUTS Activities Participation OUTCOMES Short i Implement and Evaluate Medium Long term

Outcomes • Are they Important? • Are they Reasonable? • Are they Realistic? • Are there Negative Consequences? S. M. A. R. T. • Specific • Measurable • Attainable • Realistic • Timed

INPUTS Staff OUTPUTS Develop parent ed curriculum Targeted Money Partners Research OUTCOMES Parents increase knowledge of child dev parents Deliver 6 interactive sessions attend Parents learn new ways to discipline Parents use improved parenting skills Reduced rates of child abuse & neglect INDICATORS? ? ?

Progressive Outcome Relationships SHORT MEDIUM LONG-TERM Seniors increase knowledge of food contamination risks Practice safe cooling of food; food preparation guidelines Lowered incidence of food borne illness Participants increase Establish financial goals, Reduced debt and knowledge and skills in use spending plan increased savings financial management Community increases understanding of childcare needs Residents and employers Child care needs are met discuss options and implement a plan Empty inner city parking Youth and adults learn Money saved, nutrition lot converted to gardening skills, nutrition, improved, residents enjoy community garden food preparation and mgt. greater sense of community

Logic model with Indicators for Outputs and Outcomes Outputs Program implemented Number of workshops held Outcomes Targeted farmers Number and percent of farmers attending Farmers learn Number and percent who learned content Farmers practice new techniques Number and percent who adopted practices Farm profitability increases Number and percent show improved farm profits; amount of increase

Where Does Evaluation Fit? INPUTS Staff OUTPUTS Design parent ed curriculum Money Partners Targeted OUTCOMES Parents increase knowledge of child dev parents Provide 6 training sessions attend Parents learn new ways to discipline Parents use improved parenting skills Reduced rates of child abuse & neglect EVALUATION: What do you want to know? How will you know it? Quality of curriculum # of sessions delivered # parents attending/session which parents % of parents Increase in knowledge/skill - post session survey Actual use - follow-up phone interview Decrease in rates - agency records

Last Slide • View evaluation as learning - integrate into the way we work • Build evaluation in upfront • Ask ‘tough questions’ • Make measurement meaningful • Be accountable for highest professional standards

Summary • Think of the Logic Model as Your “Roadmap” – Provides a graphic description of a program (process, event, community initiative) – Shows the relationship of program inputs and outputs to expected results (outcomes) – Makes explicit the underlying theory of a program

Summary • Made up of six components: – Situation – Inputs – Outcomes – Assumptions – External Factors

Logic Model Websites • http: //www. uwex. edu/ces/lmcourse/ • http: //www. wkkf. org/Pubs/Tools/Evaluation/Pub 3669. pdf • http: //www. uidaho. edu/extension/Logic. Model. pdf • Or goto google. com, search for “logic model program evaluation”

• Be aggressive in your programming – Establish needs early on • Recognize things change • Extension must be flexible – Be a risk taker – Utilize volunteers

New Educator Thought for the Day • “People don’t care how much you know until they know how much you care. ” » Unknown • This will serve you well as you begin your career in Extension

Last Slide, Really!! • Questions?