Making the Most of a Logic Model Demonstrating

  • Slides: 26
Download presentation
Making the Most of a Logic Model Demonstrating New Methods to Increase Use and

Making the Most of a Logic Model Demonstrating New Methods to Increase Use and Learning through Logic Models Presenters: Kate Locke Deepti Sood Rose Konecky Associate Director of Evaluation Senior Consultant

Founded in 1980 National & international 30 staff + affiliates Partner with nonprofits, corporate

Founded in 1980 National & international 30 staff + affiliates Partner with nonprofits, corporate responsibility programs, & foundations • Evaluation, strategy, grants management, research and landscape analysis, evaluation, learning and capacity building • • “We are committed to addressing complex social problems by heightening our clients’ understanding of their collaborative role in society; we help them strengthen strategy, build capacity, and advance assessment and evaluative learning. ”

Agenda o Model Heat Mapping o Cohort Logic Modelling o Change Over Time o

Agenda o Model Heat Mapping o Cohort Logic Modelling o Change Over Time o Discussion; Q&A 3

Model Heat Mapping 4

Model Heat Mapping 4

Logic Model Heat Mapping: Setting the Scene Situation: Funder w/ unclear connection between vision

Logic Model Heat Mapping: Setting the Scene Situation: Funder w/ unclear connection between vision & activities Tactic/Solution: Goal: Greater clarity of purpose & ability to articulate work Logic Model Heat Mapping 5

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Collaboration Coordination

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Collaboration Coordination Education system improves Students Summer academics Social/ emotional services Older Youth Resources Academic skills Test scores Pre-K readiness College services Community engagement Support HS drop-outs, formerly incarcerated Attitudes Knowledge & skills College readiness, attendance Certifications 6

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Collaboration Coordination

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Collaboration Coordination Education system improves Students Summer academics Social/ emotional services Older Youth Resources Academic skills Community engagement Support HS drop-outs, formerly incarcerated Attitudes Knowledge & skills Schools Test scores Pre-K readiness College services Teachers College readiness, attendance Certifications Students Non. Traditional Students 7

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Students Summer

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Students Summer academics Social/ emotional services Older Youth Coordination Resources Academic skills Collaboration Education system improves Test scores Pre-K readiness College services Community engagement Support HS drop-outs, formerly incarcerated Attitudes Knowledge & skills Example Grant Documents College readiness, attendance Certifications Summer program Social/ emotional support Goal of improved attitudes 8

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Students Summer

Initial Logic Model on Education Programs Outcomes Activities Upgrade infrastructure Job skills Students Summer academics Social/ emotional services Older Youth Coordination Resources Academic skills Collaboration Education system improves Test scores Pre-K readiness College services Community engagement Support HS drop-outs, formerly incarcerated Attitudes Knowledge & skills Example Grant Documents College readiness, attendance Certifications Adult HS drop -out Participants Goal of college readiness Goal of increased certifications 9

Initial Logic Model on Education Programs Outcomes Activities (7) Upgrade infrastructure Students Summer (11)

Initial Logic Model on Education Programs Outcomes Activities (7) Upgrade infrastructure Students Summer (11) academics (6) Social/ emotional services Older Youth (6) College services Support HS (1) drop-outs, formerly incarcerated Collaboration (0) Job skills (4) Coordination (5) Resources (1) Education system improves (0) Key 0 -2 Grantees Academic skills (11) 3 -5 Grantees Test scores (10) Pre-K readiness (1) Community engagement (6) Attitudes (9) Knowledge & skills (1) 6 -8 Grantees 9 -11 Grantees College readiness, attendance (3) Certifications (1) 10

Initial Logic Model on Education Programs Outcomes Activities (7) Upgrade infrastructure Students Summer (11)

Initial Logic Model on Education Programs Outcomes Activities (7) Upgrade infrastructure Students Summer (11) academics (6) Social/ emotional services Older Youth (6) College services Support HS (1) drop-outs, formerly incarcerated Collaboration (0) Job skills (4) Coordination (5) Resources (1) Education system improves (0) Key 0 -2 Grantees Academic skills (11) 3 -5 Grantees Test scores (10) Pre-K readiness (1) Community engagement (6) Attitudes (9) Knowledge & skills (1) 6 -8 Grantees 9 -11 Grantees College readiness, attendance (3) Certifications (1) 11

Heat Mapping: Key Takeaways Benefits • Clarifies funder vision & activities • Facilitates strategy

Heat Mapping: Key Takeaways Benefits • Clarifies funder vision & activities • Facilitates strategy conversations • Tallies based entirely off grantee documents Drawbacks • Reduces findings to number of occurrences rather than intensity • Omits tallying components not already on the LM • Reliant on grantee data 12

Cohort Logic Modelling 13

Cohort Logic Modelling 13

Cohort Logic Modeling: Setting the Scene Situation: Cohort of Grantees with Different but Overlapping

Cohort Logic Modeling: Setting the Scene Situation: Cohort of Grantees with Different but Overlapping Activities & Goals Tactic/Solution: Goal: Comprehensive Evaluation System Applicable to the Entire Cohort Logic Modeling 14

Cohort Modeling: Creating a Complex Model Document Review Range of Program Elements Outcomes Impact

Cohort Modeling: Creating a Complex Model Document Review Range of Program Elements Outcomes Impact Implementation 15

Cohort Modeling: Tagging Grantees to Model Range of Grantees Range of Program Elements Outcomes

Cohort Modeling: Tagging Grantees to Model Range of Grantees Range of Program Elements Outcomes Impact Implementation 16

Cohort Modeling: Personalized Surveys Category Construct Survey Question Timing Physical Health Applying nutrition knowledge

Cohort Modeling: Personalized Surveys Category Construct Survey Question Timing Physical Health Applying nutrition knowledge I always read nutritional labels when I am food shopping Pre-/Post- Fall Prevention Increased utilization I avoid walking on slippery of home resources floors Purposeful Engagement Invest more time in volunteer / service work Since coming to this program, I have increased the amount of time I spent doing service Pre-/Post-only 17

Cohort Modeling: Key Takeaways Benefits • Shows shared progress on goals • Allows orgs

Cohort Modeling: Key Takeaways Benefits • Shows shared progress on goals • Allows orgs to better understand their niche • Allows for comparative data analytics Drawbacks • Time-intensive • Only focuses on areas of cohesion • May duplicate other evaluation efforts 18

Change Over Time 19

Change Over Time 19

Change Over Time: Setting the Scene Tactic/Solution: Change over time bridges the gap to

Change Over Time: Setting the Scene Tactic/Solution: Change over time bridges the gap to connect the original vision with the present reality Situation: A program in its third year looks very different from how it was conceived at the time of funding Y 1 Program Y 2 Program Y 3 Program Y 1 Logic Model ? ? 20

Change Over Time: Nursing Development LM, Y 1 Inputs Staff Partnerships • A •

Change Over Time: Nursing Development LM, Y 1 Inputs Staff Partnerships • A • B Funder goals Education, population data Outcomes Activities Establish Collaborative Standardize model-based curriculum Enrollment Of nurses in acad. dev. Marketing - Create materials - Circulate statewide - Circulate in diverse venues Increased knowledge of model & buy-in Increased number of program graduates Increased interest in model Programs selfsustaining Increased employer pressure to get degree Increased workforce diversity Majority of nurses have advanced degree or higher Increased workforce capacity Improved regional health 21

Change Over Time: Annotation Process Inputs Staff Partnerships • A • B FFunder unde

Change Over Time: Annotation Process Inputs Staff Partnerships • A • B FFunder unde r egoals mph a diver sizes sity Education, population data D idn’t popu get l data ation Outcomes Activities Establish Collaborative Standardize model-based curriculum Enrollment Of nurses in acad. dev. Marketing - Create materials - Circulate statewide - Circulate in diverse venues Increased tions a i r a knowledge v New of model & in model buy-in Increased number of program graduates Increased interest in model Programs selfsustaining Increased Was employer 5 now 5%, pressure 65 to get % degree Increased workforce diversity Majority of nurses ease have r c n i No advanced time over degree or higher Increased workforce capacity Improved regional health 22

Change Over Time: Revised Model Inputs Staff Partnerships • A • B Funder goals,

Change Over Time: Revised Model Inputs Staff Partnerships • A • B Funder goals, particularly diversity Education, population data Outcomes Activities Establish Collaborative Standardize model-based curriculum Enrollment Of nurses in acad. dev. Marketing - Create materials - Circulate statewide - Circulate in diverse venues Increased knowledge of 2016 model & buy-in Increased number of program graduates Increased interest in model Programs selfsustaining Increased employer pressure to get degree (55 -65%) Increased workforce diversity Majority of nurses have advanced degree or higher (No increase 2011 -2016) Increased workforce capacity Improved regional health 23

Change Over Time: Key Takeaways Benefits • Allows orgs to better articulate progress •

Change Over Time: Key Takeaways Benefits • Allows orgs to better articulate progress • Allows for re-prioritization of activities & goals • Allows for facilitated reflection Drawbacks • Hard to articulate original vision if staff changed • Can be messy • Good way to show journey to new staff/partners 24

Discussion; Q&A 25

Discussion; Q&A 25

Kate Locke Deepti Sood Rose Konecky @TCCKate @DSood 26 @rose_k_tcc CONTACT US tccgrp. com

Kate Locke Deepti Sood Rose Konecky @TCCKate @DSood 26 @rose_k_tcc CONTACT US tccgrp. com @TCCGroup 26

Making the Most of a Logic Model DemonstratingMaking the Most of a Logic Model Demonstrating
Demonstrating Withitness Design Question 7 Element 33 DemonstratingDemonstrating Withitness Design Question 7 Element 33 Demonstrating
Demonstrating Withitness Design Question 7 Element 33 DemonstratingDemonstrating Withitness Design Question 7 Element 33 Demonstrating
Logic and Logic Programming Logic Propositional Logic FirstLogic and Logic Programming Logic Propositional Logic First
Logic Introduction to Logic What is logic LogicLogic Introduction to Logic What is logic Logic
Logic Model Workshop Logic Model A Program PerformanceLogic Model Workshop Logic Model A Program Performance
Logic model Stronger and safer This logic modelLogic model Stronger and safer This logic model
Logic model Learning and education This logic modelLogic model Learning and education This logic model
Demonstrating the use of Propositional logic Simple toDemonstrating the use of Propositional logic Simple to
Demonstrating the Logic Behind an RCT to ProgramDemonstrating the Logic Behind an RCT to Program
Programmable Logic z Regular logic y Programmable LogicProgrammable Logic z Regular logic y Programmable Logic
Introduction To Logic LOGIC Logic may be definedIntroduction To Logic LOGIC Logic may be defined
Logic Overview l l Scholastic logic Propositional logicLogic Overview l l Scholastic logic Propositional logic
Logic in Argumentative Writing Logic in Writing LogicLogic in Argumentative Writing Logic in Writing Logic
Logic Control What is Logic control Logic controlLogic Control What is Logic control Logic control
Prolog IV Logic Propositional logic n Propositional logicProlog IV Logic Propositional logic n Propositional logic
Logic What is logic n n n LogicLogic What is logic n n n Logic
Combining Description Logic Autoepistemic Logic and Logic ProgrammingCombining Description Logic Autoepistemic Logic and Logic Programming
Logic Thinking What is Logic Logic is theLogic Thinking What is Logic Logic is the
FirstOrder Logic Review 1 Firstorder logic Firstorder logicFirstOrder Logic Review 1 Firstorder logic Firstorder logic
LOGIC A BASIC OVERVIEW WHAT IS LOGIC LogicLOGIC A BASIC OVERVIEW WHAT IS LOGIC Logic
Outline Boolean Logic FirstOrder Logic What is LogicOutline Boolean Logic FirstOrder Logic What is Logic
Programmable Logic z Regular logic y Programmable LogicProgrammable Logic z Regular logic y Programmable Logic
FirstOrder Logic Review 1 Firstorder logic Firstorder logicFirstOrder Logic Review 1 Firstorder logic Firstorder logic