Results Based Accountability Basics A Half Day Presentation
Results Based Accountability Basics A Half Day Presentation Standard Training Slides Sponsored by the Ministry of Social Development
Results Based Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide. org resultsaccountability. com Book - DVD Orders sheapita. co. nz amazon. com resultsleadership. org
How could RBA add value to you? 3
SIMPLE STEPS COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER TALK TO ACTION!
Results Based Accountability is made up of two parts: Population Accountability about the wellbeing of WHOLE POPULATIONS For Communities – Cities – Districts – Countries E. g. All Rangatahi/Youth in Te Tai Tokerau, All Migrants in Nelson Performance Accountability about the wellbeing of CLIENT GROUPS/CUSTOMERS For Teams - Providers – Programmes - Agencies – Service Systems E. g. Clients of Services, Collectives, Ministries or the Health System 5
The Language Trap Too many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Indicator Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Measure Goal Objective Target Lewis Carroll Center for Language Disorders Core Yourqualitative made up strategic jargon here Measurable urgent systemic
Results Based Accountability COMMON LANGUAGE COMMON SENSE COMMON GROUND
Performance Population Definitions • RESULT / OUTCOME – A condition of wellbeing for children, adults, families or communities All Tamariki in Hamilton are Born Healthy, Safe Roads, Nurturing Whānau/Families, A Prosperous Economy • INDICATOR / BENCHMARK – A measure which helps quantify the achievement of a result. Rate of low-birth weight babies, Rate of road crashes, Rate of child abuse and neglect, Unemployment rate • PERFORMANCE MEASURE – A measure of whether a programme, agency or service system is working. Three types 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? = Client Results / Outcomes
Translation Guide/Rosetta Stone Not the Language Police Ideas 1. A condition of well-being for children, adults, families & communities 2. 3. Group 1 Group 2 Group 3 e RESULT OUTCOME TRANSLATION Back to the Idea tc. GOAL
From Ends to Means Performance Population From Talk to Action RESULT / OUTCOME ENDS INDICATOR / BENCHMARK PERFORMANCE MEASURE MEANS Client /Customer result = Ends. Service delivery = Means 10
Results – Indicators – Performance Measures in Maori, Fijian, Tuvaluan
Result, Indicator, Strategy or Performance Measure? Result 1. A Safe Community Indicator 2. Percentage of Total Recorded Offences Perf 3. Measure 4. Result 5. Strategy Average Police response time An Educated Workforce Installing street lights to make people feel safe Result 6. People have living wage jobs and income Indicator 7. % of people with living wage jobs and Perf income Measure
Key RBA concepts • 2 key types of accountability and language discipline: – Population accountability - results / outcomes and indicators – Performance accountability - performance measures • 3 types of performance measures: – How much did we do? – How well did we do it? – Is anyone better off? • 7 questions from ends to means: – baselines and turning the curve – to make life better for our families / whānau, children / tamariki, and communities. 13
Population Accountability For whole populations in a geographic area Mark Friedman (author) www. resultsaccountability. com www. raguide. org 14
The 7 Population Accountability Questions 1. What are the quality of life conditions we want for the children, adults and families who live in our community? (Population & Results) 2. What would these conditions look like if we could see them? (Experience) 3. How can we measure these conditions? (Population Indicators) 4. How are we doing on the most important of these measures? (Baseline Data and Story) 5. Who are the partners that have a role to play in doing better? (Partners) 6. What works to do better including no- cost and low-cost ideas? (What works) 7. What do we propose to do? (Action Plan) 15
16
Christchurch City Community Outcomes • A safe city • A city of inclusive and diverse communities • A city of people who value and protect the natural environment • A well governed city • A prosperous city • A healthy city • A city of recreation, fun and creativity • A city of lifelong learning • A city that is attractive and well designed 17
Kotahitanga Whānau Ora Collective positive statements - positive focus • All whaanau in Te Puuaha ki Manuka (Greater South Auckland) are. . . – – – Mana Ora: Healthy and safe; Mana Motuhake: Economically secure; Mana Tangata: Culturally confident; Mana Rangatiratanga: Knowledgeable and skilled; Mana Whānau: Connected, engaged and entrepreneurs Acknowledgement: Kotahitanga Collective Members: Turuki Healthcare Trust, Papakura Marae, Huakina Development Trust and Te Kaha O Te Rangatahi Trust, South Auckland, New Zealand.
Aranui Community Trust Acknowledgement: Aranui Community Trust Inc Society (www. actis. org. nz)
Implementing RBA Aranui Result areas and indicators Result Area 1: A community that is spiritually and socially strong Indicator: % of police callouts for family violence Result Area 2: A community full of knowledge and learning Indicator: % of students with NCEA level 1 @year 11 % primary school students performing at national average for literacy and numeracy
Result Area 3: A great physical environment Indicator: Expenditure on repairs and maintenance to city property in the Aranui Burwood Pegasus area % of $ R & M that is due to damage Result Area 4: People who know and fit in Aranui Indicator: % of people who offer to participate in local events
Result Area 5: A community that is healthy Indicator: % of Aranui residents presenting at Accident and Emergency with no trauma needs/ concerns # of total acute inpatient admissions
Results for Children, Families and Communities A Working List of Population Results § Healthy Births § Healthy Children and Adults § Children Ready for School § Children Succeeding in School § Young People Staying Out of Trouble § Stable Families § Families with Adequate Income § Safe and Supportive Communities 24
Georgia Policy Council for Children and Families RESULTS § Healthy children § Children ready for school § Children succeeding in school § Strong families § Self-sufficient families 25
Tip for Drafting Population Accountability Results Familiesin ______ Taurangaare _____ Economically All ______ Secure Insert your Population Insert your Geographic area Insert your Condition of Wellbeing 26
Examples of Means not Ends 1. COLLABORATION 2. SYSTEMS REFORM 3. SERVICE INTEGRATION 4. DEVOLUTION 5. FUNDING POOLS 27
Leaking Roof (Results thinking in everyday life) Experience: Measure: Not OK Inches of Water ? Fixed Turning the Curve Story behind the baseline (causes): Partners: What Works: Action Plan: #2
3 criteria for choosing Indicators Communication Power Does the indicator communicate to a broad range of audiences? Proxy Power Does the indicator say something of central importance about the result? Does the indicator bring along the data HERD? Data Power Quality data available on a timely basis. 29
Choosing Indicators Worksheet Safe Outcome or Result____________ Community Candidate Indicators Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Communicat ion Power H M L H H Proxy Power H M L H H Data Power H M L H L Measure 7 Data Developme Measure 8 nt Agenda
Three Part Indicator List for each Result Part 1: Primary Indicators • 3 to 5 “Headline” Indicators • What this result “means” to the community • Meets the Public Square Test Part 2: Secondary Indicators • Everything else that’s any good (Nothing is wasted. ) • Used later in the Story behind the Curve Part 3: Data Development Agenda • New data • Data in need of repair (quality, timeliness etc. ) 31
What do we mean by a baseline? H M OK? L History Point to Point Forecast Turning the Curve Baselines have two parts: history and forecast 32
Indicator Reports Neighbourhood Country City Kruidenbuurt Tilburg, Netherlands New Zealand Portsmouth, UK
MADD 34
Key RBA concepts • 2 key types of accountability: – Population – results / outcomes and indictors – Performance – performance measures • 3 types of performance measures: – How Much Did We Do? – How Well Did We Do It? – Is Anyone Better Off? • 7 questions from ends to means – baselines and turning the curve – to make life better for our families / whānau, children / tamariki, and communities. 35
Population Accountability QUICK EXERCISE
Tip for Drafting Population Accountability Results All ______ in ______ are _____ How would you experience this outcome? What would be different? How would you measure success? What Indicator would you use? Insert your Population Insert your Geographic area Insert your Condition of Wellbeing
Performance Accountability For clients of programmes, agencies, teams and service systems Mark Friedman (author) www. resultsaccountability. com www. raguide. org 38
Results Based Accountability is made up of two parts: Population Accountability about the wellbeing of WHOLE POPULATIONS For Communities – Cities – Districts – Countries E. g. All Rangatahi/Youth in Te Tai Tokerau, All Migrants in Nelson Performance Accountability about the wellbeing of CLIENT GROUPS/CUSTOMERS For Teams - Providers – Programmes - Agencies – Service Systems E. g. Clients of Services, Collectives, Ministries or the Health System 39
The 7 Performance Accountability Questions 1. Who are our clients? (Client Group/Customers) 2. How can we measure if our clients are better off? (Client/Customer Result / Outcome) 3. How can we measure if we are delivering services well? (Quality Measures) 4. How are we doing on the most important of these measures? (Baseline Data and Story) 5. Who are the partners that have a role to play in doing better? (Partners) 6. What works to do better including no-cost and low cost ideas? (Common sense ideas & research where available) 1. What do we propose to do? (Action Plan) 40
Performance Accountability Getting from talk to action Client Group/Customers
“All performance measures that have ever existed for any programme in the history of the universe involve answering two sets of interlocking questions. ”
Performance Measures Quantity Quality How Much How Well did we do? did we do it? (#) (%)
Performance Measures Effort How hard did we try? Effect Anyone better off?
Performance Measures Effort How Much Well Effect
Output Effect Input Effort Performance Measures Quantity Quality How much service did we deliver? How well did we deliver it? How much change / effect did we produce? What quality of change / effect did we produce?
Social Services Example Effort Quantity Quality How much did we do? How well did we do it? # of young people (clients) receiving job training / mentoring services % clients who complete the job training / mentoring programme Effect Is anyone better off? # of clients who move off a working age benefit and into employment (at 6 months and at 12 months) % of clients who move off a working age benefit and into employment (at 6 months and at 12 months)
Effort Education example Quantity Quality How much did we do? How well did we do it? Number of students Studentteacher ratio Effect Is anyone better off? Number of graduates Percent of graduates
Effort Drug/Alcohol Treatment Programme Quantity Quality How much did we do? How well did we do it? Number of persons treated Percent of staff with training/ certification Effect Is anyone better off? Number of clients off of alcohol & drugs - at exit - 12 months after Percent of clients off of alcohol & drugs - at exit - 12 months after
Effort Education example # 2 Quantity Quality How much did we do? How well did we do it? Number of students Studentteacher ratio Effect Is anyone better off? Number of secondary school students who graduate on time and enter Uni or employment after graduation Percent of secondary school students who graduate on time and enter Uni or employment after graduation
Effort Primary Care Practice Quantity Quality How much did we do? How well did we do it? Number of children aged 0 -2 enrolled Percent of children who did not attend Effect Is anyone better off? # children aged 8 months immunised % children aged 8 months immunised (in the practice)
Effort Not all performance measures are created equal Quantity Quality How much did we do? How well did we do it? Least Also Very Important Effect Is anyone better off? Most Important
Effort The matter of control Quantity Quality How much did we do? How well did we do it? Most Control Effect Is anyone better off? Least Control PARTNERSH
Separating the Wheat from the Chaff Types of performance measures found in each quadrant How much did we do? # Clients/custome rs # Activities (by served type of activity) # # How well did we do it? % Common e. g. client staff ratio, workload ratio, staff measures turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Activity-specific measures e. g. % timely, % clients completing activity, % correct and complete, % meeting standard Is anyone better off? % Skills / Point in Time vs. Point to Point Improvement Knowledge % Attitude / (e. g. parenting skills) Opinion % Behavior (e. g. toward drugs) (e. g. School attendance) % Circumstance (e. g. working, in stable housing)
The matter of use 1. The first purpose of performance measurement is to improve performance. 2. Avoid the performance measurement equals punishment trap. ● Create a healthy organisational environment ● Start small ● Build bottom-up and top-down simultaneously
Key RBA concepts • 2 key types of accountability and language discipline: – Population accountability - results / outcomes and indicators – Performance accountability - performance measures • 3 types of performance measures: – How much did we do? – How well did we do it? – Is anyone better off? • 7 questions from ends to means: – baselines and turning the curve – to make life better for our families / whānau, children / tamariki, and communities. 57
Performance Accountability QUICK EXERCISE
Performance Measures for my … (insert the name of your Programme or Service here) How much did we do? # Who are your clients? Clients/custome What would rs you put in here? served Choose one How well did we do it? % client satisfaction with xxx Is anyone better off? / # /% Skills # /Knowledge % Attitude / (e. g. parenting skills) # /Opinion % Behavior (e. g. toward drugs) (e. g. School attendance) # /% Circumstance (e. g. working, in stable housing)
How Population & Performance Accountabilities Fit Together 60
THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Result: Healthy Safe Young People Youth crime rates POPULATION RESULT PERFORMANCE ACCOUNTABILITY Mentoring Programme for Young Offenders % meeting # young weekly with people on mentor programme # reoffending % CLIENT reoffending RESULTS/OUTCOMES Contributio n relationship Alignment of measures Appropriate responsibili ty
Population Accountability Result: to which you contribute to most directly. Indicators: Every time you make a presentation, use a two-part approach Story: Partners: What would it take? : Role: as part of a larger strategy. Your Role Performance Accountability Programme: Performance measures: Story: Partners: Action plan to get better:
Population Accountability Result: to which you contribute to most directly. Indicators: Every time you make a presentation, use a two-part approach Story: Partners: What would it take? : Role: within the larger strategy. Your Role Performance Accountability Programme: Performance measures: Story: Partners: Action plan to get better:
Different kinds of progress 1. Data a. Population indicators: Reporting on curves turned: % increase or decrease of the graphed data (e. g. the baseline). b. Performance measures: Client group progress and improved service delivery: How much did we do? How well did we do it? Is anyone better off? E. g. Skills/Knowledge, Attitude/Opinion, Behaviour Change, Circumstance Change 2. Accomplishments Other positive activities accomplished, not included above. 3. Stories Real stories that sit behind the statistics that show individuals are better off e. g. case studies, vignettes, social media clips. 64
What’s next? A Basic Action Plan for Results Based Accountability TRACK 1: POPULATION ACCOUNTABILITY • • Establish results Establish indicators, baselines and charts on the wall Create a result card Set tables (action groups) to turn curves TRACK 2: PERFORMANCE ACCOUNTABILITY • Performance measures, and charts on the wall for programmes, agencies and service systems • Use 7 Questions manager by manager, and programme by programme, in management, budgeting and strategic planning
IN CLOSING
67
Kia ora / thank you! WEBSITES: www. raguide. org www. resultsaccountability. com BOOK /DVD ORDERS: www. sheapita. co. nz www. trafford. com www. amazon. com 68
- Slides: 68