RBA ResultsBased Accountability The Fiscal Policy Studies Institute
RBA Results-Based Accountability The Fiscal Policy Studies Institute raguide. org & resultsaccountability. com SCORECARD Book & DVD Orders amazon. com clearimpact. com
SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL
RBA in a Nutshell 2– 3 -7 2 - kinds of accountability plus language discipline Results & Indicators Population accountability Performance measures accountability kinds of performance measures. 3 - How much did we do? How well did we do it? Is anyone better off? 7 - questions from ends to means in less than an hour. Baselines & Turning the Curve
Results-Based Accountability is made up of two parts: Population Accountability is about the well-being of WHOLE POPULATIONS for Communities – Counties – States - Nations Performance Accountability is about the well-being of CUSTOMER POPULATIONS for Programs – Agencies – Service Systems
THE LANGUAGE TRAP Too many terms. Too few definitions. Too little discipline Benchmark Outcome Result Modifiers Indicator Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Measure Goal Objective Target Lewis Carroll Center for Language Disorders Core qualitative strategic Make up your own jargon. Measurable urgent systemic
DEFINITIONS RESULT or OUTCOME condition of well-being for children, adults, families or communities. Population 1. A Children born healthy, Children ready for school, Safe communities, Environment, Prosperous Economy communities Clean Environment INDICATOR or BENCHMARK 2. A measure which helps quantify the achievement of a result. Performance Rate of low-birthweight babies, Percent ready at K entry, rate air quality index, index unemployment rate crime rate, PERFORMANCE MEASURE 3. A measure of how well a program, agency or service system is working. 1. How much did we do? Three types: 2. How well did we do it? 3. Is anyone better off? = Customer Results
IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? RESULT 1. Safe Community INDICATO 2. R PERF. 3. MEASURE RESULT 4. Crime Rate INDICATO 5. R RESULT 6. Rate of obesity Average Police Dept response time Healthy People have living wage jobs and income INDICATO R 7. % of people PERF. MEASURE income with living wage jobs and
Population Accountability
Community Outcomes for Christchurch, NZ Example of results for all residents ● A Safe City ● A City of Inclusive and Diverse Communities ● A City of People who Value and Protect the Natura Environment ● A Well-Governed City ● A Prosperous City ● A Healthy City ● A City for Recreation, Fun and Creativity ● A City of Lifelong Learning ● An Attractive and Well-Designed City
CARDIFF, WALES Community Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.
Getting from Talk to Action
Leaking Roof (Results thinking in everyday life) Experience Measure Inches of Water BASELINE Not OK ? Fixed Turning the Curve Story behind the baseline (causes) Partners What Works Action Plan # 2
Results / Outcomes Indicators Baseline & Story
75 people per day 45 people per day MADD 28 people per day 2010
Rebound
Hull, UK "Woundings"
Performance Accountability
Performance Accountability Types of Measures found in each Quadrant How much did we do? # Clients/custome rs # Activities (by served type of activity) # # How well did we do it? % Common e. g. client staff ratio, workload ratio, staff measures turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Activity-specific measures e. g. % timely, % clients completing activity, % correct and complete, % meeting standard Is anyone better off? % Skills / Point in Time vs. 2 Point Comparison Knowledge % Attitude / (e. g. parenting skills) Opinion % Behavior (e. g. toward drugs) (e. g. school attendance) % Circumstance (e. g. working, in stable housing)
Effort Education Quantity Quality How much did we do? How well did we do it? Number of students Studentteacher ratio Effect Is anyone better off? Number of high school graduates (completion or certificate rate) Percent of high school graduates (completion or certificate rate)
Effort Pediatric Practice Quantity Quality How much did we do? How well did we do it? Number of patients treated Percent of patients waiting less than 30 minutes in the waiting room Effect Is anyone better off? # children fully immunized % children fully immunized (in the practice)
Effort Drug/Alcohol Treatment Program Quantity Quality How much did we do? How well did we do it? Number of persons treated Percent of staff with training/ certification Effect Is anyone better off? Number of clients off of alcohol & drugs - at exit - 12 months after Percent of clients off of alcohol & drugs - at exit - 12 months after
Effort Fire Department Quantity Quality How much did we do? How well did we do it? Number of responses Response Time Effect Is anyone better off? # of fires % of fires kept to room of origin
Service: School Hospital Job Training Fire Department _________________ How much did we do? Primary persons patients students # customers trainedactivity Primary hours diagnostic alarms courses of # job instruction to tests responded How well did we do it? Unit cost Workload ratio % of ___x___ that happen on time Is anyone better If your serviceoff? works really well, how are your customer's better off? # students who persons patients keptwho to %fires graduate get jobs fully recover room of origin
Primary v. Secondary Direct v. Indirect Internal v. External LR UR Baseline & Story
Putting Population and Performance Accountability TOGETHER
THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY POPULATION RESULTS Healthy Births Rate of low birth-weight babies Children Ready for School Percent fully ready per K-entry assessment Self-sufficient Families Percent of parents earning a living wage Alignment of measures PERFORMANCE ACCOUNTABILITY Job Training Program # persons receiving training Unit cost person trained # who get living wage jobs % who get living wage jobs Contribution relationship Appropriate responsibility CUSTOMER RESULTS
Population Accountability to which you contribute to most directly. Result: Indicators: Every time you present your program, Use a two-part approach. Story: Partners: What would it take? : Role: as part of a larger strategy. Your Role Performance Accountability Program: Performance measures: Story: Partners: Action plan to get better:
Population Turn the Curve EXERCISE
Creating a Working Baseline from Group Knowledge Indicator or Performance Measure 65% ng Forecasti ng Backcasti Now Not OK?
Turn the Curve Exercise: Population Well-being 5 min: Starting Points - timekeeper and reporter - geographic area - two hats (yours plus partner’s) 10 min: Baseline - pick a result and a curve to turn - forecast (to 2022) – OK or not OK? 15 min: Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes Two 15 min: pointers What works? (What would it take? ) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min: Report convert notes to one page to action
4. ----- Off the Wall ONE PAGE Turn the Curve Report: Population Result: ________ Indicator Baseline Indicator (Lay Definition) Story behind the baseline --------------------------- (List as many as needed) Partners --------------------------- (List as many as needed) Three Best Ideas – What Works 1. -------------2. -------------- Sharp Edges 3. -----No-cost / low-cost 4. ----- Off the Wall
Performance Turn the Curve EXERCISE
Turn the Curve Exercise: Program Performance 5 min: Starting Points - timekeeper and reporter - identify a program to work on - two hats (yours plus partner’s) 10 min: Performance measure baseline - choose 1 measure to work on – from the lower right quadrant (to 2020) – OK not OK? 15 min: - forecast Story behind theorbaseline - causes/forces at work - information & research agenda part 1 - causes Two 15 min: pointers What works? (What would it take? ) works 10 min: Report convert notes to one page to action - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what
4. ----- Off the Wall ONE PAGE Turn the Curve Report: Performance Program: ________ Performance Measure (Lay definition) Performan ce Measure Baseline Story behind the baseline --------------------------- (List as many as needed) Partners --------------------------- (List as many as needed) Three Best Ideas – What Works 1. -------------2. -------------- Sharp Edges 3. -----No-cost / low-cost 4. ----- Off the Wall
Turn the Curve Exercise – Lessons Talk to Action in an hour 1. How was this different from other processes? What worked and what didn’t work? 2. Why did we ask for: a. Results before indicators? b. Forecast? c. Story? d. No cost / low cost? e. Two hats? f. Crazy idea? g. Only 3 best ideas? 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group? (2+ curves at the same time)
Next Steps What’s one thing I can personally do with what I learned today?
Resources raguide. org resultsaccountability. com clearimpact. com RBA Facebook Group SCORECARD Book & DVD Orders amazon. com clearimpact. com
THANK YOU ! Book - DVD Orders amazon. com resultsleadership. org
- Slides: 42