PBOT Performance Framework Overview Framework Purpose To provide
PBOT Performance Framework Overview Framework Purpose To provide a structured framework for defining, measuring, and reporting on PBOT’s performance, and enable data “informed” decision making at all levels of the organization Today’s Focus Framework Components Levels of Measurement Data Governance Data Use (All Levels) Enterprise Level Policies/Standards Iterative Performance Cycle • Key, Bureau-wide, performance measures • Used to assess progress against PBOT’s short(strategic) and long (TSP) term goals Program Level • Informed by program goals and objectives • Map to enterprise level measurement priorities Project Level • Project specific measures • Map to organizational/program measurement priorities People Level • Staff level objectives • Map to organizational/Group priorities To guide data collection, storage, access, and use Tools To provide data access, automate data standards, and enable data analytics Training To improve data understanding, increase consistency of measurement efforts, and support staff Forecasting Test scenarios, estimate policy impact, inform long range planning Routines/ Reporting Put data to use, iterate and improve, openness and transparency Monitoring/ Evaluation Assess actual delivery, ground truth forecasts, enable course correction
PBOT Performance Measures are currently established for the Enterprise and Program Levels These measure, which are reflected in our FY 20/21 Budget, are a first step 1. Developed during the 2019/20 budget process, refined during the 2020/21 budget process 2. Took PBOT from 7 enterprise-wide measures to 54 measures that reflect both enterprise and programmatic priorities and progress These measures were developed based on a sub-set of performance management best practices, including 1. Measurability – must have supporting data and the ability to measure the “measure, ” at least, annually 2. Relevance – reflect the Bureau’s priorities, and in turn the program’s priorities (cascading measurement) 3. Continuity – must emphasize long term investment priorities, such that measures will not need to get replaced annually; measure “decommissioning” now subject to a formal process
Enterprise Level Current State - Annual Budget Key Performance Measures These longstanding measures align to our Bureau’s major areas of investment. They currently include: Measure Name Number of traffic fatalities Percentage of commuters who walked, biked, took transit, carpooled, or worked from home Percentage of busy (collector/arterial) streets in fair or better condition Percentage of local streets in fair or better condition Percentage of PBOT-owned bridges in non-distressed condition Annual Streetcar Ridership FY 2016 -17 FY 2017 -18 FY 2018 -19 Performance Actuals 42. 00 47. 00 34. 00 FY 2019 -20 Performance Actuals FY 2019 -20 Target (as of 12/31/19) N/A 50. 00 FY 2020 -21 Target Long Range Target N/A 0. 00 0. 42 0. 70 0. 50 0. 80 0. 35 0. 70 0. 41 0. 42 0. 40 0. 42 0. 50 0. 48 0. 43 0. 50 0. 36 0. 31 0. 28 0. 35 Measured Annually 0. 85 0. 84 0. 85 4, 720, 474. 00 4, 870, 556. 00 4, 491, 362. 75 5, 000. 00 2, 150, 000. 00 5, 000, 000. 00
Program Level Current State - Annual Budget Measures by Program Offer • The result of the Mayor’s 2018 Program Offer Requirements • Submitted with the Annual Budget; results are updated quarterly • An issue with the City’s central budget system currently results in 0’s showing across our measure sets (this is NOT the case) (Measures by Program Offer – will be provided to BBAC in full)
We are NOT done… our Bureau’s new Strategic Plan has ignited a Bureau-wide effort to “measure” better A few of our guiding questions… Are our policies and projects making the transportation system better? How are modal patterns changing over time and what investments deliver the greatest return? Are we seeing a noticeable reduction in carbon emissions? Who is benefitting most/least from our programs and projects? How and where should we prioritize our assets for investment? Is our safe systems work making the system safer?
Our ability to measure better largely rests on one thing… Better Data (including Access & Use)
PBOT’s Strategic Data Roadmap is our attempt to realize PBOT’s ‘ideal measurement state’ + + - Bureau-wide Performance Framework 2020 VMT Study (w/ Portland State Univ. ) REPLICA Pilot City. IQ Sensors/ Traffic Cordon Data Governance Committee Note: thinking is already underway as to how we can make better use of existing data in the event COVID 19 budget impacts delay or put an end to any of these efforts Vision Eval (w/ ODOT) 2021 Portland Urban Data Lake Congestion Study Annual Transportation Survey
All in all, the goal is to overhaul PBOT’s key performance measures and actualize those that really matter DRAFT “Future” Key Indicators (by Strategic Goal) DRAFT Measure Focus Transportation Justice Program & Investment Equity CIP and program distribution by geography to ensure equitable resource prioritization Program & Investment Climate Impact Measurement of Ghg, particulate matter, etc… (in coordination with BPS) Moving People & Goods (Mobility) Vehicle Miles Traveled in aggregate, as well as per Resident (per capita) Reduce Disparity – Transportation Affordability Tracking (year over year) transportation cost as % of total household expenditures Reduce Disparity - Access/Connectivity Measurement of access to networks, priority locations, and options by geographic, socio-economic variables Reduce Disparity – Travel Time Travel time disparities by geographic, socio-economic, and modal variables Mode Shift/Trips Change in trip distribution across SOV/non SOV modes Safety Traffic Injuries & Deaths Same as today Traffic Speed Comprehensive speed measurement approach Reduce Disparity - Safety Infrastructure Impact Safety project prioritization and resource distribution (e. g. , % to highest risk/most vulnerable) Resident Safety Perceptions Do residents feel like the system is getting safer? Asset Management Asset Condition State of Good Repair Targets that blend engineering targets w/ resident expectations Project Status/Impact Evaluation of Return on Investment across the PBOT’s asset portfolio Reduce Disparity – Investment Distribution & Impact Asset project prioritization and resource distribution (e. g. , % to historically underserved)
Future Key Indicators - Cont’d DRAFT “Future” Key Indicators (by Strategic Goal) DRAFT Measure Focus Organizational Effectiveness Measures related to Organizational Health, Solvency, and Efficiency To be determined once COVID 19 impact is better understood Community Impact Measures related to job creation, permitting efficiency/contributions to system, contract distribution (e. g. , % DMWESB) To be determined once COVID 19 impact is better understood
Appendix
Each effort is a piece of a larger analytics puzzle… ls e od M More Reliable, Representative, & Timely Modeling Ac tu al s Improve Ground Truth Data Gathering Tools & Policies Deliberate Governance & Management of PBOT Data Sensors/Traffic Cordon Vision Eval (Targets & Strategies) VMT Study Open Data/Data Governance REPLICA Pilot Congestion Study Portland Urban Data Lake Annual Transportation Survey
Accessibility VMT Access Mode Share Throughput Data Backbone? to promote data stewardship, data privacy, data management, and data transparency N/A N/A N/A Yes Data to acquire enhanced insight into mobility patterns and trends by purpose, time, and demographic factors N/A PBOT Performance Framework Data to align measurement efforts and communicate progress on key indicators both externally and internally N/A Portland Urban Data Lake Tech to deliver City owned, cloud based data architecture capable of managing realtime/big data N/A N/A N/A Yes Vision Eval (Targets & Strategies) Study to acquire the ability to run scenario based planning related to our long range mobility targets N/A Data to determine a viable/replicable method for calculating actual per capita VMT within city limits N/A N/A N/A Data/ Tech to establish a mechanism for gathering real time, 24/365 counts of peds, bikes, and cars traveling into/out of the Central City N/A N/A Study to survey best practice transportation analytics methods and assess their applicability for PBOT N/A Data to connect with Portlanders annually regarding their experience with our transportation system N/A Effort Open Data/Data Governance REPLICA Pilot VMT Study Sensors/Traffic Cordon Congestion Study Annual Transportation Survey Focus Policy Purpose
- Slides: 12