Johnson Space Center Safety Mission Assurance Safety Performance

Johnson Space Center Safety & Mission Assurance Safety Performance Measures Contractor Safety Forum Panel Discussion June 3, 2008 Contractor Safety Forum 1

Johnson Space Center Safety & Mission Assurance Agenda • Introduction of Panelists • The NASA Safety Performance Measurement Process • Performance Influences “Beyond the Numbers” • Panel Comments and Q&A June 3, 2008 2

Johnson Space Center Safety & Mission Assurance Panel Introduction Billy Autry NASA Procurement Policy Derek Robins SAIC Department Manager, Safety & Test Operations Cynthia Hendershot Program Manager, Raytheon, NBL/SVMF Operations David Loyd Chief, NASA Safety & Test Operations Division June 3, 2008 3

Johnson Space Center Safety & Mission Assurance NASA Safety Performance Measurement Process In 2006 S&MA clarified the safety performance measurement process to: • Guide consistent interpretation of injury metrics • Provide flexibility in considering subjective elements, anecdotal evidence, and circumstances surrounding safety performance • Solidify roles – – NASA Safety as a consulting resource – COTR as ultimately responsible for performance scoring June 3, 2008 4

Safety & Mission Assurance Johnson Space Center Safety Evaluation Process End of Performance Period Contractor mishaps rates and other relevant safety data assessment NS provides safety metrics summary and metrics adjective rating June 3, 2008 Performance Evaluation Board Meeting “Balanced Safety Score Card” Fee Determination Official Meeting S&MA Director/Deputy Director at each FDO Meeting COTR and S&MA TMR Collaborate on overall Safety Evaluation 5

Johnson Space Center Safety & Mission Assurance Example Safety Metrics A B June 3, 2008 6

Johnson Space Center Safety & Mission Assurance Safety Evaluation Score Card A Adjective Rating of metric scores determined by matrix of exceeds, meets & does not meet B Other metric factors are evaluated to determine overall safety metrics adjective rating: • Type A & B Mishaps • OSHA Violations • Rate History • Correctness/timeliness of mishap/288 reporting • Size of contract C NS provides final metrics strengths/weaknesses and adjective rating to COTR and/or S&MA TMR June 3, 2008 7

Safety & Mission Assurance Johnson Space Center “Balanced Safety Scorecard” “Reaction” (Safety Metrics) performance rating -- Based on data provided and injury/illness performance, NS Recommends a rating of ______. This rating is only a portion of the overall safety score – other factors (Leadership, Prevention & Issues) and circumstances will determine the overall safety score. This overall score must be provided and defended by the COTR. C NOTE: Zero injuries/illnesses may only mean that you are either lucky or underreporting. Zero only has meaning if there is a proactive S&H Program June 3, 2008 Category Expectation Strengths Weaknesses Leadership “Safety” is an integral part of great leadership – “leadership” is an integral part of an effective safety & health program Provided by TMR and COTR Prevention You must have a S&H Program that meets the requirement of the JSC S&H Handbook (i. e. a pro-active, leadership and employee involvement based S&H Program) Provided by TMR and COTR Reaction You are expected to achieve injury/illness rates below the industry average and to keep trying to reduce them to zero Provided by NS based on metrics as compared to industry averages and other metric factors (e. g. type A mishaps) Provided by NS - based on metrics as compared to industry averages and other metric factors (e. g. type A mishaps) Issues Manage “issues” and implement appropriate risk mitigation/control and corrective action. Provided by TMR and COTR 8

Johnson Space Center Safety & Mission Assurance Performance Influences “Beyond the Numbers” NASA deliberates to develop safety performance rating. In addition to metrics data provided, “Balanced Scorecard” must be developed and considered in scoring. Example “Balanced Scorecard” considerations: Leadership: – Substantive actions taken by management to: • Address specific injury categories; • Lead supervisors through injury preventive exercises, activities, or training; • Support and/or participate in employee awareness campaigns Prevention: – Proactive programs with measurable impact on injury/mishap reduction – • Actions based on close call trending; • Improvement activities based on employee inputs Issues: • Corrective action delays • Poor safety/health compliance in planning or operations June 3, 2008 • Mishaps or compliance problems in which NASA influence was a significant factor 9

Johnson Space Center Safety & Mission Assurance Leadership - Special safety/injury analyses - Safety & health training/seminars - Resolving employee concerns - Hosting employee roundtables Prevention - Timely close call resolution - Ad-hoc inspection activities - Unique safety & health training - Successful improvement programs - Inconsistent discipline - Tacit approval of unsafe behaviors - Minimal recognition of safe behavior - Ambiguous direction to cut corners - Poor inspection/audit results - Sluggish close call participation - Poor training attendance - Insufficient safety org. performance Issues - Safety awards and recognition - Injury prevention milestones - Resolution of unique hazards - Win-win safety integration with projects Reaction - Effective case management - Comprehensive investigations - Timely corrective actions - Quick & accurate injury reporting - Proactive consultation with OSHA - Untimely injury reporting - Poor case management - Erroneous injury reporting - Poor mishap investigation June 3, 2008 - Ineffective communications - Poor safety integration with projects - Unresolved compliance issues - Delays in corrective action 10

Johnson Space Center Safety & Mission Assurance Panel Discussion • Panelist Comments • Question & Answer • Comment Cards June 3, 2008 11