Safety Performance Criteria Agreeing on Assumptions BEIJING CHINA

Safety / Performance Criteria Agreeing on Assumptions BEIJING, CHINA; 30 JUN-11 JUL 2014 1

Objective This module provides an overview of Performance and Safety Criteria as well as Project Assumptions 2

Why? Why set performance criteria ✈ Measurement ✈ Determine success ✈ Evaluate safety 3

Assessment Q Qualitative Assessment Ø Expert judgement used to assess the design based on ICAO SARPs (Standards and Recommended Practices) and Procedures Q Quantitative Assessment Ø Quantified results produced in the form of numerical data e. g. capacity increased by 20% Both Qualitative and Quantitative assessment are crucial to safety and performance assessment 4

Evaluating Safety References: ✈ ICAO Doc 9859, AN/474, Safety Management Manual (SMM) ✈ ICAO Doc 9689, Manual on Airspace Planning Methodology for the Determination of Separation Minima ✈ ICAO Circular 319 -AN/181, A Unified Framework for Collision Risk Modelling in Support of the Manual on Airspace Planning Methodology for the Determination of Separation Minima (Doc 9689) ✈ ICAO Doc 9613, Performance-Based Navigation Manual ✈ ICAO Doc 8168, Procedures for Air Navigation Services, Volume I, Flight Procedures ✈ ICAO Doc 9905, RNP AR Procedure Design Manual ✈ ICAO Doc 4444, Procedures for Air Navigation Services, Air Traffic Management. 5

SAFETY MANAGEMENT SYSTEM (SMS) Ref: ICAO 9859, 2. 2 6

SAFETY THEORY Various defences are built into the aviation system to protect against fluctuations in human performance or decisions at all levels of the system. Organizational & Structural Pressure ers lay nsive defe 7

SAFETY MANAGEMENT SYSTEM (SMS) Traditional Approach: • Data collection and analysis efforts are limited to data collected through investigation of accidents and serious incidents. New Approach: • Adds routine collection and analysis of data using proactive as well as reactive methodologies to monitor known safety risks and detect emerging safety issues. These enhancements formulated the rationale for moving towards a safety management approach. Ref: ICAO 9859, 5. 1 8

SAFETY MANAGEMENT SYSTEM (SMS) • A SMS is a system to assure the safe operation of aircraft through effective management of safety risk. • This system is designed to continuously improve safety by identifying hazards, collecting and analysing data and continuously assessing safety risks. • The SMS seeks to proactively contain or mitigate risks before they result in aviation accidents and incidents. Ref: ICAO 9859, 5. 1 9

SAFETY MANAGEMENT SYSTEM (SMS) A SMS is not static but is designed for continuous improvement. a) Develop forms for internal evaluations. b) Define an internal audit process. c) Define an external audit process. d) Define a schedule for evaluation of facilities, equipment, documentation and procedures to be completed through audits and surveys. e) Develop documentation relevant to operational safety assurance. Ref: ICAO 9859 10

SAFETY MANAGEMENT SYSTEM (SMS) The four components of a SMS are: • a) safety policy and objectives; • b) safety risk management; • c) safety assurance; and • d) safety promotion Ref: ICAO 9859, 5. 3 11

Safety Risk Management Ref: ICAO 9859 12

Safety Management Identify Hazards Evaluate Hazards 13

Safety Management Mitigate vs Eliminate Hazards 14

Evaluating Safety Ref: ICAO 9859 15

Risk Assessment Ref: ICAO 9859 16

Risk Management Ref: ICAO 9859 17

ASSUMPTIONS 18

Assumptions Columbus challenged the Spanish courtiers to stand an egg on its end. They tried but failed. He then hard-boiled one and squashed it down. “That’s not fair, ” they protested, “you broke the rules. ” “Don’t be silly, ” he replied, “you just assumed more than you needed to. ” What unnecessary assumptions can you eliminate? 19

Assumptions 20

Assumptions 21

Assumptions PBN 22

A few examples …. ✈ Changing a radar ✈Blocked military airspace – that wasn’t ✈ Changing planned runway orientation ✈ Change to the number of runways available 23

Questions? ? ? 24