Impact of Emerging Immersive Technologies on Commercial Pilot

Impact of Emerging Immersive Technologies on Commercial Pilot Training Paul Sheward CEng MIET, Collins Aerospace Headup Guidance Systems JUNE 2019 © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data.

Introduction What are immersive technologies? Why emerging immersive technologies are becoming relevant in today’s commercial aviation training environment? How Collins Aerospace has developed a VR Training Solution for its Head. Up Display System Technologies that is gathering significant interest from the pilot training community. The HUD VR Trainer and what makes it unique Future potential for immersive technologies © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 2

Definition of Terminology - Immersive Technologies Mixed Virtual Augmented © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 3

UTC/Collins Aerospace Developments There a number of UTC/Collins Aerospace development pipelines looking at the application of Immersive Technologies and Environments. AR - Headup Display Systems Pilot Headworn Displays Engine Maintenance Systems MR - Coalescence. TM Soldier Systems - Squad Training VR - Head-Up Display Systems Part Task Trainer ● ● ● Immersive Headset See & Interact or Tablet with real world Generalin. Procedure objects Seamless VR Training Component Provides “Limitless” Tactile Training Visualisation Feedback Workeffective Could Cost Instructions be utilised in low level Narrated Tours FTDs © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 4

The Training Challenge Facing the Aviation Industry In 2017 there were 290, 000 active airline pilots globally. On average approximately 20, 000 pilots enter the airline pilot profession each year worldwide. CAE forecasts that the industry will need 255, 000 new airline pilots over the next 10 years (2017 -2027), for a total of 440, 000 active pilots by 2027 Source: CAE Pilot Demand 10 year Outlook (2017) © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 5

Familiarisation… Training… Proficiency CBT Ground Based and/or Classroom Instruction Level 4 Procedures Trainer Line Operation Experience/Qualification Level 5 or 6 Flyable fixed-base training device Full-Flight Level ‘D’ Simulator © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 6

The Argument for Emerging Immersive Technologies Cost of a Level D FFS is in the order of $10 M plus operating costs. Hourly “rental” of a Level D FFS costs between $300 -$500 and the number of simulators available is limited both in number and in some cases geographically. Availability of simulator assets and the associated access bottleneck increases the time required for pilot certification/type rating and/or specific equipment certification. As an example, training related costs make up >25% of cost of adopting HUD/HGS, per tail number. (>$100, 000/tail number across fleet sales - Boeing 737) “Importance of being able to train pilots quickly and efficiently will increase dramatically with an emphasis on lower level training devices. ” Source: Boeing 20 -year commercial pilot demand forecast © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 7

Changing Times Industry indicators show increased interest in applications leveraging immersive technologies for flight training tasks. Developing trend of moving FFS and high-level FTD training tasks to lower level devices. There is a huge forecasted pilot demand that can only be met by more innovative, efficient and effective training methods. Effectiveness and availability for some training tasks will trump historical focus on simulation fidelity. "There will always be a place for Full Flight Simulators, but solutions that could reduce FFS training footprint would have significant value". Source: Boeing © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 8

Familiarisation… Training… 4 Hours CBT Ground Based and/or Classroom Instruction Line Operation Experience/Qualification -- HUD Recommendations -- 2 -4 Hours Level 5 or 6 Flyable fixed-base training device 2 -4 Hours Full-Flight Level ‘D’ Simulator © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 9

But what about Proficiency? One of our fleet operators stated: “We estimate that it takes a pilot between 300 -350 hours of HUD/HGS use to become proficient. ” Given that typical flight operations see HUD/HGS used for approach only, this could take a pilot quite a while! Typical training programs do not have training assets with high availability that can accommodate the recursive training to achieve proficiency. © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 10

. . . and then there’s China! HUD use is mandated on all commercial aircraft in China starting 2025 Both new and experienced pilots will need to be trained on HUD/HGS technology This will put even greater stress on training facilities Can Chinese Airlines train it’s entire pilot cadre (current and new) on HUD in the next 6 years? © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 11

Introduce the HUD VR Trainer Original Objectives of the VR Trainer: • Develop a low cost part-task trainer for HUD/HGS • Provide same or better capability than existing CBT and Level 4 -6 FTDs • Leverage Collins Simulation Technologies including Image Generation • High Fidelity - Seamless Training Experience • Immersive user experience • Scalable/Portable - Suitable for Classroom or individual training © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 12

HUD VR Trainer © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 13

HUD VR Trainer Combines Multiple Collins Technologies & IP Simulation Environment ● ● ● Core. Sim. TM Instructor Associate Generic Aero Model Digital interfaces Enhanced Vision (IR) Rehosted HGS Software (Aircraft Type specific) ● ● Visual Environment ● ● ● EP 2/EP 80 Image Generator 3 D 360 O Cockpit CAD models of LRUs Digital MCP & MCDU Virtualisation using Blender. TM and Unity. TM Symbology Generator Synthetic Vision © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 14

Immersive Experience - Seamless Training © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 15

Pilot’s Visual Enhancements Combined Enhanced Vision(Rehost) (Simulated) Synthetic Vision © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 16

What does this mean for the Training Timeline? 4 -8 Hours Narrated or Instructor led Introduction and Training Line Operation Experience 1 -2 Hours Full-Flight Level ‘D’ Simulator © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 17

The (near) Future • Improvement in headset optical quality • Multi-user Classroom Environments (1 presenter, multiple viewers) • Remote instruction (pilot and instructor in different physical locations but in the same virtual space) • Avatars • Haptics © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 18

A demonstration of the HUD VR Trainer will be available for the duration of the event. Questions? © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 19

THANK YOU © 2019 Collins Aerospace, a United Technologies company. All rights reserved. Collins Aerospace Proprietary. This document contains no export controlled technical data. 20