Systems Engineering Challenges Air Force Systems Engineering Conference

Systems Engineering Challenges Air Force Systems Engineering Conference 17 August 2011 C. Douglas Ebersole Director of Engineering, F-35 Lightning II Program FOR OFFICIAL USEDISTRIBUTION ONLY // REL TO USA, GBR MOD, NLDfor MOD, TURrelease; MND, CAN DND, AUS is DOD, DNK MOD, and NOR MOD STATEMENT A. ITA Approved public distribution unlimited. 1

Problem Statement Identify systems engineering challenges to the execution of the F-35 program. Identify means to mitigate negative impacts through effective systems engineering policy, practices and people. DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 2

Outline • • Overview of F-35 Program Systems Engineering Challenges/Mitigations Workforce Management and Support Final Thoughts DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 3

F-35 Characteristics • Key Attributes: – Stealth – Integrated Avionics – A/G Munitions – Intraflight DL – Adv A/C Survivability • General Features: – Single seat – Speed: 700 kts or 1. 6 M (630/1. 6 M STOVL) – Ceiling: 50, 000 ft+ – Engine: PW F 135 • Sensors – Fully integrated open architecture system – A/G – A/A radar/SAR – Electro Optical A/G Targeting system – A/A IRST – Electronic Support Measures (ESM) – Short range EO spherical coverage CTOL (AF) Length: 51. 4 ft Wing Area: 460 ft 2 Weight (Empty): 29, 400 lb Internal Fuel: 18, 200 lb Range: 600 + nm STOVL (BF) Length: 51. 1 ft Wing Area: 460 ft 2 Weight (Empty): 32, 600 lb Internal Fuel: 13, 500 lb Range: 450 + nm CV (CF) Length: 51. 4 ft Wing Area: 668 ft 2 Weight (Empty): 34, 900 lb Internal Fuel: 19, 700 lb Range: 600 + nm Three Variants: Max Commonality And Interoperability DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 4

F-35 Program At Nexus of Planned Concurrency 1990 ASTOVL 1995 MRF ATA JAST 2000 2005 2010 2015 2020 2025 2030 2035 Eglin AFB ITC Operations JSF CDP NATF JSF SDD AX Derivatives and Enhancements System Development and Demonstration FMS F-35 PRECURSOR PROGRAMS: Advanced Short Takeoff Vertical Landing Multi-Role Fighter Advanced Tactical Aircraft Naval Advanced Tactical Fighter Advanced Attack Joint Advanced Strike Technology / Concept Demonstration Phase LRIP Low Rate Initial Production Full Rate Production Performance Based Global Sustainment DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 5

Systems Engineering “V” Pre-Milestone C Interpret User Needs, Refine System Performance Specs & Environmental Constraints Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs and Environmental Constraints Validation Linkage Trades Develop System Functional Specs & Verification Plan to Evolve System Functional Baseline Verification Linkage Evolve Functional Performance Specs into System Allocated Baseline Verification Linkage Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Verification Linkage System DT&E, OT&E, LFT&E & OAs Verify System Functionality & Constraints Compliance to Specs Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Individual CI Verification DT&E Fabricate, Assemble, Code Update Constraints, & Cost/Risk Drivers DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 6

Systems Engineering “V” Pre-Milestone C Interpret User Needs, Refine System Performance Specs & Environmental Constraints Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs and Environmental Constraints Validation Linkage Trades Develop System Functional Specs & Verification Plan to Evolve System Functional Baseline System DT&E, OT&E, LFT&E & OAs Verify System Trades Functionality & Constraints Compliance to Specs Challenge: Linkage Verification Evolve Functional Performance Specs into System Allocated Baseline Verification Linkage Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Maintaining common air system level requirements Individual across. CIbroad stakeholder base. Verification Linkage Mitigation: DT&E JSF Executive Steering Board control of system level requirements. Fabricate, Assemble, Code Update Constraints, & Cost/Risk Drivers DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 7

Systems Engineering “V” Pre-Milestone C Interpret User Needs, Refine System Performance Specs & Environmental Constraints Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs and Environmental Constraints Validation Linkage Trades Develop System Functional Specs & Verification Plan to Evolve System Functional Baseline System DT&E, OT&E, LFT&E & OAs Verify System Functionality & Constraints Compliance to Specs Challenge: Linkage Verification Evolve Functional Performance Specs into System Allocated Baseline Verification Linkage Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs 453 Shall Statements Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Individual CI Verification Performance Based Acquisition broad Verification Linkage DT&E definition of system level requirements. Mitigation: Fabricate, Assemble, Code Update Constraints, & Cost/Risk Drivers Definition of required functional attributes necessary via mission de-comp, use cases, active user engagement, other. DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 8

Systems Engineering “V” Pre-Milestone C Challenge: Interpret User Needs, Refine System Performance Specs & Environmental Constraints Combined DT&E/OT&E/LFT&E Government oversight of requirements of Demonstrate System to Linkage Specified User Needs and allocated baseline. Validation Trades Mitigation: Environmental Constraints Manage. Trades to risk. active System Taking DT&E, OT&E, LFT&E steps to Verification & OAs Verify System recover control for identified Functionality & Constraintsrisk areas. Linkage Compliance to Specs Example: Helmet Mounted Display System Develop System Functional Specs & Verification Plan to Evolve System Functional Baseline 3. 2. 1. 1. 1. 3. 7. The JSF Air System shall provide … and night vision target techniques, including visibility through Integrated DT&E, LFT&E & Verification aircraft structures to execute missions … EOAs Verify Performance Linkage Evolve Functional Performance Specs into System Allocated Baseline Compliance to Specs Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Verification Linkage Individual CI Verification DT&E Gen II Helmet EODAS sensors HTS DMC-H Fabricate, Assemble, Required specificity: Code Update Constraints, & Visual acuity as function Cost/Risk Drivers of light conditions End to end system latency DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 9

Systems Engineering “V” Pre-Milestone C Challenge: Active management of program risk at lowest configuration item. DT&E/OT&E/LFT&E level. Combined Interpret User Needs, Mitigation: Refine System Performance Specs & Environmental Constraints Validation Demonstrate System to Specified User Needs and Environmental Constraints Linkage Trades Access to program data artifacts, active TPM and risk management Trades Develop System Functional Specs & Verification Plan to Evolve System Functional Baseline Verification Linkage Evolve Functional Performance Specs into System Allocated Baseline Verification Linkage Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Verification Linkage System DT&E, OT&E, LFT&E & OAs Verify System Functionality & Constraints Compliance to Specs Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Individual CI Verification DT&E Fabricate, Assemble, Fabricate, Code Update Constraints, & & Update Cost/Risk Drivers Cost/Risk DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 10

Systems Engineering “V” Pre-Milestone C Challenge: Interpret User Needs, Refine System Performance Specs & Environmental Constraints Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs and Environmental Constraints Validation Linkage Trades Develop System Concurrent development of. Functional multiple air Specs & Verification Plan to Evolve System Functional system software builds. Drives close Baseline coordination across major system components (flight sciences, mission Evolve Functional systems, ALIS, PHM, training systems). Performance Specs into Stresses program resources. System Allocated Baseline Trades Verification Linkage Mitigation: Evolve CI Functional Broad investment in component and system Specs into Product Verification (Build to) Documentation level test and laboratory infrastructure. Tools Linkage & Verification Plan to have program level sight picture of all components. Disciplined burndown of SDD Fabricate, Assemble, success criteria. Code Update Constraints, Example: F-35 Software Build Status Cost/Risk Drivers & Success Criteria Burndown System DT&E, OT&E, LFT&E System & OAs Verify System & Functionality & & Constraints Functionality Compliance to to Specs Compliance Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Individual CI Verification DT&E DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 11

F-35 Software Build-Up Status Block 3 Final (Full SDD war-fighting capability, SW Retrofit) DEL SW Phase for each LRIP fleet release REQ SIT DEV Fill Level Denotes % Complete Color Denotes Status to Plan (Multi-Level Security, Full Block 1 Avionics) Block 1 A SIT On-board SW DEL SIT REQ DEV SC SIT REQ DEV As of 26 July 2011 SIT REQ DEV DEL REQ SIT DEV REQ DEV SC Supplier Dev: 89% Act vs. 92% Plan Prime Dev: 15% Act vs. 36% Plan REQ SIT DEV MS Integration: 5% Act vs. 26% Plan AIHM Dev: 39% vs. 47% Plan ALIS Dev: 88% vs. 100% Plan projecting Aug Start vs May Plan SC DEL DEV MS Integration: 83% Act vs. 95% Plan GLOC CTE Off-board SW (Tech Refresh 2) REQ SIT REQ DEV Block 3 Initial (SW Retrofit) DEL (Eglin Ready for Training) Block 2 B SIT Block 2 A Block 1 B DEL SC SIT REQ SC SIT DEV REQ DEV SC SIT REQ Legend Notes • On-board SW includes IPT: MS, VS, PHM Prime SW, Suppliers • Off-board SW includes IPT: OMS, ALIS, AIHM • Color codes based on IPT with lowest status against plan • Relative weighted across requirements, development, SI&T and SW based on effort DEV Software Phase REQ DEV SIT DEL SC Requirements Development Code &Unit Test System Integration & Test/ Rework Delivery (DD 250/Production Readiness) Security Cert/Govt. Acceptance DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Status against plan Complete >=95% of Plan 90 -95% of Plan <90% of Plan 12

VT&E Success Criteria Completion Metric 3000 12. 31. 2008 1. 1. 2010 1. 1. 2011 1. 1. 2012 1. 1. 2014 1. 2. 2015 1. 2. 2016 Actual Burn Down Block 0. 5 2500 # VT&E Success Criteria Remaining 1. 1. 2013 1. 1. 2017 Actual Total Activity Block 1 2000 # Block 0. 5 # Block 1 # Block 2 # Block 3 23 50 7 68 69 430 814 1497 Totals: 148 2810* Block 2 Baseline Burn Down 1500 Planned Burn Down 1000 Block 3 500 1175 SCs to Be closed In 2016 and Beyond 0 Q 1 Q 2 Q 3 2009 Q 4 Q 1 Q 2 Q 3 2010 Q 4 Q 1 Q 2 Q 3 2011 Q 4 Q 1 Q 2 Q 3 2012 Q 4 Q 1 Q 2 Q 3 2013 Date Q 4 Q 1 Q 2 Q 3 2014 Q 1 Q 2 Q 3 2015 Q 4 Q 1 Q 2 Q 3 2016 Q 4 Q 1 Q 2 Q 3 2017 Q 4 * - Excludes 225 SP 1 & 65 SP 2 Success Criteria DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 13

Systems Engineering “V” Pre-Milestone C Challenge: Interpret User Needs, Refine System Performance Specs & Environmental Constraints Linkage Trades LRIP production aircraft delivery concurrent to System Functional continued SDD Develop execution. Verification Mitigation: Combined DT&E/OT&E/LFT&E Demonstrate System to Specified User Needs and Environmental Constraints Validation Specs & Verification Plan to Evolve System Functional Baseline Trades Linkage Clear definition of incremental system level performance to be delivered with each LRIP lot Evolve Functional Verification Performance Specs into to execute user mission needs. Linkage System Allocated Baseline System DT&E, OT&E, LFT&E & OAs Verify System Functionality & Constraints Compliance to Specs Integrated DT&E, LFT&E & EOAs Verify Performance Compliance to Specs Example: Block development plan. Evolve CI Functional Specs into Product (Build to) Documentation & Verification Plan Verification Linkage Individual CI Verification DT&E Fabricate, Assemble, Code Update Constraints, & Cost/Risk Drivers DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 14

Block Plan: Capabilities / Transition Plan NOTE: Block 2 B and 3 C Fleet Release timing under development (SDD Replan) Includes Proposed “Accelerated” Block 2 B Weapons (AF & CF) DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 15

A Bit About Personnel CSAF Vector: "Improved acquisition performance begins with experienced professionals, using the right analytic tools and processes, all supported by transparent decision-making". JSF Do. E Challenge: Transition Engineering Community of Practice from one that “Reviews and Reports” to one that “Engages and Influences” • Current F-35 Engineering Workforce – 765 Engineers across numerous work sites representing 83 specific competencies • Feb-Jun 11 we completed 100% audit of all spaces/75% of faces – Resulted in need to re-align workforce competencies and re-assign personnel – Committed to stand up FTW JPO engineering presence – Identified the requisite data and artifacts required for staff to meet expectations • Transition of workforce to be accomplished throughout FY 12 DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 16

Closing Thoughts • VADM Venlet’s commitment to program execution coming out of the N-M re-certification. – Realism in planning – Transparency in all we do – Program grounded in disciplined systems engineering • It’s not hard … it’s not free … but it requires discipline and commitment • For most—simply follow your SEP – Systems Engineering Technical Reviews critical • Enables “gated” approach to program execution DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 17

Effective Use of SETR as Program Gates DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 18

DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. 19