Requirements Driven Test Design Quickly Aligning to the

Requirements Driven Test Design: Quickly Aligning to the Third Offset Strategy Melanie Di. Antonio Air Academy Associates mdiantonio@airacad. com (757) 338 -1191

Requirements Driven Test Design: Quickly Aligning to the Third Offset Strategy • Introduction • Offset Strategies: One slide to cover a 67 -year history • Solution • Requirements Driven Methodology – Answering your question, “What’s In It For Me? ”

Introduction • Test & Evaluation (T&E) • System or components are compared against requirements and specifications through testing • Results are evaluated to assess progress • Design • Performance • Supportability • Finding the requirements • Performance gaps • Capability and / or capacity • Evolution and maturity of the strategy

System Effectiveness and Component Performance Operational Construct: United States Air Force Personnel Recovery HC-130 AWACS SADL ALL Areas, minus Sells HH-60 Link 16 JSTARS A-10 HH-53 ETC ETC Sells, Air to Air H/L, SADL SATCOM – CONR 3 DCN – UHF Voice Coord – Vo. Sip L 11 – UHF L 11 - HF EC-130 ? WADS Link 16 Luke, BMG Range Ops SADL AFSOUTH COP TTC JREAP-C JRE/C 2 PC JREAP B Douglas AFNORTH ROC L 11

System Effectiveness and Component Performance Organizational Construct: Strategic Planning VISIO rd a bo h as N D Standard Work ard o hb rd s Da Cell oa hb s a D TAKT 6 S 8 -Step Countermeasures Visual Mgmt Metrics Counter-measures WHAT WHEN WHO CMR + UTE = Readiness Operator Flight TAKT DAILY Squadron WEEKLY Wing & Group MONTHLY MAJCOM USAF ANNUAL

Offset Strategies • Asymmetrically compensating for a disadvantage • Seeks to deliberately change an unattractive competition to one more advantageous for the implementer • Seeks to maintain advantage over potential adversaries • Countering an apparent advantage – finding ways to counter a threat

Offset Strategy • First Offset Strategy • 1950’s: Counter the numerical strength of military adversaries with technical innovation • Solution: Grow an arsenal of nuclear weapons for deterrence • Second Offset Strategy • 1970’s/1980’s: Precision-guided conventional weapons with Joint Operations • Solution: Precision and stealth to achieve desired military effects • Intelligence, Surveillance, and Reconnaissance • Precision Guided Weapons and Stealth Technology • Space-based military communications and navigation • Third Offset Strategy • 2017: • Outmaneuver adversaries through technology • Technologically enable operational and organizational constructs to give the joint force an advantage operationally and tactically, thereby strengthening conventional deterrence • Solutions: • Artificial Intelligence, autonomy – joint collaborative human-machine battle of networks What do Offset Strategies Create? ? ?

Gaps Once you Identify the Gap – then what do you have?

Requirements Now to find the data.

Solution: Statistically Aligning to Requirements Measure of Strategic Effectiveness Measure of Operational Performance Measure of System Effectiveness Measure of Component, Process or Procedure Performance

How It Works: Second Offset Strategy What strategic gaps closed Requirement Precision-guided conventional weapons with Joint Operations Strengthen Global Precision Attack Capability and Effects for the entire Range of Military Operations How much more effective What operational gaps closed How much faster, better, efficient Deliver Desired Effect Anywhere on the Globe Improve capability and capacity to Find, Fix, Track, Target, Engage, Assess Measure of Effectiveness (Mo. E) Requirement Measure of Performance (Mo. P)

Solution: Statistically Aligning Test to Requirement: Technologically enable Requirements operational and organizational constructs to give the joint force an advantage operationally and tactically, thereby strengthening conventional deterrence Third Offset Strategy What strategic gaps closed How much more effective How much faster, better, efficient Effectiveness in Asymmetrical Warfare Measure of Effectiveness (Mo. E) Improved: Weapons, Decisions, Reactions, Coordinated Attack Operational and Organization Capability and Capacity Outcomes: • Outmaneuver our Adversaries • Joint collaborative human-machine battle of networks Requirement: High Quality, On-Time Delivery, Best. Value, Compliant Measure of Performance (Mo. P) Artificial Intelligence Autonomous Systems

Measures of Effectiveness and Measures of Performance • Measures of Effectiveness (Mo. Es) • How well an operational task is accomplished through the weapon system • Measures of Performance (Mo. Ps) • Quantitative (or qualitative) measures of system capabilities • Mo. Ps are components of Mo. Es • The degree to which a system performs tells us how well a systems task is accomplished • Quantitatively can be collected through metrics to feed the Mo. E Rule of Thumb: Mo. Ps tell us if we do things right Mo. Es tell us if we do the right things

How It Works: Second Offset Strategy and Global Precision Attack 20 Year Plan Measures of Performance Measures of Effectiveness CONOPs, Weapon Systems, TTP, etc. OBJECTIVE In terms of Quality, Delivery, Cost and/or Compliance Scalability Data Data Stealth Data Data Connectivity Data Data Flexibility Data Data Speed Data Data Measures of Effectiveness CAPABILITIES AND CAPACITY Measures of Performance Find Fix Track Target Engage Assess Precision Data Data Lethality Data Data Survivability Data Data Persistence Data Data

Identify the Data Mo. P Command & Control Example Mission Snapshots Network Size Network Loading Movement Posture SATCOM Band SATCOM Look Angle Link Degradation Node Degradation EW Interoperability IA Security Message Type Message Size Distance Between Nodes Choices (# of levels) Entry, Operations, Consolidation 10 Nodes, 50 Nodes, 100 Nodes Nominal, 2 X, 4 X ATH, OTM 1, OTM 2 Ku, Ka, Combo 0, 45, 75 0%, 5%, 10%, 20% None, Terrestrial, GPS Joint Services, NATO None, Spoofing, Hacking, Flooding NIPR, SIPIR Data, Voice, Video Small, Medium, Large, Mega Short, Average, Long (3) (3) (3) (4) (3) (2) (4) (2) (3) (4) (3)

Collect the Data Command & Control Example

Mo. Ps to Mo. Es Operational Construct: United States Air Force Personnel Recovery HC-130 AWACS SADL ALL Areas, minus Sells HH-60 Link 16 JSTARS A-10 HH-53 ETC ETC Sells, Air to Air H/L, SADL SATCOM – CONR 3 DCN – UHF Voice Coord – Vo. Sip L 11 – UHF L 11 - HF EC-130 ? WADS Link 16 Luke, BMG Range Ops SADL AFSOUTH COP AFNORTH JRE/C 2 PC JREAP B TTC Douglas JREAP-C ROC L 11

Requirements Driven Methodology • Fact-based decisions for testing technology vs. consensus-driven decision making • Relevant measures provide clarity about current • • Realities Risk Threats Opportunities • Provides predictability around driving new enabling concepts and technologies forward • Mo. Es and Mo. Ps add precision and accuracy • • Adapting strategy Changing operations Investing and divesting in technologies Evolving tactics, techniques and procedures • Competitive advantage for providing warfighters with technologies (Third Offset Strategy) • Enables organizational and operational constructs • Mitigates risk • Closes capability gaps

Questions and Answers Melanie Di. Antonio Strategy and Policy Deployment Associate mdiantonio@airacad. com (757) 338 -1191