FCS ACQUISITION EVALUATION TEAMING Army Test and Evaluation

FCS ACQUISITION & EVALUATION TEAMING Army Test and Evaluation Command

Evaluation Strategy Elements FCS (Platforms, Networks, …) MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) TT OT Data Element Level Cap/Lim E, s, s, + Unks Core Compl Systems M&S FCS Fo. S/So. S Cap/Lim E, s, s, + Unks Joint/ Compl Systems M&S Cap/Lim @ So. S, S, S, + Unks Cap/Lim S, S, +Unks MISSION Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission + Unks Sensitivity Analyses By Thread Cap/Lim @ Mission, S, S, + Unks Capabilities & Limitations By Mission + Unks Cap/Lim S, S, +Unks Updated as Systems Mature 2

Traditional Acquisition Program Mission “PROXY” Issues Mission Capability Exists Fielded Unit Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements New Equipment 3

FCS Acquisition Program Relates To Identified Criteria Mission Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements Relates To Warfighter Needs Capabilities New Fielded Unit 4

ATEC’s Role • Independent Evaluator FCS – Develop MOEs And MOPs To Support Platform And Fo. S/So. S Assessment Of: • • Specs ORD Requirements KPPs COICs • Address The Capabilities & Limitations Of The FCS Enabled UA Mission Accomplishment – Produce An Evaluation Of Whether The FCS FOS, In The Context Of The UA, Is Effective, Suitable, And Survivable • Work In A Collaborative Environment To Maximize Commonality Of Resources & Ensure The Success Of FCS 5

CTO Organization Primary Functional Management Location Director Aberdeen Proving Ground, Maryland ATEC Deputy Director National Capital Region Warren, Michigan LSI Deputy Director PMO Deputy Director Picatinny, New Jersey Ft. Monmouth, New Jersey Huntsville, Alabama Evaluation Liaison Cell St. Louis Office Analysis Support System of System Level Test Planning, Integration, & Execution Test Assessment & Reporting Test Support & Facilities Test Resources M&S/T&E Integration Product Assurance & Verification System Level C 4 ISR Manned Combat Systems Unmanned Ground Systems Unmanned Aerial Systems Lethality/ Munitions Complementary Systems Test Integration Field Offices Ft. Huachuca WSMR UAMBL YPG Ft. Hood 6

COLLABORATION PROCESS O&O, ORD Combat Developer Defines Scenarios And Vignettes PM/LSI: So. S Spec, FCS Design FCS That Meets User’s Needs Within A Shortened Acquisition Cycle O&O, ORD, Spec, Mission Decomp, T&E Plans Mission Decomposition: Detailed Look at User Intent And How FCS Enabled Unit Of Action Will Fight O&O, ORD, Spec, Mission Decomp ATEC: Evaluation Plan to Assess Capabilities & Limitations Plan Together, Test Once, Share the Data 7

Evaluation Strategy Elements FCS (Platforms, Networks, …) MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) TT OT Data Element Level Cap/Lim E, s, s, + Unks Core Compl Systems M&S FCS Fo. S/So. S Cap/Lim E, s, s, + Unks Joint/ Compl Systems M&S Cap/Lim @ So. S, S, S, + Unks Cap/Lim S, S, +Unks MISSION Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission + Unks Sensitivity Analyses By Thread Cap/Lim @ Mission, S, S, + Unks Capabilities & Limitations By Mission + Unks Cap/Lim S, S, +Unks Updated as Systems Mature 8

Platform/Fo. S/So. S Capabilities/Limitations • MOEs, MOPs Based On COIs, ORD, KPP, AIs • Platform Level – Based On Unique Platform Requirements • Fo. S/So. S Level – Based On Synergistic Effects Of Multiple Platforms – Focused On FCS’ Contributions To Capabilities – Requires Complimentary Systems To Execute FCS Test • Basis To Determine Capabilities And Limitations At All Levels 9

Evaluation Strategy Elements FCS (Platforms, Networks, …) MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) TT OT Data Element Level Cap/Lim E, s, s, + Unks Core Compl Systems M&S FCS Fo. S/So. S Cap/Lim E, s, s, + Unks Joint/ Compl Systems M&S Cap/Lim @ So. S, S, S, + Unks Cap/Lim S, S, +Unks MISSION Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission + Unks Sensitivity Analyses By Thread Cap/Lim @ Mission, S, S, + Unks Capabilities & Limitations By Mission + Unks Cap/Lim S, S, +Unks Updated as Systems Mature 10

Mission Capabilities & Limitations • MOEs, MOPs Based on O&O, ORD, • Based On Live, Virtual & Constructive Events • Utilize Mission Decomposition Process To: – Assist In OT Planning – Correlate Capabilities And Limitations At Platform, Fo. S & So. S To Required Tasks – Determine Requirements Force Effectiveness M&S • Focused On FCS Contributions To Mission • Sensitivity Analyses Conducted To: – Determine If Other FCS Or Complimentary Systems May Alleviate Shortfalls In Capabilities Caused By: • Technical Limitations • Environmental Influences (Including Threat Effects) • … – Enable Army Examination Of Alternate Scenarios/ Red Responses 11

Mission Decomposition Missions TASKS Tasks Achieve air superiority Destroy WMD capability Facilitate control of energy centers Destroy resisting Rebel forces 1. Destroy WMD 2. Seize oil and gas pipelines and prod facilities 3. Seize the RHC fac of the IFP mil forces JFLCC 4. Seize vital infrastructure with min coll damage 5. Facilitate the transition of power 6. Destroy Rebel forces in zone 1. 2. 3. Establish multiple FOBs, on order conduct handover FOB security to 3 d BN 504 PIR Defeat rebel forces W/SW of Baku Secure OBJ CAMEL TASKS UE 1 1. 2. 3. TASKS JTF 1. 2. 3. 4. 1. 2. 3. Seize RHC fac with min coll damage Defeat Rebel forces W&S/W of Baku Conduct vertical maneuver to Baku UA 1 Defeat enemy forces withdrawing to Baku Seize bridge vic OBJ BISHOP Conduct air assault with 1 dismounted INF CO CAB 2 12

Task Decomposition Missions 1. 2. Defeat enemy forces withdrawing to Baku Seize bridge vic OBJ BISHOP 3. Conduct air assault with 1 dismounted INF CO ART 8. 1. 2 Conduct an Attack ART 7. 2. 1 Collect Relevant Information ART 7. 2. 3 Display COP Tailored to User Needs ART 7. 2. 5 Disseminate a COP & Execution Info ART 7. 2. 2 Process Relevant Information to Create a COP TASKS AUTL Sub-tasks TASKS AUTL Task TASKS CAB 2 Tasks TASKS Tasks – TA 1 Deploy Conduct Maneuver – TA 2 Develop Intel – TA 3 Employ Firepower – TA 5 Exercise C 2 Lower AUTLTasks 1. Conduct UAV Flight Operations 2. Conduct GCS (C 2 V) mission activities 3. Conduct Autonomous Surveillance MTP Tasks 13

FCS Task to Functional Capability Mapping Tasks Capabilities 14

Tasks FCS Functional Capability to ORD Requirements Capabilities 15

Capabilities FCS ORD Requirements to Materiel 16

Capabilities/Limitations Assessed At All Levels De JTF Mission JFLCC Task UE Task UA Mission Capabilities/Lim UA Task FCS Task Fo. S/So. S Capabilities/Lim Platform Task com pos n i ti o …… … Subsystem Task As defined in ORD, Spec As defined in O&O UA Level (Mission) Fo. S/So. S Level Platform Level As defined in COIC, KPP, ORD 17

Example Feedback to Be Provided to TRADOC and LSI Systems Engineering as a Result of this Endeavor thus far: • ORD 1215 - ”FCS Fo. S systems must be capable of automated precision engagements with automated fire control, distribution and clearance procedures with a manual back-up. (Threshold). ” Rational paragraph indicates requirement enables “rapid selection of high payoff and most dangerous targets while static or moving”. • SOS Spec - no capability at SOS level in spec for “rapid selection of high payoff and most dangerous targets while static or moving”; only addresses “rapid selection of high payoff and most dangerous targets” in paragraph 3. 7. 4. 2. 1. 4. 1 and 3. 7. 4. 2. 1. 4. 1 for threshold and objective requirements for MCS (ORD 3407) MCS. SOS Spec does not include ORD 3825 which indicates selection of high payoff targets requirement for ICV. • ORD 1159 – “FCS systems must accomplish position/navigation (horizontal and vertical) to a one meter Spherical Error Probable (SEP) with a Low Probability of Detection (LPD)/ Interception (LPI) and in the presence of electronic jamming. (Objective)” • SOS Spec - (3. 2. 1. 3. 2) identifies requirement as Objective. Only other references to navigation are 3. 2. 1. 8. 15. 3. 1 - kit to enable legacy systems to be interoperable; 3. 7. 18. 1 - auto navigation for UAS CL I; 3. 7. 23. 2. 1. 2. 24 – UGS position themselves; directly enables 18 tasks from 3 missions, indirectly enables 37 tasks from 3 missions • O&O (SORC) – Required Capability - Terrain Analysis. ORD addresses in 5. 9. 2 – no ORD Reference number; addresses in Appendix H, 2. 5. 1. 3. 1. 1. 6; Appendix F, Table 302; Appendix J IERs. • SOS Spec – could not find any reference to requirement for terrain analysis; directly enables 21 tasks from 3 missions, indirectly enables 35 tasks from 3 missions 18

Applying Mission Decomposition & Capability Mapping to Construct Operational Test Events Sample Application

UA Missions in OT System Task 1 Task 2 Task 3 Unit Mission Lane So. SIL C 2 V NLOS-C CL III UAS Task 1 Task 2 Task 3 MCS Task 1 Task 2 Task 3 Unit Mission Lane Larger Unit Mission Lane SUGV Virtual Loop Live Loop 20

Sample Task Set Applied OT Model System MTP 34 -5 -0041 Conduct UAV Flight Operations RECON Task 1 2 MTP 34 -5 -0052 CGS Mission. Task Activities Task 3 1. 3. 3. 1 Unit Conduct Mission Zone Recon ART 7. 2. 1 Collect Relevant Information Lane ART 7. 2. 2 Process Relevant Information to create COP Task 1 C 2 V Task 2 ART 7. 2. 5 Disseminate COP & Execution Information So. SIL ART 3. 3. 1. 1 Conduct Surface to Surface Atk Task 1 NLOS C Task 2 Task 3 ART 7. 2. 3 Display COP Tailored to User Needs ART 7. 2. 1 Collect Relevant Information Task 1 NLOS Task 3 Unit Mission Lane Task 2 Unit 3. 3. 1 Mission Conduct Lethal FS Lane Task 3 Unit Mission Lane MTP 34 -5 -0041 Conduct UAV Flight Operations CL III UAS Task 1 Task 2 Larger Unit ART 8. 1. 2 Missionan Conduct Lane Attack Task 3 ART 2. 4. 1 Conduct Lethal Direct Fire Against a Surface Target Task 1 Task 2 Task 3 ART 7. 2. 3 Display COP Tailored to User Needs MCS ART 7. 2. 1 Collect Relevant Information Task 1 Task 2 Task 3 Unit. By Fire Unit 8. 5. 1 Attack an Enemy Force Mission Lane /Position Lane XX-XX Conduct Autonomous Surveillance SUGV Virtual Loop Live Loop 21

Evaluation Strategy Example Platforms FCS MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Platform Level (ORD, Spec) TT OT Data Element Level Cap/Lim E, s, s, + Unks UAV TLE =120 M Core Compl Systems 25 M CEP NLOS = M&S FCS Fo. S/So. S Cap/Lim E, UAV s, s, Cannot + Unks Be Joint/for used as Sensor Compl NLOS in. Systems the precision M&S mode Cap/Lim @ So. S, S, S, + Unks Cap/Lim S, S, +Unks MISSION Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission Delayed Mission Awaiting Ground Sensor+for NLOS Unks Sensitivity Comanche Analyses Provide By Location Accuracy Thread for NLOS Cap/Lim @ Mission, Capabilities & Limitations By Mission + Unks S, S, + Unks Cap/Lim S, S, +Unks Updated as Systems Mature 22

Evaluation Strategy Example Platforms FCS MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Platform Level (ORD, Spec) Manned Grnd TT OT Data Vehicle Protection Element Level Limited to 14. 5 mm Cap/Lim E, s, s, + Unks Core WIN-T/JTRS Compl Provides Systems Connectivity M&S UAV Provides Enemy Location Cap/Lim S, S, +Unks FCS Fo. S/So. S Cap/Lim Network Provides E, Enemy s, s, +Location Unks to Commander Joint/ Prior to. Compl Systems Engagement M&S Cap/Lim @ So. S, S, S, + Unks MISSION Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission + Enemy Unks Destroyed Sensitivity Out of Analyses Contact By Thread Cap/Lim @ Mission, S, S, + Unks Capabilities & Limitations By Mission + Unks Cap/Lim S, S, +Unks Updated as Systems Mature 23

The Road Ahead • TRADOC Complete Decomposition of 1 st Mission • TRADOC, ATEC, PM/LSI Identify M&S Requirements • Develop Common Database For All Stakeholders – Identify All T&E Events – Include All Measures For Evaluation – Capabilities and Limitations Based – Evaluation of Data and Confidence Levels Continuously Updated 24

Backup

FCS Test Program Schedule FY 2002 FY 2003 FY 2004 FY 2005 FY 2006 FY 2007 FY 2008 FY 2009 FY 2011 FY 2010 FY 2012 FY 2013 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 MS B System of System Testing SFR So. S PDR So. S CDR Facilitization LL IPR Waiver Initial Production Decision LFT - FUSL Spec Verif / Integr Verif Testing - Prod So. SIL Dev IP S 1 Sims ASAR Deliveries C FOC UA 1. 6 a Production Spec Verif / Integr Qual Testing -SDD Integrat ion IT/UT CT Demos D IOC UA(-) W/ILOs IP P 1 Integration IT/UT Assessment TRR Init Sys. TRR Assessment Deliveries IP S 2 IP IP P 2 P 2 Integration IT/UT Early Emulators Deliveries SDD TRR Assessment TRR IP S 5 ** IP S 3 Integration Integrati on Init DP PIs Deliveries IMT Assessment TRR Assessment IT/UT TRR Init Sys Deliveries Assessment. Init SW Deliveries TFT#P 1 TFT#P 2 LUT 3 IOT FDTE Integration OE/CE IT/UT Log Demo TRR Assessment Continuous Evaluation Init Sys TFT#S 4 IP S 4 TFT# S 2 TFT# S 3 Deliveries LUT 2 LUT 1 Log Demo ** SW Testing only Integrated Evaluation Process Alt 5 A v 12 4 -13 -03 26

ORD - KPP Mapping 27

M&S In Support of Evaluation Elements (Platforms, Networks, . . . ) MOPs/MOEs Element Level (ORD, Spec) HWIL MIL Digital SWIL SILs PRO-E BRL CAD Element Level Models Element Level Cap/Lim E, s, s, + Unks MISSION FCS MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) FCS Fo. S/So. S Cap/Lim E, s, s, + Unks Joint/ Compl Systems Core Compl Systems - Mobility (NATO Reference Model) - C 4. (Comms, COP, FIRES) - ISR/Fusion - Synthetic Environment - Behavioral - Environ (Atmosphere, Propagation) - Threat (behavior, Platform, Signature) - Observable(Obscuration, Wx, Signature) HWIL MIL Digital SWIL SILs So. SIL Wrap-Around Sim Mission Threads (O&O) Decomposition Red Blue Cap/Lim By Mission + Unks Sensitivity Analyses By Thread Capabilities & Limitations By Mission + Unks So. SIL Wrap-Around Sim Federated Battle Labs Force-On-Force M&S Updated as Systems Mature 28

Instrumentation & Facilities In Support of Evaluation Elements FCS (Platforms, Networks, etc. ) MOPs/MOEs Fo. S/So. S Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) Platform Level, Embedded Element Level Cap/Lim E, s, s, + Unks Core Compl Systems MISSION FCS Fo. S/So. S Cap/Lim E, s, s, + Unks Joint/ Compl Systems Mission Threads (O&O) Cap/Lim By Mission + Unks Sensitivity Analyses By Thread Decomposition Red Blue Capabilities & Limitations By Mission + Unks RTCA, C 3 Driver, Embedded, Field Data Collection Systems, Large Scale Data Integration Updated as Systems Mature 29