Lesson 9 Design For Supportability L 9 Design

Lesson 9 Design For Supportability L 9 Design For Supportability October 1 2018

What Are The Goals of Defense Acquisition? Ø Provide a Military Capability Ø Meet User Needs Ø Be Affordable Ø Minimize Risk Ø Be Accountable L 9 Design For Supportability October 1 2018

Affordable System Operational Effectiveness (ASOE) Model JCIDS KPP/KSA Materiel Availability (AM) Operational Availability (AO) Reliability Operating & Support Cost (O&S) Mean Down Time (MDT) Affordability L 9 Design For Supportability October 1 2018

Mapping Trade-Offs JCIDS KPP/KSA Materiel Availability (AM) Operational Availability (A O) Reliability Operating & Support Cost (O&S) Mean Down Time (MDT) Affordability L 9 Design For Supportability October 1 2018

JCIDS KPP / KSA Definitions q Key Performance Parameter (KPP) “Performance attributes of a system considered critical or essential to the development of an effective military capability. ” q Key System Attributes (KSAs) "System attributes considered most critical or essential for an effective military capability but not selected as Key Performance Parameters (KPPs). KSAs provide decision makers with an additional level of capability prioritization below the KPP but with senior sponsor leadership control (generally four star, defense agency commander, or principal staff assistant). " L 9 Design For Supportability October 1 2018

JCIDS Sustainment KPP / KSA Definitions Materiel Availability (AM) Materiel Availability (A M) is a measure of the percentage of the total inventory of a system operationally capable (ready for tasking) of performing an assigned mission at a given time, based on materiel condition. AM = Number of Operational End Items / Total Population Operational Availability (AO) Reliability (R) The measure of the percentage of time that a system or group of systems within a unit are operationally capable of performing an assigned mission. AO = Uptime / (Uptime + Downtime) Reliability as a measure of the probability that the system will perform without failure over a specific interval, under specified conditions. R = Number of Failures / Total Operating Hours Operating & Support (O&S) Costs Mean Down Time. L 9 (MDT) Measuring O&S cost provides balance to the sustainment solution by ensuring that the total O&S costs across the projected life cycle associated with availability and reliability are considered in making decisions. The O&S Cost KSA is to be computed using base year dollars. For consistency and to capitalize on other efforts in this area, all CAPE O&S cost elements, will be used in support of this KSA. Energy costs shall be included in O&S cost, and will use the base year price throughout the assessment. All O&S costs are to be included regardless of funding source or management control. The O&S cost covers the planned O&S timeframe, consistent with the timeframe and system population identified in the Sustainment KPP. As part of the supporting rationale, provide the annual cost per system (for large systems such as aircraft, vehicles, ships, etc. ) or fleet of systems (for networks or smaller systems such as munitions) upon which the O&S Cost KSA total is based. The O&S Cost KSA objective values are to be calculated in base year dollars as 10% less than the threshold value. Mean Downtime (MDT) is the average Total Downtime required to restore an asset to its full operational capabilities. MDT includes the time from reporting of an asset being down to the asset being given back to Design For Supportability October 1 2018 operations / production to operate. MDT includes administrative time of reporting, logistics and materials procurement and lock-out/tag-out of equipment, etc. , for repair or preventive maintenance.

Traceability of Metrics from KPP/KSA – MOE – MOP – MOS - TPM q Measures of Effectiveness (MOE) are derived from User Needs defined in terms of Key Performance Parameters (KPP) and Key System Attributes (KSA) in a Capability Development Document (CDD) or a Capability Production Document (CPD). q MOEs may defined in terms of Measures of Performance (MOP), such as Speed and Measures of Suitability (MOS), such as Reliability. q MOPs and MOS may be expressed in terms of Technical Performance L 9 Design For Supportability October 1 2018 Measures, for example,

Align MOEs to Milestones to Ensure Traceability of Requirements Design for Supportability October 1 2018 9

The Practitioner’s Guide to Supportability Process Steps 1. Define/Establish an Analytical Framework 2. Translate Requirements into a Design 3. Mature the Design Through Testing 4. Use Analytical Tools to Conduct Trades 5. Develop, Maintain, Use and Report Data 6. Continuously Evaluate Suitability 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 10

1. Define/Establish an Analytical Framework From Competencies to Outcomes COMPETENCIES • Reliability, Availability and Maintainability • Design Interface • CBM+ / RCM • Configuration Management • IUID • PHST PROCESSES ACTIVITIES • Integrated Product and Process Development (IPPD) • Requirements Management • Product Support Analysis (PSA) • Supportability Analysis • Transportability • Reliability Growth • Sustaining Engineering • RIO Management • Technical Data Management • Independent Logistics Assessment 2018 PSM Workshop March 20, 2018 DATA TOOLS OUTCOMES • Capability • Design Interface • Requirements • R&M Allocation & Prediction • Performance • Reliability Growth • Operational Modeling • Technical Reviews • Logistics Product Data • Operational Effectiveness • Configuration Management • Technical Data / IP • Test & Evaluation • DT/OT Test • Quality • Field Maintenance • Sustaining Engineering • Business Case Analysis • FMEA/FMECA • Power. LOG-J PSA • COMPASS Level of Repair Analysis • CASA Life Cycle Cost • KPP/KSAs • Affordability • Operational Suitability • Managed Risk • Accountabilit y • Post Fielding Support Analysis (PFSA) • SEP • LCSP L 9 Design For Supportability October 1 2018 11

1. Define/Establish the Analytical Framework Apply Enterprise Standards Click for Hyperlink Source: US Army LOGSA • US Army LOGSA Logistics Enterprise Standards define the terminology, requirements, processes, and relationships necessary to provide a comprehensive assessment of system architectures and resources. . 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 12

2. Translate Requirements into Design Objective #1: Failure Identification / Prediction Supportability as a JCIDS Design Objective The ability of the system to identify and/or predict failures down to a certain subsystem within a given percentage of accuracy. Potential attributes include health management, prognostics and diagnostics capabilities, Condition-Based Maintenance Plus (CBM+) enablers, support equipment and parts commonality. 2018 PSM Workshop March 20, 2018 Attributes Which May be Considered KPPs or KSAs Include: üBuilt-In-Test (BIT) Fault Detection - a measure of recorded BIT indications which lead to confirmed hardware failures. üBIT Fault Isolation - A measure of recorded BIT indications which correctly identify the faulty replacement unit, either directly or through prescribed maintenance procedures. üBIT False Alarms - A measure of recorded BIT indications showing a failure when none has occurred L 9 Design For Supportability October 1 2018 13

2. Translate Requirements into Design Objective #2: Rapid Restoration of Service Maintainability as a JCIDS Design Objective The ability of the system to be brought back to a state of normal function or utility. Normally expressed as Mean Down Time (MDT), Mean Time To Repair (MTTR) or a calculation of ease of maintainability. Attributes Which May be Considered KPPs or KSAs Include: üCorrective Maintenance - All actions performed as a result of any failure, to restore a system, subsystem, or component to a required condition. üMission Maintainability - The ability of the system to be retained in or restored to a specified mission condition. üMaintenance Burden - A measure of maintainability Maintainability Design Attributesrelated to the system's demand for maintenance manpower Accessibility – Physical placement of hardware to facilitate maintenance. Modularity – Grouping of similar functions within a physical area. Testability – Extent to which the operational status of modules can be tested Practitioner's Guide to Supportability 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 14

2. Translate Requirements into Design Objective #3: Affordable Cost / Effective Sustainment JCIDS Design Objective Definition / Attributes Cost Included as one of the O&S Cost KSA, normally expressed as the total O&S costs regardless of the funding source over the projected life cycle of the capability solution in base year dollars Sustained Operations The ability of the system to be employed in an operational context for a given timeframe without logistics resupply or support Transportability & Deployability The ability of the system to be moved and deployed within the Department's transportation infrastructure Logistics Footprint Materiel, mobility, and space required to effectively sustain the system in the field 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 15

3. Mature the Design Through Testing Designing for R&M / Developmental Test Design for Reliability (DFR) is a System Engineering process that identifies and eliminates failure modes, and ensures the reliability and supportability of designs: ü Redundancy Developmental Test & Environmental Testing Evaluation (DT&E) (MIL-STD-810 C) ü Derating • Laboratory • Altitude ü Thermal Design • Limited Operational • Hi / Low Temp / Shock • Simulation • Vibration ü Integrity Analysis • Heat/Cold ü Software RAM • Solar Radiance • Rain (Wind and Ice) ü Parts Selection Program • Humidity / Fungus • Wind/Fog ü Critical Items Analysis • Salt ü Storage Analysis ü Sneak Circuit Analysis The Failure Reporting And Correction System (FRACAS) Is An Integral Part Of The Development Process 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 16

4. Use Analytical Tools to Conduct Trades MIL-HDBK-502 A Design Interface-Support Trades Task Outputs • • Requirements / Traceability MTBF, MTTR Predictions / Allocations Reliability Modeling Redundancy Requirements • • • Single Points of Failure Maintainability Information/Accessibility/Modularity/Testability Criticality Analysis Fault Tree Analysis • Root Cause Analysis Maintenance Task Analysis • Preventive and Corrective Tasks, Skills, Tools, Test Equipment, Facilities Reliability Centered Maintenance / Condition Based Maintenance • • Preventive Maintenance Tasks, Cost and Schedule Prognostics and Health Management • • • Maintenance Concept Repair v Discard / Maintenance Allocation Chart Operational Availability Maintenance Cost RAM Allocation, Prediction, Modeling & Analysis Failure Modes, Effects and Criticality Analysis Level of Repair Analysis 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 17

4. Use Analytical Tools to Conduct Trades FMECA Appendix A - Maintainability Information System UHF/VHF Radio Indenture Level A 304 Diode Bridge Mission Rx Tx Full Duplex 1 2 3 4 5 6 7 8 9 10 ITEM FUNCTIO N FAILURE MODES AND CAUSES FAILURE EFFECTS LOCAL LEVEL FAILURE EFFECTS NEXT HIGHER LEVEL FAILURE EFFECTS END EFFECTS SEVERITY CLASS FAILURE PREDICTABILITY FAILURE DETECTION MEANS MAINTENANC E ACTIONS Power Suppl y Diode Bridge Provide regulate d electrical power Identifies 1. Diode fails “open”; 2. Root cause to be determine d a. Materia ls quality issue b. Excessi ve voltage / c. Excessi ve Engineering current Loss of electrical connectivi ty in the circuitry 1. Loss of regulated electrical power 1. No power for operations 2. Cannot transmit 3. Cannot receive 4. May require alternative design for incorporati on of internal battery 5. Single point of failure • HIGH Class 4 TBD • Loss of Mission • Loss of Equipme nt and Product Support Information for 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 QUESTION(s) 1. Was the diode selected as a known reliability item? 2. Is the diode performing within its known specification profile? 3. Given usage, where is the diode in its life profile within the Design, CBM / bath tub curve? QUESTION(s) 1. What is the level of Performan ce Monitoring Fault Location (PMFL) capability within the design? 2. What level of ambiguity exists within the Built-In. RCM, Tech Test (BIT) capability? 1. Inspect 2. Test 3. Remove & Replace Manuals 18

4. Use Analytical Tools to Conduct Trades Do. D Product Support Analytical Tools USA AMSAA Center for Reliability Growth USA LOGSA Logistics Engineering Analysis Center Products Disclaimer The product support analytical tools identified in this database are provided solely to assist defense acquisition workforce professionals to identify best value product support solutions which optimize system readiness and life cycle cost. Neither the Department of Defense or the Defense Acquisition University provide any warranty of these tools whatsoever, whether express, implied, or statutory, including, but not limited to, any warranty of merchantability or fitness for a particular purpose or any warranty that the contents of the item will be error-free. This analytical tools database should under no circumstances be considered as being all-encompassing, and is in no-wise meant to endorse the capabilities or products of any particular individual, company, or organization. Practitioner's Guide to Supportability 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 19

5. Develop, Maintain, Use and Report Data Logistics Product Data (LPD) / Data Sources MIL-HDBK-502 A, Product Support Analysis, and GEIA-STD-0007 Logistics Product Data define over 100 logistics product data (LPD) tables that document information for the 12 Integrated Product Support (IPS) elements. T A B L E S D A T A CDD Inputs Maintenance Task Analysis Engineering Analyses Bill of Materials Purchase Orders Drawings Facilities Test Equipment Specifications Practitioner's Guide to Supportability 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 20

5. Develop, Maintain, Use and Report Data Industry Standards Facilitate Data Exchange • Universal Data Item Description (DID) • Standard reports supporting IPS Elements • Data requirements/attributes • Exchange protocols for data communication • Table relationships • Shared, common terminology OEM GOVT Enables Error Free Data Transfer 10101010010 Commercial Software Govt Software Contracts can require the OEM provide SAE GEIA-STD-0007 compliant data to the Government. SAE GEIA-STD-0007 Logistics Product Data Has Been Adopted by the Do. D for the Acquisition and Exchange of Logistics Product Data (LPD) 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 21

5. Develop, Maintain, Use and Report Data LSA Reports Detail IPS Element Resources Over 80 Reports 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 22

5. Develop, Maintain, Use and Report Data-Driven Decision Making / Governance Sustainment Quad Chart 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 23

6. Continuously Evaluate Suitability Independent Logistics Assessment (ILA) The 2009 Do. D Weapon Systems Acquisition Reform Product Support Assessment (WSAR-PSA) included the recommendation to implement independent Logistics Assessments during Weapon System Development, Production and Post-initial Operational Capability (Post IOC) (1) Assessment Criteria (2) ILA Rating Criteria (3) Risk Rating Summary ILA Provides Critical Technical And Management Information To Support the Governance Process 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 24

6. Continuously Evaluate Suitability Initial Operational Test & Evaluation (IOT&E) Suitability is the degree to which a system can be satisfactorily placed in field use, with consideration given to reliability, availability, compatibility, transportability, interoperability, wartime usage rates, maintainability, safety, human factors, manpower supportability, logistics supportability, documentation, environmental effects, and training requirements. The Log Demo evaluates the Suitability of system support that ensures the right resources, with the appropriate skill level, under the appropriate environment conditions, to achieve the maintenance task in the time allotted. $ A o MTTR Logistics Footprint Maintenance Concept 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 25

6. Continuously Evaluate Suitability Post Fielding Data & Supportability Analysis (PFSA) Air Force Total Ownership Cost Management Information System (AFTOC) Army Operating and Support Management Information System (OSMIS) Navy Visibility and Management of Operating and Support Cost (VAMOSC) US Army Logistics Support Activity (LOGSA) Post Fielding Support Analysis (PFSA) Tool Weapon System Report A two-year window rolling weapon system performance assessment § Equipment Availability § Demand Drivers § Maintenance Drivers § Fleet Usage 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 26

6. Continuously Evaluate Suitability Sustaining Engineering: q Technology Insertion q Service Life Extensions q Correction of Deficiencies q Incorporation of New Capabilities q Improved Product Support Click Pic for Hyperlink Technology Insertion Sustaining Engineering spans engineering and sustainment domains (and analyses) to ensure continued operation and maintenance of a system with managed (i. e. , known) risk. Service Life Extension Are the Levels of Performance, Reliability and Product Support Sufficient to Meet System Sustainment Requirements? 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 27

Supportability Analysis Links LOG 211 Supportability Analysis (Classroom) CLL 008 Designing for Supportability in Do. D Systems CLL 012 Supportability Analysis MIL-HDBK-502 A Product Support Analysis ACQuipedia Article Logistics Assessment Guidebook CLL 020 Integrated Logistics Assessment (ILA) Guidebook ACQuipedia Article 2018 PSM Workshop March 20, 2018 L 9 Design For Supportability October 1 2018 28

LESSON 3 / 4 DESIGNING FOR SUPPORTABILITY Capability Development Document (CDD) Review L 9 Design For Supportability October 1 2018

“Strike Talon” UAV Capability Development Document (CDD) q LOG 211 Supportability Analysis uses a case-based approach to learning q DAU worked with NAVAIRSYSCOM to review the Broad Area Maritime Surveillance S(BAMS) Unmanned Aerial System for use as a reference in LOG 211. q DAU condensed the unclassified Capability Development Document (CDD) for the “Strike Talon” to convey program management, requirements, schedule and logistics-related concepts and information Design for Supportability October 1 2018 30

“Strike Talon” Capability Developmen t Document (CDD) Design for Supportability October 1 2018 31

“Strike Talon” Capability Developmen t Document (CDD) Design for Supportability October 1 2018 32

“Strike Talon” Capability Developmen t Document (CDD) Design for Supportability October 1 2018 33

“Strike Talon” Capability Developmen t Document (CDD) Design for Supportability October 1 2018 34

“Strike Talon” Capability Developmen t Document (CDD) Design for Supportability October 1 2018 35

“Strike Talon” CDD L 9 Design For Supportability October 1 2018

CDD Takeaways Ø CONOPS / Maintenance Concept Ø Capability to be provided Ø R&M KPP / KSAs Ø Supportability Trade Studies Ø Program Schedule Design for Supportability October 1 2018 53

LESSON 3 / 5 USMC REQUIREMENTS TRANSLATION PROCESS AND DESIGN FOR SUPPORTABILITY OVERVIEW Job Support Tools L 9 Design For Supportability October 1 2018

https: //www. dau. mil/tools#All|null|recent| DAU Analytical Tools. Click for Hyperlink L 9 Design For Supportability October 1 2018

DAU Defense Acquisition Guidebook Page Click for Hyperlink L 9 Design For Supportability October 1 2018

Interactive Defense Acquisition Life Cycle Wall Chart (with Demo) Click for Hyperlink L 9 Design For Supportability October 1 2018

Milestone Document Identification (MDID) Click for Hyperlink L 9 Design For Supportability October 1 2018

Product Support Analytical Tools Data Base (Demo) Click for Hyperlink L 9 Design For Supportability October 1 2018

Do. D Integrated Product Support (IPS) Implementation Roadmap (Demo) Click for Hyperlink L 9 Design For Supportability October 1 2018

Lesson 9 Summary ü Engineering and Life Cycle Logistics Share Competencies, to include R&M, Intellectual Property, Obsolescence, among others. ü The Sustainment Metric KPP and its KSAs are identified in both the CDD and the CPD and are the primary metrics for R&M. ü Measures of Effectiveness (Mo. E) are used throughout the product life cycle to influence the design as well as sustaining engineering and post fielding supportability. ü Logistics Product Data (LPD) and its associated data base is generated by both ENG and Logistics and serves to document the design from both perspectives. Product Support deliverables such as the Tools and Test Equipment List, Bill of Materials, Technical Manuals and Level of Repair Analysis are drawn from the LPD. ü Job Support Tools provide both analytical methods and information from which mandatory documentation / trade studies may be developed. L 9 Design For Supportability October 1 2018

Slide Corral L 9 Design For Supportability October 1 2018