Lesson 12 Supportability Design Reviews LOG 211 Lesson

Lesson 12 Supportability Design Reviews LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -1

Topic 1: Introduction What’s in it for me? Technical Reviews are conducted throughout the Life Cycle to address system planning, development, and Sustainment, as required by Do. D Directive 5000. 01, the Defense Acquisition System. The reviews address operational effectiveness, suitability, affordability, Sustainment, and Supportability “throughout the system life cycle. ” Supportability Design Reviews are conducted as part of the Technical Reviews defined in the Systems Engineering Plan (SEP). Specific Supportability Design Review criteria are identified as part of the Design Review process, and are focused on meeting Supportability Objectives as detailed in the Defense Acquisition Guidebook (DAG). Supportability Design Reviews ascertain whether specific decision criteria have been met from the perspectives of the Program Management, Systems Engineering and Life Cycle Logistics communities. LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -2

Life Cycle Management Framework Where Are You? What Influence Do You Have? Technology Maturation & Risk Reduction LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -3

Topics and Objectives TLO 13: Recognize the process and impact of Supportability Design Reviews Topic 1: Introduction Topic 2: Overview of Supportability Design Reviews Topic 3: Supportability Design Reviews and Criteria Topic 4: Exercise • • • Welcome Where Are You? What Influence Do You Have? • Relate Supportability design reviews to Supportability and Supportability Analysis • Examine the Systems Engineering (SE) design review process and milestones Relate design review criteria to Supportability Analyze system design compliance to requirements • • • Differentiate the impact of Supportability Design Reviews on Supportability and Supportability Analysis Topic 5: Summary LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -4

Supportability Design Reviews Lesson Approach This lesson approach will emphasize the following LCL role for each Supportability design review: Prepare system for review with entry criteria Apply criteria to design review decision making process Determine whether design review exit criteria have been met LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -5

Topic 2: Overview of Supportability Design Reviews LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -6

What Are Supportability Design Reviews? Technology Maturation & Risk Reduction Supportability design reviews are: • Defined as major technical efforts within the Life Cycle Management Framework • Considered event-driven • Conducted when system satisfies entry criteria • Conducted at major transition points in the Life Cycle Management Framework • Required by contract to include review processes and requirements LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -7

Supportability Questions Inputs Supportability Design Reviews Overview Technology Maturation & Risk Reduction Affordability? Supportability? Effective Design? Achieve Outputs ü Identify role: Who is doing what? ü Define analysis goal ü Define schedule/timeline ü Establish WIPT credentials Entry Criteria ü Phase-specific criteria including maturity, performance, and documentation Exit Criteria Program–specific accomplishments for: ü Progress in Life Cycle Management Framework ü Move to next phase LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Report ü Make recommendations to appropriate IPTs ü Update Supportability documents and LPD 12 -8

Design Reviews and Affordability LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -9

Topic 3: Supportability Design Reviews and Criteria LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -10

Alternative Systems Review (ASR) Alternative Systems Review: • Is the final review at Pre-Milestone A • Influences the Design for Support • Ensures materiel solution(s) have the best potential to be: o Cost effective o Affordable o Operationally effective o Suitable • Ensures system can be developed to provide: o A timely solution to a need o At an acceptable level of risk Technology Maturation & Risk Reduction Adapted from SAE GEIA-HB-0007 Do the available system concepts meet the capabilities described in the Initial Capabilities Document (ICD)? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -11

ASR Process Supportability Questions Inputs Is there a plan to conduct an ASR, or has one been completed in preparation for a Milestone A Decision? Affordability? Effective Design? Outputs Achieve ü Supportability? Report Has the system technical baseline been captured in a preliminary system specification that is consistent with technology maturity and the proposed program cost and schedule? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -12

System Functional Review (SFR) Technology Maturation & Risk Reduction System Functional Review: • Pre-Milestone B • Influences the Design • Influences the Support • Establishes functional baseline • Ensures system has reasonable expectation of satisfying requirements of ICD Adapted from SAE GEIA-HB-0007 Does the system have a reasonable expectation of satisfying requirements of the ICD? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -13

SFR Process Approved Supportability Questions Inputs Updated DRAFT Materiel Solution Logistics and training requirements identified in system and subsystem specifications Functionality? Affordability? Outputs Achieve ü ü Supportability? Report System functional baseline established with traceability to lowerlevel performance requirements Preliminary system level maintenance plan LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -14

Preliminary Design Review (PDR) Preliminary Design Review: • Is the final review at Pre-Milestone B • Influences the Design • Influences the Support • Confirms preliminary design • Leads to approval for beginning detailed design • Ensures allocated baseline is established • Ensures each function in functional baseline is allocated to one or more system configuration items Technology Maturation & Risk Reduction Adapted from SAE GEIA-HB-0007 Does the system have a reasonable expectation of being judged operationally effective, suitable, and affordable before a funding request? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -15

PDR Process Updated Configuration Management Board running with metrics Outputs Supportability Questions Inputs Approved Affordability? Design Readiness? Achieve ü ü Supportability? Report An established system allocated baseline The Requirements Traceability Matrix (RTM) LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -16

Critical Design Review (CDR) Technology Maturation & Risk Reduction Critical Design Review: • Post-Milestone B • Influences the Design • Influences the Support • Evaluates the completeness of the design and its interfaces • Ensures initial product baseline • Finalizes the design • Ensures system meets the requirements from the Capability Development Document (CDD) within current allocated budget and schedule Adapted from SAE GEIA-HB-0007 Does the system meet logistics and Supportability requirements within the current allocated budget and schedule? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -17

Reviewed ü Risk ü Opportunity management Supportability Questions Inputs CDR Process Affordability? DRAFT Approved Design Capability? Outputs Achieve ü ü Updated ü Successful completion of all action items related to the previous conference (PDR) Supportability? Report An established system initial product baseline Estimates of System R&M Supportability requirement enablers Safety and Occupational Health (ESOH) risk reduction features LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -18

Developmental Test and Evaluation (DT&E) Technology Maturation & Risk Reduction Developmental Test and Evaluation: • Conducted at each milestone • Influences the Design • Influences the Support • Provides data on the achievability of critical system performance parameters • Ensures the confidence that system design solution satisfies desired capabilities • Ensures the verification and validation of systems engineering process Adapted from SAE GEIA-HB-0007 Does the system design solution satisfy the desired capabilities? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -19

DT&E Process ü Testing for Reliability improvement program Entry questions regarding: ü Interoperability testing ü Technical maturity Outputs Supportability Questions Inputs ü Areas needing test to complete FMECA/FTA/ RCM Analysis Supportability? Achieve Report ü ü Improvements in Reliability LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 ü Systems Engineering IPT Test and Evaluation IPT 12 -20

Functional Configuration Audit (FCA) Technology Maturation & Risk Reduction Functional Configuration Audit: • Pre-Milestone C • Influences the Support • Validates that a configuration item’s intended function or performance specifications are being met • Ensures EMD product is mature for entry to Low-Rate Initial Production (LRIP) Adapted from SAE GEIA-HB-0007 Does the intended function or performance of configuration items meet specifications? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -21

FCA Process Updated ü Verification is comprehensive and complete Outputs Supportability Questions Inputs Accomplish Supportability Objectives Functionality? Achieve ü ü All FCA-related actions and risks identified, resolved or effectively mitigated to an acceptable level EMD product is sufficiently mature for entrance into Low-Rate Initial Production LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Report ü ü Configuration Management IPT Product Support Management IPT 12 -22

Production Readiness Review (PRR) Technology Maturation & Risk Reduction Production Readiness Review: • Pre-Milestone C • Influences the Support • Ensures design is ready for production • Ensures contractors accomplished adequate production planning • Ensures unacceptable risks in production are identified Adapted from SAE GEIA-HB-0007 Is the system design ready for production? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -23

PRR Process ü Manufacturing processes identified and validated Outputs Supportability Questions Inputs ü Quality assurance in place ü Manufacturing personnel trained ü Mature software Producibility? Achieve ü Production capability forms a satisfactory basis for proceeding into Low-Rate Initial Production (LRIP) Report ü ü LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 IPT reviews readiness of manufacturing process Remaining risks and risk mitigation plan 12 -24

Life Cycle Management Framework Where Are You? What Influence Do You Have? Technology Maturation & Risk Reduction Adapted from SAE GEIA-HB-0007 LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -25

Production and Deployment Phase Conduct Test & Evaluation Conduct Maintenance Demonstration Initiate Failure Reporting & Corrective Action System Assess Reliability Growth Opportunities Initiate Provisioning Requirements Update SAE GEIA-STD-0007 Logistics Product Data Output Analysis Objectives LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -26

Initial Operational Test and Evaluation (IOT&E) Initial Operational Test and Evaluation: • Post-Milestone C • Supports the Design • Examines operational effectiveness and suitability • Conducted by an independent operational test agency • Ensures system performs as required in an operational environment • Ensures system satisfies user needs Technology Maturation & Risk Reduction Adapted from SAE GEIA-HB-0007 Does the system perform in an operationally effective and suitable manner under realistic operational conditions? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -27

IOT&E Process Completed Inputs Supportability Questions Outputs Supportability? Achieve ü Completed and delivered: ü Technical manuals ü Training plan/program ü System performance requirements demonstrated in realistic operating environment Measured operational effectiveness and suitability performance in operational use LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Suitability? Report ü Issued to Congress 12 -28

Physical Configuration Audit (PCA) Physical Configuration Audit: • Post-Milestone C • Supports the Design • Examines actual configuration of item being produced • Verifies that related design documentation matches the item as specified in the contract • Ensures manufacturing processes, quality control system, measurement and test equipment, and training are planned, tracked and controlled Technology Maturation & Risk Reduction Adapted from SAE GEIA-HB-0007 What is the actual configuration of the item being produced and is it accurately reflected in the LPD? LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -29

PCA Process Outputs Supportability Questions Inputs ü Technical Data Package that describes the product baseline ü Quality control results are available Producibility? Achieve ü ü All PCA-related actions and risks are effectively mitigated to an acceptable level. Design and manufacturing documentation match the item as specified in the contract. LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Report ü PCA certificate of completion submitted to the MDA for Full Rate Production 12 -30

Supportability Design Reviews IPS Elements and IPTs LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -31

Topic 4: Exercise LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -32

What impacts do different Supportability design reviews have on Supportability and Supportability Analysis? Key Question Exercise 30 minutes Individual grade LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Directions 1. Log in to Blackboard and navigate to the Lesson 13 Exercise. 2. Answer the questions. 3. Submit your answers in Black. Board. 12 -33

Topic 5: Summary LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -34

Takeaways Supportability design reviews: • Defined as technical reviews that confirm design status between: o Entry Criteria o Exit Criteria • Considered as event-driven at major transition points (e. g. , milestones) • Used as major opportunities to check Affordability and Supportability • Focused on a specific set of questions for each IPT Supportability design reviews ensure traceable requirements flow down to complete an effective, supportable, affordable system. LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 Technology Maturation & Risk Reduction 12 -35

Summary TLO 13: Recognize the process and impact of Supportability Design Reviews Topic 1: Introduction Topic 2: Overview of Supportability Design Reviews Topic 3: Supportability Design Reviews and Criteria Topic 4: Exercise • • • Welcome Where Are You? What Influence Do You Have? • Relate Supportability Design Reviews to Supportability and Supportability Analysis • Examine the Systems Engineering (SE) design review process and milestones Relate design review criteria to Supportability Analyze system design compliance to requirements • • • Differentiate the impact of Supportability Design Reviews on Supportability and Supportability Analysis Topic 5: Conclusion LOG 211 Lesson 12: Supportability Design Reviews FINAL v 1. 2 12 -36