Procurement Quality Assurance Quality Metrics for Aerospace HOW

Procurement Quality Assurance Quality Metrics for Aerospace HOW ARE WE DOING ? Tim Robertson PQA NASA/JPL 1

Procurement Quality Assurance Quality Metrics for Aerospace While ISO 9000 emphasis was on the COMPLIANCE to the requirements, the focus of AS 9100 is on the EFFECTIVENESS of the Quality System. In order to determine the effectiveness of a system, one must be able to measure the inputs and outputs of the system. 2

Procurement Quality Assurance Quality Metrics for Aerospace Psychology of Metrics • Results Based • Clear Objectives • Process and Product Focus • Focus on Numbers • Avoid Misuse 3

Procurement Quality Assurance Quality Metrics for Aerospace ROI of Metrics Value of Information Cost of Acquisition 4

Procurement Quality Assurance Quality Metrics for Aerospace Value of Information Direct • Net Cost Reduction • Net efficiency improvement Indirect • Quality Improvement • Risk Reduction 5

Procurement Quality Assurance Quality Metrics for Aerospace Cost of Acquisition • Incremental collection cost • Computation and manipulation • Interpretation of results 6

Procurement Quality Assurance Quality Metrics for Aerospace Analyzing Metrics Results • Model effectiveness • Telling the desired stories • Cost effective measurements • Data accuracy • Data consistency 7

Procurement Quality Assurance Quality Metrics for Aerospace The metrics matrix will be a value added tool of measurements from the top-level business process through design and engineering, into the manufacturing of products and installation and testing. Quality Metrics Tree 8

Procurement Quality Assurance Quality Metrics for Aerospace Systems Design The quality metrics matrix will have the ability to focus on the low hanging fruit as well the areas not as easy to reach Process Quality Metrics Tree 9

Procurement Quality Assurance Quality Metrics Tree System Level 1 Level 2 Design Level 3 Level 4 Process Level 5 Level 6 10

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Procurement Quality Engineering Information Systems Finance Management Level One Quality Metrics identify top level measurables- for example: 1. Customer satisfaction rating on cost, timeliness, accuracy, or other key characteristics 2. Number of outputs for which customer requirements have been identified and defined 3. Number of customer complaints 4. Number of waivers to procedures per day/week/month 11

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Material Processing Welding Brazing Heat Processing Using Manufacturing as the Level One Process, the identified Level Two Process Metrics could include the following: 1. Percent reduction of elapsed process time (process time now vs. process time before) 2. Percent increase in flexibility (response time now vs. response time before) 3. Percent reduction of cost required to complete process (cost now vs. cost before) 4. Percent increase in accuracy (number of defect now vs. number of defects before) 5. Percent increase in timeliness (number of on-times now vs. on-time before) 6. Percent reduction in detection/correction costs (cost now vs. cost before) 7. Percent reduction of hands-on time required to complete process (hands-on time now vs. hands-on time before) 12

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe CNC Mill Conv. Lathe Conv. Mill Deburr Using Manufacturing/Machining as the Level One and Level Two Processes, the identified Level Three Process Metrics could include the following: 1. Percentage of processes for which capability is established 2. Elapsed time vs. hands on time 3. Amount of hands on time (in hours) devoted to non-value added steps in: · Inspection, Rework, Duplicate approvals 4. Cost of non-value added steps (hands on time x costing rate) 5. Number of defects or errors in output (per hour/day/week/per unit/page/form) 6. Number of on-time deliveries (per schedule, contract, or promise date) 7. Cost of quality (cost of prevention activities + cost of detection/correction activities) 8. Machine Capability Studies 13

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Aluminum High Strength Steel Nickel Alloys Titanium Beryllium Using Manufacturing/Machining/CNC Lathe Processes, the identified Level Four Process Metrics could include the following: 1. Material Supplier Quality Data 2. Material Certifications, i. e. chemical and physical 3. Material Heat Lot 14

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Aluminum Level 5 Drilling Boring Facing Turning Threading Grooving Using Manufacturing/Machining/CNC Lathe/Aluminum, the identified Level Five Process Metrics could include the following: 1. Percent reduction of elapsed process time (process time now vs. process time before) 2. Percent reduction of cost required to complete process (cost now vs. cost before) 3. Percent increase in accuracy (number of defect now vs. number of defects before) 5. Percent increase in timeliness (number of on-times now vs. on-time before) 6. Percent reduction in detection/correction costs (cost now vs. cost before) 7. Percent reduction of hands-on time required to complete process (hands-on time now vs. hands-on time before) 15 8. Process Capability vs. Product Tolerance measurement

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Material Type Level 5 Drilling Level 6 Speed Feed Rate Drill Type Drill Material SFM Tool Holder Using Manufacturing/Machining/CNC Lathe/Aluminum/Drilling, the identified Level Six Process Metrics could include the following: 1. Process capability Studies with various type of drills 2. Process Capability Studies with various speeds and feeds 3. Inspection / Gage Capability 16

Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Material Type Level 5 Drilling Boring Facing Turning Threading Grooving Level 6 Key Process Parameters 17

Procurement Quality Assurance Quality Metrics for Aerospace The Quality Metrics initiative is to develop and implement a set of standardized metrics across the various NASA centers and laboratories. The development of a web based quality metrics matrix will allow for customers and suppliers to select the value added metrics for all areas of business. 18

Procurement Quality Assurance Quality Metrics for Aerospace The Quality Metrics Initiative is a JPL coordinated, NASA (soon to be sponsored) activity that will involve all NASA Centers and various Aerospace Companies in the development 19

Procurement Quality Assurance Quality Metrics for Aerospace Keys for Success • Understand the purpose of metrics • Focus on results • Objective measures • Knowledge acceptance and transfer • Clear, relevant metrics 20