MODELING THE TESTING PROCESS INPUT PROCESS OUTPUT Requirements

MODELING THE TESTING PROCESS INPUT PROCESS OUTPUT Requirements Software Design Risk Data Approved, Debugged, Eng. Tested Code Automated Test Tools Formal Testing (1. 0) Test Doc. Review Results Problems Found in Testing Requirements, Design, and Code Issues Tested Code Test Report Test Incidents System Limitations Updated Test Doc. Customer Problems Change Requests

MODELING THE TESTING PROCESS Program Plan Issues Program Plans Extract Test Information from Program Plans 1. 1 Requirements, Design, and Code Issues Requirements Risk Standards, Templates Requirements Issues Test Tool Data Create Test Plan Requirements 1. 2 from Pgm. Plans Resources Standards, Design, Code, and Staff Test Plan Templates and Complexity Data Requirements, Issues SW Design, Create Test Design, Code Test Design, Cases, Test SW, and Test Procedures 1. 3 Procedures, 1. 4 Input Data Design, Reqts. Code Test Tools Engineering Issues Tools Test Doc. Problems Test Data Tested Source and Object Code Test Report Test Doc. Update Test Incidents Problems Updated System Limitations Documentation Test 1. 5 Documentation Perform Formal Test Documentation

MODELING THE TESTING PROCESS PMP, SDP, CMP, QAP, or other plans as appropriate Standards and Templates INPUT PROCESS OUTPUT Extract Test Information from Program Plans 1. 1 Program Plan Review Results Reviewed Program Plans Program Plan Issues Test Requirements from Program Plans Documentation Problems Program Plan Issues

MODELING THE TESTING PROCESS (Extract Test Information From Program Plans) PMP Issues Program Management Plan Doc. Problems from Later Phases QAP Testing Reqts. Doc. Problems from Later Phases Review Config. Mgmt. Plan 1. 1. 4 Testing Reqts. Standards and Templates Testing Reqts. SDP Issues CMP Issues Test Engineering Review of PMP, CMP, QAP, and SDP Review Quality Assurance Plan 1. 1. 2 Review Program Management Plan 1. 1. 1 Standards and Templates QAP Issues CMP Doc. Problems from Later Phases Review Software Development Plan 1. 1. 3 Testing Reqts. SDP Doc. Problems from Later Phases

MODELING THE TESTING PROCESS (Review Program Management Plan) PMP Issues Program Management Plan PMP Issues Review Table of Contents of PMP 1. 1 Doc. Problems from Later Phases Standards and Templates Test Engineering Review of PMP, Review Comments PMP Issues Review Org. Section of PMP 1. 1. 1. 2 Review Life Cycle Section of PMP 1. 1. 1. 3 Format Testing and Testing Standards Reqts. and Templates Issues PMP Review Results Testing Standards Life Cycle and Templates Reqts. Review Testing Section of PMP 1. 1. 1. 4 Review Schedule Section of PMP 1. 1. 1. 5 PMP Issues Testing Reqts.

MODELING THE TESTING PROCESS (Review Quality Assurance Plan) QAP Issues Review Table of Contents of QAP 1. 1. 2. 1 Doc. Problems from Later Phases Standards and Templates Format and Testing Issues Review Stds. Section of QAP 1. 1. 2. 2 Standards and Templates QAP Review Results TE Review of QAP, Review Comments QAP Issues Review “Reviews” Section of QAP 1. 1. 2. 3 Testing Reqts. Testing Standards Reqts. and Templates Review CM Section of QAP Review Incident-Reporting Section of QAP 1. 1. 2. 5 QAP Issues Testing Reqts. 1. 1. 2. 4

MODELING THE TESTING PROCESS (Review Software Development Plan) SDP Issues Software Development Plan SDP Issues Review Table of Contents of SDP 1. 1. 3. 1 Doc. Problems from Later Phases Standards and Templates TE Review of SDP, Review Comments Format and Testing Issues Review Life Cycle Section of SDP 1. 1. 3. 2 Standards and Templates Testing Reqts. Review Qual. Factors Section of SDP 1. 1. 3. 3 Testing Standards Reqts. and Templates SDP Review Results Review Software Engineering Section of SDP Review Schedules Section of SDP 1. 1. 3. 6 SDP Issues 1. 1. 3. 5 SDP Testing Issues Reqts. Review Software Components Section of SDP 1. 1. 3. 4 Testing Reqts.

MODELING THE TESTING PROCESS (Review Configuration Management Plan) CMP Issues Configuration Management Plan CMP Issues Review Mgmt. Section of CMP 1. 1. 4. 2 Review Table of Contents of CMP 1. 1. 4. 1 Doc. Problems from Later Phases Standards and Templates TE Review of CMP, Review Comments CMP Issues Format and Testing Issues Standards and Templates Review CM Activities Section of CMP 1. 1. 4. 3 Testing Reqts. Testing Standards Reqts. and Templates CMP Review Results Review Storage and Delivery Section of CMP 1. 1. 4. 6 Testing Reqts. CMP Issues Review Records Section of CMP Review Tools Section of CMP 1. 1. 4. 5 1. 1. 4. 4 Testing Reqts. CMP Issues Testing Reqts.

MODELING THE TESTING PROCESS Requirements from Program Plans CM System Incident-Handling System Standards and Templates Staff Resources Risks Test Tool Information Requirements Issues INPUT PROCESS OUTPUT Create Test Plan 1. 2 Approved Test Plan Review Results Requirements Review Results Test Plan Issues

MODELING THE TESTING PROCESS (Create Test Plan) Requirements Issues Reqts. from Program Plans Incident-Handling System Reqts. Issues Staff Requirements Analyze Requirements 1. 2. 1 Write Test Plan Testable Requirements 1. 2. 2 Test Tool Data, Test Techniques, CM Test Environment, Standards and Templates System Reqts. Review Results Test Items Approved Test Plan, including Features to Test, Features Not to Test, Pass/Fail Criteria, Training Needs, Schedule, Risks Meeting Report Test Plan Review Results Review Test Plan 1. 2. 3 Test Plan

MODELING THE TESTING PROCESS (Analyze Requirements) Reqts. Issues Reqts Ensure Reqts. Not Ambiguous 1. 2. 1. 1 Traceability Matrix Determine If Reqts. Traceable 1. 2. 1. 6 Reqts Issues Review Reqts. Attributes 1. 2. 1. 7 Customer Problems Ensure Reqts. Consistent 1. 2. 1. 3 Determine If Reqts. Complete 1. 2 Reqts. Issues Ensure Reqts. Non -Compound 1. 2. 1. 5 Reqts. Issues Ensure Reqts. Verifiable 1. 2. 1. 8 Ensure Reqts. Correct 1. 2. 1. 4 Reqts. Issues Review Constraints 1. 2. 1. 9 Testable Reqts

MODELING THE TESTING PROCESS Reqts. from Program Plans Reqts. to Test/Not Test (Write Test Plan) Incident. Handling System Define Test Reqts. Test Tool Data, Test Techniques, Test Environment Define Test Environment Staff Needs, Schedule Constraints Test Methods, Techniques, Test Tool Data Reqts. Issues Test Items Test Tasks Define Staff, Schedule 1. 2. 2. 7 List Test Documents 1. 2. 2. 3 Define Test Tasks 1. 2. 2. 2 1. 2. 2. 1 CM System Define CM Tasks 1. 2. 2. 6 Standards and Templates Test Reqts. , Test Tasks List Pass/Fail Criteria 1. 2. 2. 5 1. 2. 2. 4 Standards and Templates Risks Establish Risks 1. 2. 2. 8 Document Test Plan 1. 2. 2. 9 Test Plan Problems from Subprocess 1. 2. 3. 3 Draft Test Plan

MODELING THE TESTING PROCESS (Review Test Plan) Meeting Notice Requirements Distribute Meeting Data Pack and Agenda 1. 2. 3. 1 Test Plan Requirements Meeting Data Pack Review Test Plan Review Comments Meeting Attendees Requirements Issues Meeting Report 1. 2. 3. 2 Test Plan Updates Test Plan Problems Conduct Meeting Publish Meeting Report 1. 2. 3. 3 1. 2. 3. 4 Approved Test Plan Meeting Data Pack

MODELING THE TESTING PROCESS Requirements Approved Test Plan Software Design Source Code Complexity Data Standards and Templates Test Tool Requirements INPUT PROCESS OUTPUT Create Test Design, Test Cases, Test Software, and Test Procedures 1. 3 Test Case, Test Design, Test Procedure Review Results Design and Code Issues Test Plan Issues Test Cases Test Design Test Input Data Test Software Test Procedures Test Documentation Problems

MODELING THE TESTING PROCESS (Create Test Design, Test Cases, Test Software, And Test Procedures) Test Plan Issues Test Plan Software Design, Requirements Reqts. and Test Plan Issues Features List, Requirements Test Plan Review Test Plan 1. 3. 1 Create Test Design Complexity Design, Code Issues Test Env. 1. 3. 7 Entry, Exit Criteria Pass/Fail Criteria Minutes 1. 3. 3 CM System, Standards and Templates Techniques, Methods Acquire Test Software— Build 1. 3. 5 Test Software Doc. Review Test Design 1. 3. 2 Code Review Data, Defect History Create Test Procedures Test Doc. Test Design Issues Test Cases Acquire Test Software— Buy 1. 3. 6 Test Data Test Software Reqts. Test Items Create Test Cases 1. 3. 4 Design Issues CM System Test Env.

MODELING THE TESTING PROCESS (Review Test Plan) Test Plan Issues Requirements Read Test Plan 1. 3. 1. 2 1. 3. 1. 1 Change Requests Requirements Issues Review Testability 1. 3. 1. 6 Requirements Issues, Test Plan Issues Evaluate Ambiguity of Reqts. 1. 3 Review Reqts. Volatility Requirements Issues Identify Interface Issues 1. 3. 1. 5 Identify Performance Issues 1. 3. 1. 4

MODELING THE TESTING PROCESS (Create Test Design) Software Design Requirements Test Plan Issues Features List Test Plan from Test Plan Issues Refine Test Approach Identify Features to Be Tested 1. 3. 2. 1 Test Design Identify Test Cases 1. 3. 2. 3 1. 3. 2. 2 Complexity Requirements and Standards and Test Plan Issues Templates Document Test Design Requirements and Test Plan Issues Test Plan Update Risks 1. 3. 2. 6 1. 3. 2. 5 CM System Requirements and Test Plan Issues Define Pass/Fail Criteria 1. 3. 2. 4

MODELING THE TESTING PROCESS Shading indicates that the action must be taken by other groups besides test engineering (Review Test Design) Meeting Notice Requirements Approved Test Plan Draft Test Design Distribute Meeting Data Pack and Agenda 1. 3. 3. 1 Meeting Data Pack Meeting Attendees Test Design Update Recommendation Meeting Report 1. 3. 3. 2 Review Comments Test Design Updates Test Doc. Problems Publish Meeting Report 1. 3. 3. 4 Approved Test Design Review Test Design Conduct Review Meeting 1. 3. 3. 3 Meeting Data Pack

MODELING THE TESTING PROCESS (Create Test Cases) Approved Test Design Issues Identify Test Items Develop Input Specifications Develop Output Specifications 1. 3. 4. 2 1. 3. 4. 3 1. 3. 4. 1 Approved Test Plan Test Items Test Environment Complexity Identify Inter-Case Dependencies 1. 3. 4. 6 Test Cases Test Software Reqts. Test Plan and Test Design Issues Standards and Templates Document Test Cases Test Plan and Test Design Issues 1. 3. 4. 5 CM System Test Cases Test Environment Identify Environment 1. 3. 4. 4 Needs

MODELING THE TESTING PROCESS (Acquire Test Software—Build) Software Test Design, Design Test Cases Test Software Issues Test Cases for Techniques, from Subprocess Test Software Methods 1. 3. 5. 5 Techniques, Methods Create Test Software Design 1. 3. 5. 2 Analyze Test Software Reqts. 1. 3. 5. 1 Test Software Reqts. Doc. Test Report Test Software Issues to Subprocess 1. 3. 5. 3 Document User Instructions for Test Software 1. 3. 5. 6 Test Software Test Env. Perform Test of Test Software 1. 3. 5. 5 CM System Standards and Templates Code Test Software 1. 3. 5. 3 CM System Documented Issues Change Requests Review Test Software 1. 3. 5. 4 Test Cases for Test Software

MODELING THE TESTING PROCESS (Acquire Test Software—Buy) Software Test Design, Design Test Cases Research Test Software Analyze Test Software Reqts. 1. 3. 6. 1 Test Software Reqts. Doc. Test Software Select and Evaluate Test Software 1. 3. 6. 3 1. 3. 6. 2 CM System Test Report Test Software Issues to Vendor Document User Instructions for Test Software 1. 3. 6. 6 Test Cases for Candidate Test Software Tools Candidate Tools Techniques, Methods Test Environment Perform Test of Test Software 1. 3. 6. 5 CM System Standards and Templates Purchase Test Software 1. 3. 6. 4 Test Cases for Test Software

MODELING THE TESTING PROCESS (Create Test Procedures) Requirements Software Design Test Plan Define Procedures Purpose 1. 3. 7. 1 Test Design, Test Cases Identify Test Setup Reqts. 1. 3. 7. 2 Test Items Describe Entry/Exit Criteria 1. 3. 7. 3 Test Environment Standards and Templates Design, Code Issues Document Test Procedures 1. 3. 7. 6 Test Procedures Test Design, Test Cases CM System Identify Data Analysis Reqts. 1. 3. 7. 5 Define Procedures Test Steps Test Design, Test Cases 1. 3. 7. 4 Design, Test Code Issues Cases Test Plan, Test Design, Test Case Issues

MODELING THE TESTING PROCESS Approved Test Documentation CM System Engineering Test Data Resources and Staff Software Documentation Source Code Test Schedule Test Tools INPUT PROCESS OUTPUT Perform Formal Test 1. 4 Incident. Reports Fixes Requirements, Design and Code Issues Test Documentation Problems Tested Code Incidents, including Test Incidents with Test Documentation Problems System Limitations Test Report Meeting Minutes

MODELING THE TESTING PROCESS (Perform Formal Test) Test Documentation Problems Minutes Test Schedule Software Documentation Test Documentation Source Code, Software Doc. , Test Doc. , Resources, Test Tools Hold Pretest Meeting Tested Code, Incidents, Test Output Data Execute Test 1. 4. 2 1. 4. 1 Engineering Test Data Staff Test Documentation Problems System Limitations Write Test Report CM System Tested Code Environment Staff Hold Posttest Meeting 1. 4. 5 Test Report Requirements, Design, Code Issues 1. 4. 4 Minutes CM System Retest Determine Disposition of Incidents 1. 4. 3 Test Documentation Incident-Tracking Problems Reqts. , Design, System Code Issues

MODELING THE TESTING PROCESS (Hold Pretest Meeting) Meeting Notice Test Documentation Distribute Meeting Data Pack and Agenda 1. 4. 1. 1 Engineering Test Data Test Environment Status Schedule Updates 1. 4. 1. 5 Meeting Report Review Data 1. 4. 1. 2 Test Schedule Review Comments Meeting Attendees Test Item Status Publish Meeting Report Meeting Data Pack Test Documentation Issues Make Test Start Decision 1. 4 Test Team Recommendations Status Updates Conduct Meeting 1. 4. 1. 3 Meeting Data Pack

MODELING THE TESTING PROCESS (Execute Test) Test Environment Test Documentation Test Items, Test Schedule Software Doc. , Test Resources, Test Environment Verify Test Environment Perform Test Procedures 1. 4. 2. 1 1. 4. 2. 2 Test Documentation Issues Analyze Test Output Data 1. 4. 2. 5 Analyzed Test Data Monitor Test Status Incidents Document Incidents 1. 4. 2. 4 Test Output Data Code Test Logs Test Cases, Test Procedures Test Documentation Retest Signal Issues from Subprocess 1. 4. 3. 5 Test Tools Reports System Limitations Incidents, Tested Code, Test Output Data Planned Schedule 1. 4. 2. 3 Incidents; Reqts. , Design, Code Issues Incident-Tracking System

MODELING THE TESTING PROCESS (Determine Disposition Of Incidents) Incident. Tracking System Incident Enter Incident in Tracking System 1. 4. 3. 1 Requirements, Design, or Code Fix Retest Signal to Subprocess 1. 4. 2. 2 Test Output Data Review Prior Incidents CM System Review Test Output 1. 4. 3. 2 Incident-Tracking Test Documentation Fix Tool Specify and Implement Software Fix 1. 4. 3. 5 Test Documentation Identifying Expected Results 1. 4. 3. 3 Incident-Tracking System Specify and Implement Test Fix 1. 4. 3. 4 Retest Signal to Subprocess 1. 4. 2. 2 CM System

MODELING THE TESTING PROCESS (Hold Posttest Meeting) Meeting Notice Incident List Test Documentation Test Data Distribute Review Materials and Agenda 1. 4. 4. 1 Meeting Data Pack Review Test Output Data 1. 4. 4. 2 Review Comments Meeting Attendees Test Manager Recommendation Test Doc. Issues System Limitations Meeting Report Publish Meeting Report 1. 4. 4. 5 Status Updates Make Pass/Fail Decision 1. 4. 4. 4 Schedule Updates Manager Consensus Conduct Meeting 1. 4. 4. 3 Meeting Data Pack

MODELING THE TESTING PROCESS (Write Test Report) Analyzed Test Output Data Hardware and Software Configuration Status Test Documentation Collect Test Output Data 1. 4. 5. 1 Posttest Meeting Report CM System Test Status Reports Review Test Logs Review Incident. Report Status 1. 4. 5. 2 Incident-Tracking System 1. 4. 5. 3 Test Logs Standards and Templates Test Manager Approval Author Inputs Test Report Publish Test Report 1. 4. 5. 6 Create and Review Test Report 1. 4. 5. 5 Set Up Test Report Format 1. 4. 5. 4 Project Team Inputs

MODELING THE TESTING PROCESS INPUT Test Plan Problems Test Design Problems Test Case Problems Test Procedure Problems Test Documentation Requirements Design Standards and Templates PROCESS OUTPUT Update Test Documentation Review Comments 1. 5 Updated Test Plan Updated Test Design Updated Test Cases Updated Test Procedures

MODELING THE TESTING PROCESS (Update Test Documentation) Test Plan, Test Design Test Plan Problems Requirements, Design, Code Analyze Test Documentation Problems 1. 5. 1 Test Design, Test Case, Test Input Data Problems Test Procedure Problems Update Test Documents 1. 5. 2 Test Cases, Test Input Data, Test Procedures Review Comments Incident Reports Test Plan, Test Design, Test Cases, Test Input Data, Test Procedures Review and Approve Software Test Documents 1. 5. 3

MODELING THE TESTING PROCESS (Analyze Test Documentation Problems) Test Plan, Test Design Incidents with Test Design Problems Incidents with Test Plan Problems Test Plan Analyze Test Plan Problems Analyze Test Design Problems 1. 5. 1. 2 1. 5. 1. 1 Requirements, Design Requirements Incidents with Test Procedure Problems, with Proposed Updates Analyze Test Procedure Problems 1. 5. 1. 4 Incidents with Test Design, Test Cases Case Problems Analyze Test Case Problems 1. 5. 1. 3 Test Procedures Requirements, Design

MODELING THE TESTING PROCESS (Update Test Documents) Updates to Test Plan Standards and Templates Updates to Test Design Standards and Templates Update Sections of Test Plan 1. 5. 2. 1 Update Sections of Test Design Requirements, Design Requirements Test Plan, Test Design Internal Review Comments Updated Documents Ready for Review Internally Review Updates Reviewed Test Plan, Test Design, Test Cases, Test Procedures 1. 5. 2. 5 Updates to Test Procedures Update Sections of Test Procedures 1. 5. 2. 4 1. 5. 2. 2 Test Design, Test Cases Update Sections of Test Cases Standards and Requirements, Test Templates Design Procedures Standards and Templates 1. 5. 2. 3 Updates to Requirements, Test Cases Design Standards and Templates

MODELING THE TESTING PROCESS (Review And Approve Software Test Documents) Requirements Updated Test Documents Review Request Requirements Review Updated Test Documents Distribute Updated Test Documents 1. 5. 3. 2 1. 5. 3. 1 Test Documents Review Comments Reviewers Test Documents CM System Approved Test Documents Approve and Publish Test Documents 1. 5. 3. 4 Incorporate Review Comments 1. 5. 3. 3 CM System