Test Planning CSSE 376 Software Quality Assurance RoseHulman

Test Planning CSSE 376, Software Quality Assurance Rose-Hulman Institute of Technology March 9, 2007 1

Outline Process for planning n Test plan components n 2

Test Planning Process 1. 2. 3. 4. Define test strategy Define test system Estimate test effort Prepare and review test plan 3

1. Test Strategy n Scope ¨ You cannot test everything. ¨ What are the priorities? n n most important features new code most difficult areas most often used features int sum(int a, int b){ int r = a; while (b > 0) { r++; b--; } return r; } 4

1. Test Strategy (continued) Approach: When to do different tasks n Entry/exit criteria n ¨ When can you start? ¨ When can you stop? ¨ When can you restart? n Automation ¨ Which tools? ¨ When? (e. g. , only regression testing) 5

2. Test Systems n Architecture ¨ Test suite: collection of tests for a related group of requirements ¨ Test: one or more test cases for a single function or requirement ¨ Test case: smallest unit Environment: physical facilities n Configurations: platforms, combinations n 6

3. Estimating Test Effort Tasks: list of things to do n Effort estimation: previous experience, expert judgment (Delphi), decomposition n Schedule: show relationships between tasks n Risks: estimate likelihood and impact n 7

Delphi Experiment 8

Cartoon of the Day 9

Components of a Test Plan 1. 2. 3. 4. 5. 6. 7. 8. Test plan identifier Introduction Test items Features to be tested Features not to be tested Approach Item pass/fail criteria Suspension criteria and resumption requirements 9. 10. 11. 12. 13. 14. 15. 16. Test deliverables Testing tasks Environmental needs Responsibilities Staffing and training needs Schedule Risks and contingencies Approvals 10

Test Plan Components (1) 1. 2. 3. 4. 5. Test plan identifier: unique Introduction: objectives of document Test items: high-level description of inputs to testing Features to be tested: list of features or requirements Features not to be tested: features you cannot test yet 11

Test Plan Components (2) 6. Approach how you will test n may include: phases of testing (unit, system, acceptance), static vs. dynamic methods, performance testing, regression testing, use of problem tracking system n 7. Item pass/fail criteria When does a test pass? n When does the product pass? n 12

Test Plan Components (2) 8. 9. 10. 11. 12. Suspension criteria and resumption requirements: what to do if bugs prevent progress Test deliverables: all outputs of testing Testing tasks: from your schedule Environmental needs: hardware and software Responsibilities: who does what 13

Test Plan Components (3) 13. 14. 15. 16. Staffing and training needs: list people or types of people Schedule: milestones Risks and contingencies: matrix here Approvals: signatures 14