Planning Design 1 0 Feature freeze Code freeze

Процесс непрерывной разработки программного продукта Planning Design 1. 0 Feature freeze Code freeze Development 2. 0 1. 0 beta 1. 0 1. 1 Product to customer Planning Design Development Testing & Debugging Deployment

Процесс непрерывной разработки программного продукта Planning Design 1. 0 Feature freeze Code freeze Development 2. 0 1. 0 beta 1. 0 1. 1 Product to customer Planning Design Development Testing & Debugging Deployment

Типы тестирования Модульное (Unit) n Regression n Функциональное n Интеграционное n Performance n Stress n Compatibility n Installation/Deployment n

CMM/CMMI Capability Maturity Model® Integration (CMMI) 0. 1. 2. 3. 4. 5. Incomplete Performed Managed Defined Quantitatively Managed Optimizing

CMM/CMMI generic practices n GG 1 Achieve Specific Goals n n GG 2 Institutionalize a Managed Process n n n 2. 1 Establish an Organizational Policy 2. 2 Plan the Process 2. 3 Provide Resources 2. 4 Assign Responsibility 2. 5 Train People 2. 6 Manage Configurations 2. 7 Identify and Involve Relevant Stakeholders 2. 8 Monitor and Control the Process 2. 9 Objectively Evaluate Adherence 2. 10 Review Status with Higher Level Management GP 3. 1 Establish a Defined Process GP 3. 2 Collect Improvement Information GG 4 Institutionalize a Quantitatively Managed Process n n n GP GP GP GG 3 Institutionalize a Defined Process n n GP 1. 1 Perform Base Practices GP 4. 1 Establish Quantitative Objectives for the Process GP 4. 2 Stabilize Subprocess Performance GG 5 Institutionalize an Optimizing Process n n GP 5. 1 Ensure Continuous Process Improvement GP 5. 2 Correct Root Causes of Problems

Project Quality Management

RUP – Rational Unified Process

Организация QA команды Department QA Testing Tools Project 1 Test Development Metrics Project. N

Преимущества выделенного QA n Unification of QA processes and standards in an organization n QA career path n Separation of development and testing resources n Common QA planning n Sharing and load balancing of HW and human resources n QA manager has similar org-level with development managers and has a “say so” in decision making

Инструментарий QA Requirements Management Testbase Version Control Bugtracking Test generators Test harness Test Results DB

Организация совместной разработки программ Product WS Pre-integration WS Component. WS SB Pre-integration WS Developer. SB SB

Backup

V-модель тестирования Product validation Big. App testing Monthly testing Bi-weekly Weekly Nightly Mainline-checkin Check-in criteria Developer testing

Задачи команды тестирования Build products, run regular testing, analyze failures, submit bugreport, provide testing reports n Maintain testing workloads n Maintain testbase n Manage testing platforms n Develop and support QA processes, perform automation n Developer support n

Задачи Test Development Work in close cooperation with developers n Perform systematic test development n Use different methodologies to detect weak areas of compiler n Develop new testing methodologies n

Test development example Stage Developer QA Feature planned Testing works planned. Testing strategy developed ww 8 Planning ww 11 Planned start of implementation ww 12 Feature development slipped to ww 17 Notified QA about changing plans Test development rescheduled ww 17 Feature development started Developer produced some preliminary working product Active test development started, tests are being delivered to developer Feature development Developer provides QA with fresh product QA reports to developer all newly found problems ww 18 Test development scheduled ww 19 Feature development Development continues Basic test development finished, test delivered to developer ww 20 ww 25 Feature development Development continues No activity ww 26 Finalization Feature is almost completed Testsuite revised, many tests improved ww 27 Final testing Feature completed Some specific tests are to be added ww 28 Feature promoted Developer promoted feature. Bugs for every known problem submitted to bugtracking system Some specific tests are to be added. All found problems are now submitted through bugtracking system ww 29 Testsuite finalization Developer delivered tests to QA QA revised the whole testsuite and integrate developer tests if appropriate ww 30 Regular testing No activity Testsuite integrated to regular testing.

Test development example Dev QA

Планирование качества n Set clear quality criteria for major release stages (betaacceptance criteria, release criteria). In terms of: n n n n Passrate on special set of important suites (usually 100%) Passrate of baseline testing in comparison with previous release Passrate on new features testsuites Number of high priority bugs allowed Define OS matrix and volume of testing on each platform Define testing level required for every new product feature Set bug fixing goals for components Develop test plans and testing schedule

Жизненный цикл дефекта Bug status: Bug resolution: Submitted Not reproducible Engineering Will not be fixed Fixed 3 -rd party problem Verified User Error Closed Fixed/Implemented