SQA What is Quality n Quality of Design

SQA

What is "Quality"? n "Quality of Design" and "Quality of Conformance" -- Roger Pressman n User Satisfaction = compliant product + good quality + delivery within budget and schedule -- Robert Glass

Standard Definition Software Quality - Conformance to: explicitly stated functional and performance requirements, 2. explicitly documented development standards, and 3. implicit characteristics that are expected of all professionally developed software. 1.

SQA Components 1. 2. 3. 4. 5. 6. Pre-Project Components Development and Maintenance Activities Error Reduction Infrastructure SQ Management Components SQA System Assessment Human Components Software Quality Assurance by Galin

1. Pre-Project Components Contract Review n Development and Quality Plans n ¨ Development n n n schedules manpower requirements tools ¨ Quality n n n Plans measurable quality goals success criteria for each project phase scheduled V&V activities

Obvious Question… Q: Why should the software geeks worry about the contract? A: Because the software team must do the work and assure the product's quality. loosely defined requirements ¨ unrealistic budgets ¨ unrealistic schedules ¨ A: Contract review is required by ISO 9001

IEEE 730 - Standard for SQA Plans Plan Sections 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. Purpose Reference Documents Management Documentation Standards, Practices, and Conventions Reviews and Audits Software Configuration Management Problem Reporting and Corrective Action Tools Techniques and Methodologies Code Control Media Control Supplier Control Records Collection, Maintenance, and Retention

2. Life Cycle Components Software Testing n Reviews n varying levels of formality ¨ specs, designs, code modules, documents, etc ¨ n Maintenance corrective ¨ adaptive ¨ functional ¨

Formal Technical Reviews n FTRs are the primary quality control activity. n Justification to err is human ¨ other people are better at finding our faults than we are ¨ good way for other people to learn details about another part of the project ¨

FTR Guidelines n 3 to 5 people n n includes the producer, review leader, recorder no more than two hours preparation small portions only n narrow focus increases likelihood of find an error n meeting duration less than two hours n outcome: accept, accept pending changes, reject n report is signed and saved n

FTR Guidelines n n n n n Review the Product, not the person! Set an agenda and keep it. Limit debate and rebuttal. Find errors, don't try to solve them. Take written notes. Limit number of participants and have advance preparation. Allocate resources and schedule time for FTRs. Conduct training for reviewers. Review your earlier reviews.

3. Error Prevention and Improvement Infrastructure Next Slide work procedures see link to NASA n templates and checklists n staff training n preventive actions n configuration control Last Class n document control n

Example types of Work Instructions audit process for subcontractors n design documentation templates n C++ programming instructions n coordination and cooperation with the customer n follow-up of beta site reporting n monthly progress reporting n Galin: page 316

4. Management Components n Project Progress ¨ schedules, budgets, risk analysis, … n Quality Metrics n Quality Costs

Statistical SQA 1. Info about defects are collected and categorized. 2. Defects are traced to their root cause. 3. Isolate the vital 20% 4. Move to correct problems that caused defects. SSQA is similar to "Six Sigma" Pareto Principle: 80% of defects can be traced to 20% of causes.

5. SQA Assessment n Quality Management Standards SEI CMM ¨ ISO 9001 ¨ Details o'plenty Next Week

SEI CMM Levels 1. Initial n 2. ad hoc, perhaps chaotic Repeatable tracks costs, has a schedule n similar projects can repeat earlier successes n 3. Defined n 4. Managed n 5. process in documented and standardized detailed process and product measurements Optimizing n continuous process improvement

ISO Standards for Quality n ISO 9000 : Quality Management and Quality Assurance Standards - Guidelines for selection and use n ISO 9001 : Quality Systems - Model for quality assurance in design/development, installation, and servicing n ISO 9000 -3 : Guidelines to applying 9001 to software

ISO 9000 seeks to set criteria which achieve a goal and is not prescriptive as to methods. The requirements come in Sections 4 to 8. Section 4 is entitled General Requirements ¨ Section 5 is entitled Management Responsibility ¨ Section 6 is entitled Resource Management ¨ Section 7 is entitled Product Realization ¨ Section 8 is entitled Measurement, analysis and improvement ¨ In each of these areas, ISO 9001: 2000 seeks to set out key requirements, which if met will ensure quality. http: //en. wikipedia. org/wiki/ISO_9000

Other Quality-Related Standards n ANSI/IEEE 730 - Standard for Software Quality Assurance Plans n ANSI/IEEE 983 - Software Quality Assurance Planning n ANSI/IEEE 1028 - Standard for Software Reviews and Audits n ANSI/IEEE 1012 - Standard for Software Verification and Validation

6. Human Components n Management n SQA Unit n SQA committees and forums

The SQA Group n n n n Participates in the development of the project's software process description. Reviews software engineering activities to verify compliance with the defined process. Audits designated software work products to verify compliance with those defined as part of the software process. Ensures that deviations in software work and work products are documented and handled according to a documented procedure. Records any noncompliance and reports to senior management. Coordinates and controls change. Helps collect and analyze metrics.

When is enough? SQA + Failure Costs Cost of SQA Cost of Failure Software Quality Optimal Quality Level

Summary n "Quality" includes explicit and implied properties as well as the development process. n FTRs are a key part of SQA. n An SQA Group is highly recommended. n QA must be part of the plan and schedule. n SSQA is a commonly used formal approach to quality assurance and process improvement.

Next Time… SEI CMM n ISO 9001 n