This work is licensed under the Creative Commons

This work is licensed under the Creative Commons Attribution-No. Derivs License ISO/IEC 15504 and the SPICE Network A Status Report Terry Rout ISO/IEC 15504 Project Editor Griffith University Software Quality Institute T. Rout@griffith. edu. au Alec Dorling ISO/IEC 15504 Convener Inter. SPICE Ltd alec. dorling@interspice. uk. com Copyright Inter. SPICE Ltd.

License You are free: • to copy, distribute, display, and perform the work • to make commercial use of the work Under the following conditions: Attribution. You must give the original author credit. No Derivative Works. You may not alter, transform, or build upon this work. • For any reuse or distribution, you must make clear to others the license terms of this work. • Any of these conditions can be waived if you get permission from the author. Your fair use and other rights are in no way affected by the above. http: //creativecommons. org/licenses/by-nd/1. 0/ Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Process Assessment - a History 1 v 1985 ² v 1987 ² v Humphrey and Sweet from the Software Engineering Institute (SEI) at Carnegie Mellon University publish a report on the state of software development. 1989 ² ² v Ron Radice and colleagues report on a “Programming Process Study” at IBM. SEI issues its first maturity questionnaire. Watts Humphrey’s book “Managing the Software Process” is published. 1991 ² ² ² UK Mo. D conducts Improve-IT study. SEI releases SW-CMM V 1. 0. ISO requests a study on process assessment. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Development of a Standard v v Pressures for a standard: ² The increasing number of assessment approaches available. ² The increasing use of the technique in commercially-sensitive areas. The 1992 study group report for JTC 1/SC 7: ² v “. . . the international community should pool its resources to develop a standard for software process assessment, incorporating the best features of existing software assessment methods. ” Staged development: ² ² initial publication as a Technical Report (“draft standard”); revision and publication as ISO/IEC 15504 - Information Technology Process Assessment. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Process Assessment - a History 2 v 1993 ² ² ² v 1995 ² ² v SEI commence work on SE-CMM. ISO accepts new work item on process assessment. SEI release SW-CMM V 1. 1. SEI release SE-CMM V 1. 1. SPICE (ISO 15504) standard draft released. 1998 ² ISO TR 15504 published. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

ISO/IEC TR 15504 v International standard for assessing software processes v Purpose: v ² Continuous process improvement ² Capability determination Scope: ² Processes include acquisition, supply, development, operation, maintenance and support ISO/IEC TR 15504 is currently in transition to full International Standard status Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Process Assessment - a History 3 v 2000 ² v 2002 ² v CMMI® SE/SW/IPPD/SS V 1. 1 released. 2003 ² v CMMI® SE/SW/IPPD V 1. 0 released. ISO 15504 -2 -3 published. 2004/5 ² Full publication of ISO/IEC 15504 Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Current Status v Part 1 ² v Part 2 ² v Published (6 Jan 2004) Part 4 ² v Published (31 Oct 2003) Part 3 ² v Approved for publication following FDIS ballot Approved for publication following FDIS Ballot Part 5 ² ² ² Committee Draft (CD) ballot completed 2 nd CD ballot to commence 2 July 2004 Scheduled completion 2005 (Part 5) Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Organisational Maturity - New study v Views have crystallized over time regarding continuous and stage representations and models of process capability. v It is generally acknowledged that levels of organisational maturity can be defined in terms of defined profiles of process capability. v There is however no recognised common definition of maturity or sets of profiles corresponding to maturity levels. v A study is therefore underway (Jun-Oct 2004) by WG 10 to explore the needs and requirements for the definition of a framework for the expression of organisational maturity consistent with ISO/IEC 15504 -2. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

ISO/IEC 15504 - Revision q Name change from Software Process Assessment to Process Assessment q Restructuring from 9 parts to 5 parts q Inclusion of exemplar assessment method q Process dimension removed to ISO 12207 q Introduction of Process Reference Models q Alignment of Capability Dimension with ISO 9001: 2000 q q Revision of small set of ISO 12207 AMD 1 processes by publication of ISO 12207 AMD 2 12207 AMD 1 and 2 used as basis for PRM in exemplar assessment model New opportunities Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

The International Standard Part 1 Concepts and Vocabulary Part 3 Part 2 Guidance on Performing Assessments Requirements (normative) Guidance on Using Assessment Results Part 5 Compliant Process Reference Model (ISO/IEC 12207 AMD 1/2) Software Quality Institute Part 4 An Exemplar Assessment Model Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

The Process Assessment Process PROCESS REFERENCE MODEL PROCESS ASSESSMENT MODEL Scope Indicators Mapping Translation Domain and Scope Process Purpose Process Outcomes MEASUREMENT FRAMEWORK Capability Levels Process Attributes Rating Scale ASSESSMENT PROCESS INPUT Sponsor identity Purpose Scope Constraints Assessment Team OUTPUT Identification of Evidence Process Used Process Profiles Planning Data Collection Data Validation Process Attribute Rating Reporting ROLES AND RESPONSIBILITIES Sponsor Competent Assessors Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

The Assessment Framework Two-dimensional model for processes and process capability ² ² Process Dimension l Process Categories l Processes (P 1, …, Pn) Capability Dimension l Capability Levels (CL 1, …, CL 5) l Process Capability Attributes CL 5 CL 4 CL 3 CL 2 CL 1 CL 0 CUS. 1 CUS. 2. . . ORG. 6 Each process receives a capability level rating This is referred to as a Continuous Model Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

ISO/IEC 15504 -5: Processes Acquisition preparation Supplier selection Contract agreement Supplier monitoring Product acceptance Configuration Control Management Documentation management Configuration management Problem resolution management Change request management Organisational alignment Organisational management Project management Quality management Risk management Measurement Product Quality Supply Product evaluation Supplier tendering Product release Product acceptance support Quality Assurance Engineering Requirements elicitation System requirements analysis System architectural design Software requirements analysis Software design Software construction Software integration Software testing Software installation System integration System testing System and software maintenance Software Quality Institute Process Improvement Process establishment Process assessment Process improvement Quality assurance Verification Validation Joint review Audit Resource and Infrastructure Human resource management Training Knowledge management Infrastructure SUPPORTING ORGANISATIONAL PRIMARY Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Reuse Asset management Reuse program management Domain engineering Copyright Inter. SPICE Ltd. 1 December 2003

The New Measurement Framework Optimizing The process is continuously improved to meet relevant current and projected business goals Level 5 Optimizing PA. 5. 1 PA. 5. 2 Predictable The process is enacted consistently within defined limits Level 4 Predictable PA. 4. 1 PA. 4. 2 Established A defined process is used based on a standard process. PA. 2. 1 PA. 2. 2 PA. 3. 1 PA. 3. 2 Process Definition Process Deployment Performance Management Work Product Management Level 1 Performed Process Performance Level 0 Incomplete Software Quality Institute Process Measurement Process Control Level 3 Established Level 2 Managed PA. 1. 1 Process Innovation Process Optimisation Managed The process is managed and work products are established, controlled and maintained. Performed The process is implemented and achieves its process purpose Incomplete The process is not implemented or fails to achieve its purpose Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

The Assessment Framework Assessment Tool Process Reference Model Process Assessment Model Output Input - Purpose - Scope - Constraints Assessor Training Syllabus & Certification Scheme Process Assessment Responsibilities Competent Assessor Sponsor Assessors Competent Assessors Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions 5 4 3 2 1 Process Improvement or Capability Determination Guidance Copyright Inter. SPICE Ltd. 1 December 2003

The Assessment Model ISO 15504 -2 Requirements for Conformity (Compatibility) determine applicability of Measurement Framework Process Reference Model Assessment Model e. g. ISO 12207 Requirements for Compliance determine suitability of Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Process Assessment Models v v v A Process Assessment Model forms the basis for the collection of evidence and rating of process capability. Any Process Assessment Model is related to one or more Process Reference Models. A Process Assessment Model shall contain: ² ² ² a definition of its purpose, scope, elements and indicators; its mapping to the Measurement Framework and the specified Process Reference Model(s); a mechanism for consistent expression of results. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Why the concern for Conformance? v v Results from assessments based on the same assessment model can generally be compared in some way. The requirements for conformance of assessment models broadens the basis for comparison: ² assessments based on different assessment models can be compared, providing the models can be related to the same Process Reference Model. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Harmonising Different Approaches Part 5 CMMI ISO 9001: 2000 CL 5 CL 4 CL 3 CL 2 CL 1 CL 0 P 1 P 2 P 3. . Pn A common reference framework OOSPICE Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Automotive SPICE Copyright Inter. SPICE Ltd. 1 December 2003

Process Reference Models 15504 Requirements REQUIREMENTS Performing an assessment Process Reference Models Process Assessment Models Conformity assessment Model Architecture Process Categories Process Capability Levels Reference Processes Model Process Attributes requirements 15504 Assessment Model Automotive SPICE OOSPICE ISO 9001 S 9 K 12207 based Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Standards-Based Process Reference Models 12207 Software Lifecycle Process ISO/IEC 12207 Amendment 1 and 2 15288 System Lifecycle Process ISO/IEC 15288 18529 Human Centered Lifecycle Process ISO/IEC 18529 ISO 9001 Quality Management European Space Agency Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Sector / Domain Based Developments SPACE SPICE 4 SPACE European Space Agency AUTOMOTIVE SPICE IEC 62304 – Medical Device Software – Software Life Cycle Processes Medi-SPICE The SPICE User Group Procurement Forum / SPICE UG Component Based Development OOSPICE IT Infrastructure Management TBD Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Recommendations for Transition - 1 v It is recommended that (with immediate effect) assessment approaches that support conformance with the requirements of ISO/IEC TR 15504 transition to support conformance with the requirements of ISO/IEC FDIS 15504 -2. ² v The requirements include the use of the new measurement framework for process capability. Assessment approaches that are currently using the exemplar assessment model in ISO/IEC TR 15504 -5 may use the process dimension in ISO/IEC TR 15504 -2 as the basis for a Process Reference Model (PRM) and use ISO/IEC TR 15504 -5 as the basis for a Process Assessment Model (PAM) in relation to the PRM Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Recommendations for Transition - 2 v It is recommended that assessment approaches that are currently using the exemplar assessment model in ISO/IEC TR 15504 -5 commence to transition to use the exemplar Process Assessment Model in ISO/IEC 15504 -5 in conjunction with Process Reference Model in ISO/IEC 12207: 1995 AMD 1 and 2 as soon as ISO/IEC 15504 -5 is distributed for FCD ballot (Nov 2004). ² It is noted that the exemplar Process Assessment Model (ISO/IEC 15504 -5) is expected for publication in 2005. Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Achievements v 4000 v In assessment performed worldwide 45 countries v Major ² sectors setting the pace Space, Automotive, Defence, Aerospace, Medical Devices v Major country initiatives ² Initiated in Europe ² Japan, Korea, Australia, Brazil v Microsoft Readiness Framework Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Why has SPA has been performed? ð Establish project/organisation baseline and/or track organisations’ process improvement ð Improve Establish best practices to guide organisational process improvement ð Improve efficiency and/or customer service ð Customer demand to improve process capability ð Generate management / technical support and buy in for software process improvement ð Improve reliability of products Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

International Assessor Certification Scheme Providing confidence in the assessors v www. int-acs. org v Purpose ² v v To certify as competent, assessors trained and qualified in the principles and practices of assessing processes using ISO/IEC 15504. Intended for ² Internal process assessors ² External process assessors ² Process practitioners Three assessor grades ² Provisional assessor, Assessor, Principal assessor Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

ISO/IEC 15504 Certification Scheme Providing confidence in the Assessment Results v Certification Scheme(s) under discussion / development v Underlying Target Maturity Model TMM© v Based on ISO/IEC 15504 NOT ISO/IEC TR 15504 v First trial certifications end 2004 Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

SPICE User Group The SPICE User Group is a non profit membership organization. SPICE User Group Membership Services SPICE Network Annual Conference Research Enhanced membership services planned end 2004 Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Benchmarking Copyright Inter. SPICE Ltd. 1 December 2003

www. spice 2005. com Annual Conference APRIL 2005, Austria IWAS Universität Klagenfurt Lakeside University Park Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

Keeping Informed www. isospice. com Software Quality Institute Inter SPICE ISO/IEC 15504 (SPICE): Current and Future Directions Copyright Inter. SPICE Ltd. 1 December 2003

END Copyright Inter. SPICE Ltd. •