Rating Concepts and Scales Concepts Scales Determine highest

  • Slides: 17
Download presentation
Rating Concepts and Scales Concepts Scales ð Determine highest capability level to rate ð

Rating Concepts and Scales Concepts Scales ð Determine highest capability level to rate ð Process context - see scope ð Process and process instances under scope ð Assessment purpose must always be kept in mind WM-001 - Software Process & Quality - N: Not achieved P: Partially achieved L: Largely achieved F: Fully achieved Determining Ratings -slide#1 + 1

Process Attribute Rating Scale N Not achieved No evidence of achievement of the defined

Process Attribute Rating Scale N Not achieved No evidence of achievement of the defined attribute P Partially achieved Some achievement of the defined attribute L Largely achieved Significant achievement of the defined attribute F Fully achieved Full achievement of the defined attribute WM-001 - Software Process & Quality Determining Ratings -slide#2 2

Process Attribute Ratings ï Rating references can be expressed in the form: PC. PR

Process Attribute Ratings ï Rating references can be expressed in the form: PC. PR (Instance Reference); CL. PA where - PC = Process Category - PR = Process - (instance reference) = number or list - CL = Capability Level - PA = Process Attribute WM-001 - Software Process & Quality Determining Ratings -slide#3 3

Expressing Rating ð Example: For a single instance of process ENG. 2 (Develop Software

Expressing Rating ð Example: For a single instance of process ENG. 2 (Develop Software Requirements) which is referred to as ‘SEAF-des-1’, a capability rating is determined for each attribute at Level 3, the Well-Defined Level. The ratings might be expressed as: ENG. 2(SEAF-des-1); 3. 1 = L ENG. 2(SEAF-des-1); 3. 2 = P WM-001 - Software Process & Quality Determining Ratings -slide#4 4

Ratings Determination contains Capability lev. 1 rating determined against Process indicator Base Practices Process

Ratings Determination contains Capability lev. 1 rating determined against Process indicator Base Practices Process Profile òPerformance of relevant tasks provides 1 st indication that an implemented process meets purpose òThe existence of worksatisfies products is the second indication. Sample work. Process purpose used to assess product types must exist. statement Organization’s processes WM-001 - Software Process & Quality Determining Ratings -slide#5 5

Ratings Determination Higher (Management) Capabilities Process Profile contains Capability rating level 2 -5 òuse

Ratings Determination Higher (Management) Capabilities Process Profile contains Capability rating level 2 -5 òuse the set of process capability indicators determined against òtake into account the capability level and the attribute definitions Process capability indicator is applied to Process òa rating is assigned and attribute justified by the assessor Organization’s used to assess processes WM-001 - Software Process & Quality Determining Ratings -slide#6 6

Ratings Determination - Overall Process Profile contains Capability rating level 2 -5 Capability lev.

Ratings Determination - Overall Process Profile contains Capability rating level 2 -5 Capability lev. 1 rating determined against Process indicator is applied to satisfies Process purpose statement WM-001 - Software Process & Quality Process capability indicator used to assess Organization’s processes Determining Ratings -slide#7 Process attribute used to assess 7

Relationship between Reference Model and the Assessment Model PROCESS DIMENSION CAPABILITY DIMENSION E C

Relationship between Reference Model and the Assessment Model PROCESS DIMENSION CAPABILITY DIMENSION E C Process categories N E R EL Processes E F OD E Process purposes R M Capability levels Process attributes T N E S Indicators of process M R S O S T capability performance E A S IC S A D Base Practices Management practices IN WPs & characteristics Indicators of Attribute indicators practices performance WM-001 - Software Process & Quality Determining Ratings -slide#8 8

Capability Level Determination Continuous Imprvm’t - 5. 2 Process Change- 5. 1 Process Control

Capability Level Determination Continuous Imprvm’t - 5. 2 Process Change- 5. 1 Process Control - 4. 2 Process Measurement - 4. 1 Process Resource - 3. 2 Proc. Def’n & Tailoring - 3. 1 Work Product Mngmt - 2. 2 Performance Mngmt - 2. 1 Process Performance - 1. 1 Lev. 0 Lev. 1 Lev. 2 Largely achieved WM-001 - Software Process & Quality Determining Ratings -slide#9 Lev. 3 Lev. 4 Lev. 5 Fully achieved 9

Calculating Capability Level Ratings Levels 1 - 3 Capability Level Process Attributes Rating Level

Calculating Capability Level Ratings Levels 1 - 3 Capability Level Process Attributes Rating Level 1 (Inc) PA 1. 1 Process Performance L or F Level 2 PA 1. 1 Process Performance PA 2. 1 Performance Mgmt PA 2. 2 Work Product Mgmt F L or F PA 1. 1 Process Performance PA 2. 1 Performance Mgmt PA 2. 2 Work Product Mgmt PA 3. 1 Process Definition PA 3. 2 Process Resource F F F L or F (Performed) Level 3 (Managed) WM-001 - Software Process & Quality Determining Ratings -slide#10 10

Calculating Capability Level Ratings Level 4 (Predictable) Capability Level 4 WM-001 - Software Process

Calculating Capability Level Ratings Level 4 (Predictable) Capability Level 4 WM-001 - Software Process & Quality Process Attributes PA 1. 1 Process Performance PA 2. 1 Performance Mgmt PA 2. 2 Work Product Mgmt PA 3. 1 Process Definition PA 3. 2 Process Resource PA 4. 1 Process Measurement PA 4. 2 Process Control Determining Ratings -slide#11 Rating F F F L or F 11

Calculating Capability Level Ratings Level 5 (Optimized) Capability Level 5 WM-001 - Software Process

Calculating Capability Level Ratings Level 5 (Optimized) Capability Level 5 WM-001 - Software Process & Quality Process Attributes PA 1. 1 Process Performance PA 2. 1 Performance Mgmt PA 2. 2 Work Product Mgmt PA 3. 1 Process Definition PA 3. 2 Process Resource PA 4. 1 Process Measurement PA 4. 2 Process Control PA 5. 1 Process Change PA 5. 2 Continuous Improvemt Determining Ratings -slide#12 Rating F F F L or F 12

Rating Examples Man. 2 Proj 1 Proj 2 Proj 3 Proj 4 Proj 5

Rating Examples Man. 2 Proj 1 Proj 2 Proj 3 Proj 4 Proj 5 F = Fully L = Largely P = Partially N = None WM-001 - Software Process & Quality 1. 1 2. 2 3. 1 3. 2 4. 1 4. 2 5. 1 5. 2 F L L F L P N N N L P L P N N N P N P N N F F L P N N N F L L P N LEV, 2 1 0 3 2 Determining Ratings -slide#13 13

Rating Examples Accumulated F = Fully L = Largely P = Partially N =

Rating Examples Accumulated F = Fully L = Largely P = Partially N = None Man. 2(*)1. 1 = [0%N, 20%P, 20%L, 60%F] Man. 2(*)2. 1 = [20%N, 40%P, 20%L, 20%F] Man. 2(*)2. 2 = [0%N, 20%P, 40%L, 40%F] Man. 2(*)3. 1 = [20%N, 20%P, 20%L, 40%F] Man. 2(*)3. 2 = [0%N, 20%P, 0%L, 80%F] Man. 2(*)4. 1 = [20%N, 80%P, 0%L, 0%F] Man. 2(*)4. 2 = [100%N, 0%P, 0%L, 0%F] Man. 2(*)5. 1 = [80%N, 20%P, 0%L, 0%F] Man. 2(*)1. 1 = [100%N, 0%P, 0%L, 0%F] WM-001 - Software Process & Quality Determining Ratings -slide#14 14

Distribution of Attribute Ratings WM-001 - Software Process & Quality Determining Ratings -slide#15 15

Distribution of Attribute Ratings WM-001 - Software Process & Quality Determining Ratings -slide#15 15

Example Process Attribute Ratings % WM-001 - Software Process & Quality Determining Ratings -slide#16

Example Process Attribute Ratings % WM-001 - Software Process & Quality Determining Ratings -slide#16 16

Deriving a Process Profile is derived from Evidence of Process Performance (Capability Lev 1)

Deriving a Process Profile is derived from Evidence of Process Performance (Capability Lev 1) Based on judgement of Indicators of Process Capability Indicators of Process Performance consisting of Input and output work products and their characteristics Base Practices used to assess WM-001 - Software Process & Quality Evidence of Process Capability (Capability Lev 2 -5) consisting of Management Practices Characteristics of practice of resources & Associated performance infrastructure Processes Organization’s Processes Determining Ratings -slide#17 17