Rating Concepts and Scales

- + Rating Concepts and Scales • Determine highest capability level to rate • Process context - see scope • Process and process instances under scope • Assessment purpose must always be kept in mind Concepts Scales N: Not achieved P: Partially achieved L: Largely achieved F: Fully achieved Determining Ratings -slide#1

Process Attribute Rating Scale NNot achieved No evidence of achievement of the defined attribute PPartially achieved Some achievement of the defined attribute LLargely achieved Significant achievement of the defined attribute FFully achieved Full achievement of the defined attribute Determining Ratings -slide#2

Process Attribute Ratings • Rating references can be expressed in the form:PC.PR (Instance Reference); CL.PAwhere - PC = Process Category - PR = Process - (instance reference) = number or list - CL = Capability Level - PA = Process Attribute Determining Ratings -slide#3

Expressing Rating • Example:For a single instance of process ENG.2 (Develop Software Requirements) which is referred to as ‘SEAF-des-1’, a capability rating is determined for each attribute at Level 3, the Well-Defined Level. The ratings might be expressed as:ENG.2(SEAF-des-1);3.1 = L ENG.2(SEAF-des-1);3.2 = P Determining Ratings -slide#4

Process Profile contains Capability lev. 1 rating determined against Process indicator satisfies Process purpose statement used to assess Organization’s processes Ratings Determination Base Practices • Performance of relevant tasks provides 1st indication that an implemented process meets purpose • The existence of work-products is the second indication. Sample work-product types must exist. Determining Ratings -slide#5

Process Profile contains Capability rating level 2-5 determined against Process capability indicator is applied to Process attribute Organization’s processes used to assess Ratings Determination Higher (Management) Capabilities • use the set of process capability indicators • take into account the capability level and the attribute definitions • a rating is assigned and justified by the assessor Determining Ratings -slide#6

Process Profile contains contains Capability rating level 2-5 Capability lev. 1 rating determined against determined against Process capability indicator Process indicator is applied to satisfies Process attribute Process purpose statement used to assess Organization’s processes used to assess Ratings Determination - Overall Determining Ratings -slide#7

PROCESS DIMENSION CAPABILITY DIMENSION Process categories Processes Process purposes Capability levels Process attributes REFERENCE MODEL Indicators of process capability Indicators of process performance ASSESSMENT INDICATORS Base Practices WPs & characteristics Management practices Attribute indicators Indicators of practices performance Relationship betweenReference Model and the Assessment Model Determining Ratings -slide#8

Capability Level Determination Continuous Imprvm’t - 5.2 Process Change- 5.1 Process Control - 4.2 Process Measurement - 4.1 Process Resource - 3.2 Proc. Def’n & Tailoring - 3.1 Work Product Mngmt - 2.2 Performance Mngmt - 2.1 Process Performance - 1.1 Lev.0 Lev.1 Lev.2 Lev.3 Lev.4 Lev.5 Largely achieved Fully achieved Determining Ratings -slide#9

Calculating Capability Level Ratings -Levels 1 - 3 Capability Level Process AttributesRating Level 1 (Inc)PA1.1 Process Performance L or F Level 2 PA1.1 Process Performance F (Performed) PA2.1 Performance Mgmt L or F PA2.2 Work Product Mgmt L or F Level 3 PA1.1 Process Performance F (Managed) PA2.1 Performance Mgmt F PA2.2 Work Product Mgmt F PA3.1 Process Definition L or F PA3.2 Process Resource L or F Determining Ratings -slide#10

Capability Level Process Attributes Rating Level 4 PA1.1 Process Performance F PA2.1 Performance Mgmt F PA2.2 Work Product Mgmt F PA3.1 Process Definition F PA3.2 Process Resource F PA4.1 Process Measurement L or F PA4.2 Process Control L or F Calculating Capability Level Ratings -Level 4 (Predictable) Determining Ratings -slide#11

Capability Level Process Attributes Rating Level 5 PA1.1 Process Performance F PA2.1 Performance Mgmt F PA2.2 Work Product Mgmt F PA3.1 Process Definition F PA3.2 Process Resource F PA4.1 Process Measurement L or F PA4.2 Process Control L or F PA5.1 Process Change L or F PA5.2 Continuous Improvemt L or F Calculating Capability Level Ratings -Level 5 (Optimized) Determining Ratings -slide#12

Rating Examples Man.2 1.1 2.1 2.2 3.1 3.2 4.1 4.2 5.1 5.2 LEV, Proj1 F L L F L P N N N 2 Proj2 L P L P L P N N N 1 Proj3 P N P N P N N N N 0 Proj4 F F F F L P N N N 3 Proj5 F L F L L P N P N 2 F = Fully L = Largely P = Partially N = None Determining Ratings -slide#13

Rating Examples Accumulated Man.2(*)1.1 = [0%N, 20%P, 20%L, 60%F] Man.2(*)2.1 = [20%N, 40%P, 20%L, 20%F] Man.2(*)2.2 = [0%N, 20%P, 40%L, 40%F] Man.2(*)3.1 = [20%N, 20%P, 20%L, 40%F] Man.2(*)3.2 = [0%N, 20%P, 0%L, 80%F] Man.2(*)4.1 = [20%N, 80%P, 0%L, 0%F] Man.2(*)4.2 = [100%N, 0%P, 0%L, 0%F] Man.2(*)5.1 = [80%N, 20%P, 0%L, 0%F] Man.2(*)1.1 = [100%N, 0%P, 0%L, 0%F] F = Fully L = Largely P = Partially N = None Determining Ratings -slide#14

Distribution of Attribute Ratings Determining Ratings -slide#15

Example Process Attribute Ratings % Determining Ratings -slide#16

Process Profile Evidence of Process Capability (Capability Lev 2-5) is derived from Evidence of Process Performance (Capability Lev 1) Based on judgement of Based on judgement of Indicators of Process Capability Indicators of Process Performance consisting of consisting of Management Practices Input and output work products and their characteristics Base Practices Characteristics of practice performance Characteristics of resources & infrastructure Associated Processes used to assess Deriving a Process Profile Organization’s Processes Determining Ratings -slide#17

Rating Concepts and Scales