Process Maturity Profile: Cmmi For Development Scampi Class A Appraisal Results 2009 End-Year Update
Process Maturity Profile: Cmmi For Development Scampi Class A Appraisal Results 2009 End-Year Update
Carnegie
Software Mellon
Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Software Engineering Institute
March 2010
We could not produce this report
without the support of the organizations
and lead appraisers who reported their
appraisal results to the SEISM.
The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense and operated by Carnegie Mellon® University
® CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University
SM SCAMPI and SEI are service marks of Carnegie Mellon University
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 1
© 2010 by Carnegie Mellon University
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Outline
Introduction
Current Status
Community Trends
Organizational Trends
The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team
leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority”
of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be
fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and
services only.
Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on
appraisal methods and for a directory of authorized lead appraisers who can perform them, visit:
http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 2
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Introduction: Purpose
Characterize the adoption of CMMI® - DEV®
Describe results from Standard CMMI Appraisal Method
for Process Improvement (SCAMPISM) v1.1/v1.2 Class A
appraisals using Capability Maturity Model® Integration
(CMMI-SE/SW/IPPD/SS v1.1 or CMMI - DEV v1.2) *
Encourage continued reporting of results
* Organizations previously appraised against CMMI v1.0 and which have not reappraised against v1.1 or
v1.2 are not included in this report
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 3
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
1. Current Status
- Snapshot of the software community based on the most
recent appraisal, since 2002, of reporting organizations
2. Community Trends
- Global distribution of appraisals
- Growth in the number of appraisals performed
- Shifts in the maturity profile over time
3. Organizational Trends
- Analysis of Process Area (PA) satisfaction
- Time to move up in maturity based on change in maturity
level and time between appraisals
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 4
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Current Status
• 5,499 appraisals
• 4468 organizations
• 3,458 participating companies
• 826 reappraised organizations
• 30,227 projects
• 74.3% Non-USA organizations
Additional charts providing different views and break down of this information will be added to this briefing
as more appraisal data is reported to the SEI over time.
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 5
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
2800
2600
Number Of Organizations
53.9%
2400
2200
2000
1800
1600
1400 28.2%
1200
1000
800
600
0
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 6
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
2000
1800 63.0%
Number Of Organizations
1600
1400
1200
1000
800
25.2%
600
400
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 7
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Commercial/In-house 76.8%
Contractor for
18.7%
Military/Government
Number of Organizations
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 8
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
90%
% Of Organizations Within Category
60% 56.4%
48.9%
50%
43.1%
40%
31.2%
30% 26.8% 27.4%
23.4%
20%
9.4%
10% 8.1% 7.7%
5.4%
2.8% 3.6%
0.8% 1.4% 1.0% 1.0% 1.5%
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
Based on most recent appraisal of 4421 organizations reporting an organization category
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 9
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Organization Type
Based on Primary Standard Industrial Classification (SIC) Code
Other Manufacturing
Health Services Industries
1.3% 1.2%
Engineering & Management
Services Other Services
24.2% 10.7%
Based on 3766 organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 10
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Organization Size
Based on the total number of employees within the area of the organization that was appraised
1001 to 2000
2.6%
501 to 1000 2000+
5.2% 1.8%
25 or fewer
301 to 500 16.0%
6.4%
201 to 2000+
23.8%
1 to 100
201 to 300 58.2%
7.7%
101 to 200
18.0%
26 to 50
21.2%
76 to 100
8.3%
51 to 75
12.8%
Based on 4423 organizations reporting size data
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 11
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
100%
90%
% of Organizations by Size
80%
70%
61.6%
60.8%
60.3%
55.5%
54.6%
60%
52.4%
51.5%
50.4%
48.8%
46.7%
50%
40.0%
39.2%
40%
31.7%
28.2%
27.7%
26.2%
30%
22.8%
22.3%
21.3%
18.3%
16.5%
20%
12.0%
11.8%
10.5%
9.4%
8.7%
8.5%
8.2%
7.6%
6.4%
6.3%
6.3%
6.0%
5.7%
5.1%
5.0%
4.9%
4.9%
4.7%
10%
3.8%
3.5%
3.3%
3.2%
2.6%
2.0%
1.8%
1.7%
1.5%
1.1%
1.0%
0.9%
0.9%
0.8%
0.7%
0.7%
0.5%
0.1%
1.3%
0%
25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+
Not Given Initial Managed Defined Quantitatively Managed Optimizing
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 12
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
400
Commercial/In-
house 2996
617
Contractor for
Military/Government
211
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
% of Organizations
Based on 1143 USA organizations and 3278 Non-USA organizations reporting an organization category
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 13
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
90%
80%
70%
% of Organizations
60%
50%
474
40% 425
30%
20%
146
82
10%
15 8
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 14
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
90%
80%
70%
% of Organizations
1933
60%
50%
40%
30% 836
20%
267
10% 157
100
25
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 15
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 16
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
2800
2648
2600
2400
2200
Number of Appraisals
2000
1800 1727
1600
1400
1200
1000
800 709
600
400 313
200
63 39
0
Africa Asia Australia Europe North America South America
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 19
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
1400 1352
TOTAL
1285
1200
Number of Appraisals
POSTED ON PARs
1029 1001
1000
800
600
692
600
437
400 425
186
200 230
52
85
0
2002 2003 2004 2005 2006 2007 2008 2009
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 20
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
1400 1006
338
First Appraisal
1200
Number of Appraisals
834
Reappraisal
598
800 109 849
760
733
437
600
96
504
400 43
186 394
200 52
23
163
1
51
0
2002 2003 2004 2005 2006 2007 2008 2009
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 21
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
2009 4,468
60%
53.8%
48.2%
50%
41.5%
37.2%
40%
33.0%
32.9%
32.4%
32.0%
30.2%
30% 28.2%
18.3%
15.8%
20%
12.4%
9.8%
9.1%
9.1%
8.9%
7.8%
7.8%
6.8%
10%
4.5%
4.4%
3.4%
2.8%
2.4%
2.2%
1.5%
1.3%
1.1%
0.9%
0%
Not Given Initial Managed Defined Quantitatively Managed Optimizing
Based on a cumulative view of the most recent appraisals of organizations up through the year indicated
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 22
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 23
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Maturity Level of
First and Latest Appraisal
100%
90%
80%
First
70%
% of Organizations
Latest
56.5%
60%
50%
40% 39.3%
31.7%
30%
22.4%
20%
11.4%
10.0%
9.2%
6.7%
5.1%
10%
4.2%
3.3%
0.2%
0%
Not Given Initial Managed Defined Quantitatively Optimizing
Managed
Based on 827 reappraised organizations using their first and latest appraisal
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 24
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Time to Move Up
55 Largest observed
value that is not
an outlier
50
40
Number of
months
to move to
next maturity
level
30 75th Percentile
26.5
24 24
20.5 20
20 18 18 19 19
Median
25th Percentile
10
5 4.5 4.5 Smallest observed
value that is not an
outlier
0
Time Period of Initial 2002 to 2005 2006 to Present All (2002 to Present)
Appraisal
Level 1 to 2 2 to 3 3 to 4 3 to 5 1 to 2 2 to 3 3 to 4 3 to 5 1 to 2 2 to 3 3 to 4 3 to 5
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 25
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Summary
5499 appraisals have been reported to the SEI in 94 months
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 26
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Summary - 2
Note:
Since the March 2009 report, the median time to move from maturity level 1
to 2 increased from 4 months to 4.5 months. the median time to move from
maturity level 2 to 3 increased from 18.5 months to 19 months. The median
time to move from maturity level 3 to 4 increased from 19 months to 24
months , the median time to move from maturity level 4 to 5 is replaced by
the information of the the median time to move from maturity level 3 to 5.
Also, for all maturity level, the 25th percentile and the 75th percentile time
frame needed to move up to next level are increasing significantly
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 27
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Non-USA - Appraised entity whose geographic location is not within the United
States. The parent of the appraised entity may or may not be based
within the United States.
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 28
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Please visit:
http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 29
Carnegie Mellon
Software Engineering Institute CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results
Contact Information
Please visit:
http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm
Internet Address
[email protected]
Mailing Address
Customer Relations
Software Engineering Institute
Carnegie Mellon University
Pittsburgh, PA 15213-3890
© 2010 by Carnegie Mellon University March 2010 Process Maturity Profile - Page 30