SATURN 2010 Panel On Architecture Certification
SATURN 2010 Panel On Architecture Certification
Panel on
Architecture Certification
Software Engineering Institute
Carnegie Mellon University
Pittsburgh, PA 15213
Our panelists
Panel Format
b)
c)
d)
e)
f)
g)
Target candidate: To whom are you targeting the program? What are the
max/min qualifications?
Description of program: E.g., describe the courses; say how long completion
takes; are there levels or stages? Is it available only within your organization or
do you offer it to outsiders?
Intended results: Someone successfully completing the certification program
should be able to
Testing: Must a candidate pass an examination? If so, describe it.
Number of people completing the program to date: Obvious
Costs and benefits measured/ observed: To individuals, to your
organization, to the community
Overall / concluding observations: E.g., what would you change about the
program if you could?
How many of you work for an organization that has its own architect
certification program?
10
Did your organization sponsor you or did you pay for it yourself?
11
Part 1
Raytheon Certified Architect Program
Rolf Siegers, 20 May 2010
2010 Carnegie Mellon University
12
b. Description of Program:
Companywide initiative which formally identifies, instructs,
and assesses Raytheons top systems and enterprise architects
Spans all Raytheon Businesses and includes participants from U.S., U.K, and Australia
Program milestones: Raytheon Trained Architect, Raytheon Certified Architect
Participants are Raytheon employees; Customer participation also permitted
Recertification required every 3 years
c. Intended Results:
Establish a cadre of senior architects across Raytheon worldwide to develop
architectures that support customer mission success, facilitate interoperability
between highly complex systems, foster the expertise required for Raytheon to
excel as a Mission Systems Integrator, and mentor our next generation of architects
d. Testing:
Certification requires fulfillment of several dozen criteria in the areas of
13
g. Overall/Concluding Observations:
14
b. What does it include, how long does it take (work time, calendar
time)?
Includes about 25 of 100 line items of study, content varies depending on domain of
expertise. Takes 20+ hours for seasoned vet, takes > 100 hours for up and comer.
Calendar time of months or many months.
c. What are the intended results? Someone with SAC can do what?
Refresh seasoned veterans in the state of art
Train upcoming architects in practices and in the state of art.SAC holders are
referenced for SW arch jobs and arch analysis tasks
15
16
b)
17
e)
f)
g)
18
IASA CITA-P
a. Target candidate: Practicing IT architects
b. Description of program:
- The IASA CITA-P program is the 3rd level of certification for measuring
an architects career progression. The prerequisite is experience
successfully delivering value through IT.
- The CITA-P measures a candidates knowledge and experience using
the skills in the IT Architect Body of Knowledge (ITABoK) in order to
deliver business value through the use of IT with predictable and
repeatable success on IT projects.
- The ITABoK is based on qualitative and quantitative analysis of the
day-to-day skills that make todays worldwide community of top
architects successful in their practice.
19
IASA CITA-P
c. Intended results: Provide predictable and repeatable results in
delivering business value through the use of IT
d. Testing: Candidate submits a brief on experience and then stands for
an interview with four senior architects, CIOs, or CTOs. Prereq is exp
e. Successful candidates to date: 31 (program launched Dec 09)
f. Cost/benefit assessment:
- Individual gets validation of skills and growth roadmap
- Organization gets reliable measure of architectural skills
- Community get another member of the community and view on
current business challenges and best practices in architecture
g. Conclusions: Owned by the community of architects. As it needs to
change and grow, it will.
20
SEI
Software
Architecture
Professional
ATAM
Evaluator
ATAM
Leader
Mission
a. Ideal
Candidates
NA
NA
Minimum
Qualifications
b. Requirements
21
SEI
Software
Architecture
Professional
ATAM
Evaluator
ATAM
Leader
c. Expected
Outcome
Ability to
apply architecture-centric
practices throughout life cycle
produce and understand
documentation for software
architecture
Understanding of
quality attributes and their
relationship to architecture
relationship of architecture to
business goals
s/w product line approach
Ability to
evaluate a software
architecture
execute the steps of the ATAM
Ability to
lead the evaluation of a
software architecture using
the ATAM
d. Testing (exam
begun in 2008)
SAPP exam:
e. Awardees
1140
521
f. Benefits
Community level: focus on quality attributes and connecting business goals to architectural decisions
corporate-level architecture initiatives and programs; SATURN
Organization level: improved architecture practices and improved architectures; 10 of 11 US Army
programs recognized significant or very substantial improvements from the use of the ATAM (Impact
of Army Architecture Evaluations, CMU/SEI-2009-SR-007).
Individual level: improved understanding of architecture concepts; greater confidence in using
effective architecture-centric practices; enhanced technical credentials
75% score
22
How well would the programs that you just heard about work in your
organization? Would people sign up? Would the organization lend its support?
Why or why not?
23
24
25
How can certification address the broad range of application areas? Can an
architect of a web-based non-mission critical application, an architect of a
business-critical financial application, an architect of a highly-complex, life-critical
embedded application be equally certified?
26
27
28
Part 2
Raytheon Certified Architect Program
Rolf Siegers, 20 May 2010
2010 Carnegie Mellon University
29
30
31
32
33
34
35
36
37
38
IASA CITA-P
Before
After
http://blogs.ajc.com/jeff-schultz-blog/files/2009/02
http://web.gcpower.net/wp-content/
39
40
41
Foundations
Methods
Practices
Quality
attributes,
Books
Course
Software
s
Architecture:
Principles and
Practices (SAPP)
Documenting
Software
Architectures
(DSA)
Software
Architecture
Design and
Analysis (SADA)
ATAM, ADD,
QAW, AADL,
Software Product
Lines (SPL)
Views and
Beyond, ARID,
ATAM Evaluator
CBAM, software
product lines
Certificate
Programs
and
Certification
Software
Architecture
Professional
ATAM Evaluator
ATAM Leader
ATAM Leader
42
Bosch
Boeing
Raytheon
Architecture
Initiative
Architecture
Books
ATAM
1998
ATAM,
Training QAW
(SLEP, SEI Pilots
Courses)
Chief
Systems
Engineer
Mandate
SATURN
Courses,
Conference
Certificate Programs,
Certifications
Software
Army Architect
Impact Mandate
Study
MTW,
System and
Software ATAM,
SoS Architecture
Evaluation
Defense
Contractor
s
U.S. Army
SEI
QAW
2010
Raytheon Certified Architect Program
Rolf Siegers, 20 May 2010
2010 Carnegie Mellon University
43
44
SEI: Observations
Solution
Solution
Process is onerous
Solution
45