Course Slides
Course Slides
KEY PERFORMANCE
INDICATORS PROFESSIONAL
Towards the use of a rigorous KPI Measurement Framework
13th – 15th of October 2015 | Khartoum | Republic of Sudan
Ahmed Samy
The KPI Institute
www.integratingperformance.com [email protected]
Certified Benchmarking
Certified KPI Professional
Professional
After-course stage
Core-course stage
Certification Exam
Participation at on-site
training
Forum introduction Additional reading
1 week before core-course Within 3 weeks after the core-course
The certification process is finalized only when you complete all of the 3 stages of the learning experience. You will receive:
• Certificate of Completion: after completing pre-course activities and passing the Certification Exam;
• Certificate of Attendance: after participating at the 3 days of on-site training course;
• Certified KPI Professional diploma: after you have successfully completed all of the 3 stages of the learning experience.
Data Visualization
Review &
KPI Taxonomy Certification
KPI Selection Exam
© The KPI Institute 2015 14
LEGEND
Key learning points Case study Session review
40.00%
30.00%
0.00%
Selecting the right Gathering data for Documenting KPIs Root cause analysis Decision making
KPIs KPIs clearly and based on KPI
concisely results
Clarity Focus
Communication
70%
59%
60%
50%
41% 41% 41%
40% 35%
29%
30% 24%
20% 18% 18%
12% 12%
10% 6% 6% 6%
0%
60%
53%
50%
40% 35%
29%
30% 24%
20%
12% 12% 12% 12%
10%
0%
Reports
Rewards
Scorecards
Targets
Technology
Training
Individual performance
System Map
plans
Desired State of
Evolution Performance
evaluations
Strategy Map
Performance
conversations
Performance Scorecard
Organisational KPI
Catalogue Personal Level
Portfolio of Initiatives
Personal performance
Dashboard plans
Performance review
meetings Performance reviews
Source: http://commons.wikimedia.org/wiki/File:Fleischwolf-zerlegt.jpg
Photo taken by: Kku, Modified by: Rainer Zenz
ORGANIZATIONAL STRATEGY
INTEGRATED PERFORMANCE
OUTCOMES
MANAGEMENT SYSTEM
OUTCOMES
• Overall
organizational Departmental
objectives
Team
40%
29% 29%
30%
0%
Top • Promote
Management • Support
• Design
• Implement
Strategy / • Assume
• Maintain
Performance Office ownership of
targets
• Collect data
• Report data
Images:
• The KPI Institute (2014), Human Resources Performance Management Toolkit. Available at:
http://store.kpiinstitute.org/hr-performance-management-system-toolkit.html
Metrics
Measurement
KPIs KRIs
Performance Risk
Assessment Assessment
Analytics
Decision Making
# Air humidity
# Air purity
# Employees
# Highway kilometres
# Employee age
$ Budget
% Budget variance
$ Revenues
$ Operating costs
KPI Definition:
A measurable expression for the achievement of a desired level of results in an area relevant
to the evaluated entity’s activity.
(The KPI Institute)
© The KPI Institute 2015 The World Understand
Understand KPI KPI Working with Data Data Course 53
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs
KPIs Selection Documentation Targets Gathering Visualization Review
SMART OBJECTIVES DECOMPOSED
Option 1: Increase market share to 28% by the end of the financial year
under Marketing Director coordination.
Option 2:
$ = Value of
% = Percentage of
# Complaints received
% Customer satisfaction
Corporate Goal 2 – To establish a new pricing structure up to September 30, 2009 depending on the phases
established in the work plan.
Corporate Goal 3 – To provide a preliminary report of the Technical Cooperation Project up to September
30, 2009.
Corporate Goal 4 – To implement planned activities for the Third Set of Locks Project up to September 30,
2009, in compliance with the milestones of the established schedule.
Corporate Goal 5 – To make optimal use of the existing plant to meet transit demands, ensuring a service
level compliance average ≥ 85 percent.”
“Corporate Goal 6 - To adapt the organization through the improvement of the processes identified up to
September 30, 2009.
Corporate Goal 8 – To develop the Monitoring and Evaluation Plan for Sustainable Development and
Integrated Management of Water Resources for the Panama Canal Watershed up to September 30, 2009.
Corporate Goal 9 – To prepare a talent management plan and to provide a generational shift and to meet
emerging needs in the operation up to September 30, 2009.
Corporate Goal 10 – To improve the working environment ≥ 5.0 percent, measured by a satisfaction,
commitment and work climate survey up to September 30, 2009.
Corporate Goal 11 – To ensure that the Corporate Performance Index (CDI) is ≥ 100, up to September 30,
2009.”
Objective 4 - To efficiently manage the volume and quality of the water resources of the
Panama Canal Watershed.
• Needs identification
• Selection
• Documentation
• Visualization
• Analysis • Analysis
Images:
• Google (2015), Google Analytics. Available at: http://www.google.com/analytics/
• Spider Strategies (2015), QuickScore. Available at: http://www.integerperform.com/kpi-
dashboard-balanced-scorecard-software/
3 KPI Typology
1. Leading vs lagging KPIs
2. Qualitative vs quantitative KPIs
3. Efficiency vs effectiveness KPIs
NCOS implementation
NCAT implementation
• % Applications processed in
SLA
• % Applications processes
correctly first time
• # Average delay in processing
applications
Source: Australian Federal Government (2011)
All KPIs are quantitative, but they can measure different aspects of an
objective, such as:
1. % Employee turnover
2. # Production cycle time
3. # Brand image index
4. # Customer satisfaction score
5. % Projects delivered on time and on budget
6. % Error rates
7. % Employee engagement
8. $ Operating costs
9. % Market share
10. # Service quality rating
Effectiveness
Desired
Inputs Processes Outputs Outcomes
output/outcome
Efficiency
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 76
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
KPI USE CASE SCENARIOS
1 Organizational strategy
7 Project management
12 Fitness training
Personal Performance
13 Personal performance management
17 Audit
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 77
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
1. ORGANIZATIONAL STRATEGY
Context: Scorecards to monitor the achievement of strategy, through KPIs.
Positive aspects: KPIs are monitored in 5 perspectives: Financial, Customer, Operations and
People. Traffic lights are used to enable immediate understanding of performance data.
Recommendations: Link KPIs to more specific strategic objectives, not only to goals.
Comments: The scorecard contain some of the most important fields to track performance.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 78
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
2. ORGANIZATIONAL OPERATIONS STRATEGY
Context: Dashboards to provide a more detailed overview of corporate performance.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 79
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
3. DEPARTMENTAL STRATEGY
Context: Scorecards to monitor strategy at operational level.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 80
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
4. DEPARTMENTAL OPERATIONS TRACKING
Context: Dashboards to offer visibility into key processes.
Recommendations:
Cluster KPIs around key
processes or activities.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 81
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
5. ALLIANCES / JOINT VENTURES RELATIONSHIP
SCORECARD
Context: Scorecards to monitor performance of alliances or other business
partnerships.
Positive aspects: KPIs are linked to clear objectives established for the alliance.
Recommendations: Standardize KPI names and allocate a section to comment KPI results.
Comments: Key value drivers for the alliance were identified, such as relationship value or
strength that cluster the scorecard objectives and help managers focus on what matters the
most.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 82
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
6. PORTFOLIO AND PROJECT MANAGEMENT
Context: KPIs to monitor the performances in
terms of managing more projects.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 83
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
7. PROJECT MANAGEMENT
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 84
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
8. QUALITY / PROCESS MANAGEMENT
Context: KPIs to measure quality and compliance with standards, as well as to
support process optimization.
Recommendations:
Establish KPIs to assess
the quality of processes.
Source: Adapted from Oak Ride Institute for Science and Education (2005)
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 85
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
8. QUALITY / PROCESS MANAGEMENT
Process improvement
Capacity
Space Productivity
Waste! Profit
Quality
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 86
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
9. SERVICE LEVEL AGREEMENT (SLA)
Context: KPIs to ensure the quality of services delivered – whether is about third
party providers (suppliers) or internal providers (departments, divisions).
Recommendations:
Standardize KPI names for more
clarity.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 87
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
10. SUPPLIER PERFORMANCE MANAGEMENT
Context: KPIs to monitor performance of supplier, for a streamlined supply chain.
a) 3 Perspectives b) 8 Categories c) 24 Indicators
Compliance with client requirements
Outcomes Quality and severity of defects
The objectives of the engagement were achieved
Outcome performance Timely delivery schedule
Schedule Ability to meet interim milestones
Ability to complete work within agreed upon budget
Ability to control costs / Cost improvements over time
Budget
Value for money / Competitiveness of pricing
Provides effective and timely communication
Service and product delivery problems were quickly resolved
Communication
Documentation requirements / Understanding of business requirements
Innovative in helping delivering solutions
Delivery performance
Value add/Innovation Understanding of the client’s business processes and practices
Understanding of the industry and market and how it applies to VG
Technical skills and experience
Delivery capability Personnel quality (i.e. independence and thoroughness)
Overall project management
Reasonable negotiations and contract, ease of doing business
Effective, accurate and efficient billing system
Responsiveness /
Account Management Flexible, accessible and responsive to inquiries
Service excellence
Overall satisfaction with vendor deliverables and services
Professional and cooperative behaviour with the client personnel
Client satisfaction Work ethic, flexibility and responsiveness
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 88
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
11. EMPLOYEE PERFORMANCE MANAGEMENT
Context: KPIs and scorecards to evaluate performance of each employee in the
organization.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 89
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
12. FITNESS TRAINING
Context: KPIs to track performance of athletes.
Comments: A clear
perspective on current fitness
performance contributes to
better planning workouts.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 90
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
13. PERSONAL MANAGEMENT
Context: KPIs to monitor personal achievements, to track daily activities, to
improve time management.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 91
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
14. SUSTAINABILITY PERFORMANCE REPORTING
Context: KPIs to assess the environmental impact of
activities. Results are presented in sustainability scorecards
or in dedicated performance reports.
Comments:
Transparency in KPI
results can positively
contribute to brand
image.
© The KPI Institute 2015 The World Understand KPI KPI KPI
KP Taxonomy Working with Data Data Course 92
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
15. BENEFITS REALIZATION MANAGEMENT
Context: Benefits realization is an important part of project management and
should rely on KPIs that clearly outline expected benefits.
Positive aspects:
KPIs are accompanied by
target values.
Recommendations: KPI
names should be
standardized.
Comments: benefits
realization management
through KPIs provides the
necessary visibility in
assessing investment
projects.
Source: Western Australia Department of Treasury and Finance (2005)
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 93
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
16. GENERAL OPERATIONAL REPORTING
Context: KPIs are commonly used by departments or teams to report the
performance of their activities.
Positive aspects: KPI results are accompanied by comments to facilitate
understanding of current performance level.
Recommendations:
Structure the KPIs under
sustainability objectives
and outline specific
targets that are desired.
Comments:
Operational reporting
must be focused on
providing essential data
for decision making.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 94
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
17. AUDIT
Context: KPIs can be used to assess the quality of the audit department, but also to
analyze how an organization is coordinated.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 95
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
18. COMPLIANCE REPORTING
Context: KPIs are commonly used to report
compliance with regulations.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 96
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
KPI DNA MAP
Scenario:
• You are part of the management team of a manufacturing
company. Based on the context provided you have to
recreate the KPI taxonomy of two division in the
organization: production and customer service.
Task:
• Read carefully the report provided and identify examples
of KPIs that you can use to populate the taxonomy given.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 97
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
KPI DNA MAP
PRODUCTION
Costs Timeliness
Expenses Planning Duration Schedule adherence
Quality Quantity
Scrap Meeting standards Volume Productivity
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 98
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
KPI DNA MAP
CUSTOMER SERVICE
Costs Timeliness
Expenses Planning Duration Schedule adherence
Quality Quantity
Meeting standards Satisfaction Volume Productivity
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 99
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
KPI DNA MAP
The KPI taxonomy can be consolidated into a matrix, integrating
also the concepts of efficiency and effectiveness.
Efficiency Effectiveness
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 100
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
SESSION REVIEW
1. 18 different scenarios / contexts to use KPIs
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 101
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
REVIEW DAY 1 – CROSSWORD
Scenario
• You are split in teams, with the objective of finding out the
crosswords from the next slide.
Tasks
• Identify the 15 words hidden behind letters from the next
slide;
• All words connect to the previous day key concepts.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 102
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
REVIEW DAY 1 – CROSSWORD
A S L E A D I N G E N T G G V D E R A C K B E K K G
Q T I L O S Z Q L I M N D E C Q B C Q P P M K Q E D
A F O B J E C T I V E L I A Q D M H R O I L R D Y C
Z U I A D G A M I E F F E C T I V E N E S S Q C R Y
A B O N A S O A R S F N B B M D F N Q A S C V B I S
Q E Y P V B N M L Q I H C G I L A A A L L H U J S C
W B H O A A S S G T C Y S T N O L E Z C A X S C K D
X E N I C D V B M D I P E R F O R M A N C E U I I F
C R M K O C V B K A E U V E X S W E D X R T Y U N L
D V J M D A N M I O N I I E V R Y T E O E G H J D O
Q E R T Y U I O P C C Y N R E W Q R A S W V E R I U
D A S H B O A R D R Y N N R T C Y I Z X I V B N C T
A S C V B N M J H K D D I X A A A C G H E K L O A R
I U Y T R E W Q S D F G T J L F L F J H W F D S T E
A S C O R E C A R D O I I P O C E T S R T D N G O W
C M N B V C U P O L I U A T R A Q Y E L H G F S R Q
Q W E R T Y U I O P L K T H T I M E L I N E S S D D
G F L A G G I N G W Y U I O P E L T J H G F D S A F
A S D F G L H Q A Z X E V W C R V B N H G F D E W G
V B N M P L O I U Y T R E W Q U A L I T A T I V E H
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 103
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
REFERENCES
• Apple (2011), Environmental responsibility. Available at: http://www.apple.com/environment/
• Australian National Audit Office (2011), Development and implementation of Key Performance
Indicators to support the outcomes and programs framework. Available at:
http://www.anao.gov.au/~/media/Uploads/Audit%20Reports/2011%2012/201112%20Audit%20Report%20
No%205.pdf
• Body Media Fit (2015), Activity Manager. Available at: http://www.bodymedia.com/?whence=
• Clebsch, B., Dougherty, J. D., and Anderson, G. (2004), Management by fact: Benchmarking university
IT services. Available at: http://www.educause.edu/ero/article/management-fact-benchmarking-
university-it-services
• Felton, N. (2013), Annual report. Available at http://feltron.com/FAR13_11.html
• Godrejinfotech.com (2010), Products. Available at:
http://www.godrejinfotech.com/godrej/godrejinfotech/offerings/products/sap/pro_sap_busiObj.html
• KPI Institute (2014), Human Resources Performance Management Toolkit. Available at:
http://store.kpiinstitute.org/medical-practice-performance-management-system-toolkit.html
• KPI Institute (2015), Individual Performance Management Toolkit. Available at:
http://store.kpiinstitute.org/individual-performance-management-toolkit.html
• Oak Ride Institute for Science and Education (2005), Performance measurement process. Available at:
http://www.orau.gov/pbm/handbook/1-1.pdf
• Texas State University (n.d.), Global service level objectives. Available at:
http://www.tr.txstate.edu/ser-cat/sc-object.html
• Western Australia Department of Treasury and Finance (2005), 2004-05 Procurement Reform benefits
realisation report
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 104
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Taxonomy Selection Documentation Targets Gathering Visualization Review
AGENDA
5 KPI Selection
1. KPI selection for organizational scorecard
2. KPI selection sources
3. KPI selection techniques
KPI documentation
Follow up on KPI selection First performance review
33 meeting
Objectives Scorecard
3
Processes Dashboard
WHY
Channels the selection process on a clear path with
specified scope and outputs expected.
Workshop Industry
KPI standards
2
Sources
3
Board Benchmarking
Management Competitors
Historical External
data Compliance lists
Workshop
1
• Competitor review reports
• Strategic development plan
• Printed catalogues
(3-5 years)
SECONDARY
2 • Online catalogues
• Annual business / strategic
(http://www.smartkpis.com/)
plan
3 • Annual reports of other
• Annual reports
organizations (KPIs in
• Internal operational reports
Practice)
• Suppliers input
• Front-line employees input
PRIMARY
• Customers input
• Managers input
• Expert advice
• Board input
• Questions in discussion forums
INTERNAL EXTERNAL
WHY
3
HOW
• Consolidating lists from external sources, like smartKPIs.com.
• Using internal sources to identify KPIs, like operational
reports.
© The KPI Institute 2015 The World Understand KPI
KPI KPI Working with Data Data Course 111
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection
Selection Documentation Targets Gathering Visualization Review
KPI CLUSTERING
WHAT
1
Grouping KPIs in different categories:
2 • Balanced Scorecard perspectives;
• Objectives;
3 • Dashboard sections;
• Value Flow Analysis stages;
• Process steps.
WHY
• Enables alignment and identification of possible gaps.
Task:
• Write down 5 KPIs you would
recommend.
• Use one single post-it note for
each KPI (5 post-it notes per
team).
2
Examples:
• What numbers will demonstrate the objectives
3 achievement?
• What matters?
• So what?
© The KPI Institute 2015 The World Understand KPI
KPI KPI Working with Data Data Course 114
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection
Selection Documentation Targets Gathering Visualization Review
RELEVANT QUESTIONS FRAMING
During the KPI selection Questions to prepare in
FAQs
workshop case they are asked
1
What will we do with KPI
What are the most relevant How many KPIs should we
results?
sources for KPI selection? select?
2
What is the order of
What efforts are required for
importance in which the KPI What is the procedure for
data gathering for each KPI?
3 selection sources should be validating the KPIs selected?
analyzed?
What process are we going
4 Who should participate in What will we learn from the
through and how long will it
the KPI selection process? data?
take?
What figures will reflect the
What is the ideal format for How do we link KPI results
achievement of company
KPI selection process? with bonuses?
objectives?
What sort of data we need to
What are the most relevant
keep track of to ensure
criteria for the KPI selection?
informed decision making?
What are we trying to What matters?
achieve by setting up KPIs?
3 WHY?
• Gain insight into how the objective can be measured
from different perspectives.
• Examples:
Human Resources: # Employees, # Consultants, # Project team
Financial Resources: $ Budget, # Grants, $ Bank loans
Infrastructure: # Production lines available, # Plants available
Source: Adapted from Performance monitoring indicators handbook - World Bank Technical Paper, No 334
• Examples:
Time: % On time delivery vaccination, # Time to finalize task
Utilization: % Equipment utilization rate, % Transportation
capacity used
Source: Adapted from Performance monitoring indicators handbook - World Bank Technical Paper, No 334
• Examples:
# Patients vaccinated
# Items produced
# Scrap generated
# Facilities built
Source: Adapted from Performance monitoring indicators handbook - World Bank Technical Paper, No 334
• Examples:
Impact: % Incidence of disease, % Mortality rate, % Graduates
employment rate
Added value: $ Savings generated by innovation ideas,
# Customer satisfaction index, % Net promoter score
Source: Adapted from Performance monitoring indicators handbook - World Bank Technical Paper, No 334
WHY?
3
• To avoid focusing on certain KPIs at the expense of
others.
• To provide a wider perspective upon actual
performance.
1 # Incidents of non-
# Fatal accidents Oil & Gas
compliance
% Employees with competencies at
2 # Training hours per FTE Consulting
desired level
Efficiency Effectiveness Industry
3 $ New customers acquisition
# New customers Retail
cost
# Call duration % First call resolution rate Call Centre
3
First performance review
meeting
• Review and reconsider
some KPIs that may prove
inefficient to measure and
report in practice.
• Incentivized
• Practical Clearly
• Reliable defined
• Specific
• Tested
Balanced
• Time bound
• Useful for management
6 KPI Alignment
1. KPI alignment approaches
2. Select KPIs for corporate scorecard
3. Cascaded KPIs to functional area
WHEN
• strategy is more clear at business unit
Organization level (for example diversified
companies, holding corporations);
Bottom-up
• In practice, many companies find
themselves between the two
extreme approaches and recur to a
combination of tactics.
Top-down
• The process can start from business units and have an alignment:
bottom-up for corporate scorecard;
top-down for departments within that business unit.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 137
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
KPI CASCADING
Business Unit Department A Team A1
O2: O2:
Team A2
KPI2a Specific KPIs KPI2Aa
KPI2b KPI2Ab
O1:
KPI1b
1 KPIs cascaded
1 specific KPI KPIA1b
Supports the
O3: achievement of O3 OA3:
KPI3a KPI3Aa
KPI3b KPI3Ab
OA2:
KPIA2a Team specific
Specific objective objective
KPIA2b
Specific KPIs Specific KPIs
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 138
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
KPI CASCADING
1. Business unit objectives can be cascaded at departmental level as
they are, with the same or different KPIs:
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 139
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
SELECT KPIS FOR CORPORATE SCORECARD
• Scenario:
As the new management team of a hotel you have reviewed the strategy
and reflected it in the organizational balanced scorecard. Given the
significant changes adopted in terms of objectives, a new KPI selection
process is necessary.
• Task:
Based on the list of KPIs specific for the hospitality industry you are
required to choose the most relevant KPIs for the organizational scorecard.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 140
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
SELECT KPIS FOR CORPORATE SCORECARD
Financial
Achieve profit growth
Customer
Maintain high levels of customer satisfaction
Internal processes
Maximize capacity utilization
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 141
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
SELECT KPIS FOR CORPORATE SCORECARD
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 142
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
CASCADE KPIS TO FUNCTIONAL AREA
Scenario:
• You are part of a hotel’s Human Resources team. Given the strategy
review that took place at organizational level, you will have to align the
departmental strategy to the new changes.
Task 1:
• Cascade the objectives and KPIs from the Hotel balanced scorecard
to Human Resources department.
Task 2:
• Add new relevant objectives and KPIs for the department, based on the
lists with examples provided.
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 143
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
CASCADE KPIS TO FUNCTIONAL AREA
Customer
Internal Processes
Financial
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 144
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
CASCADE KPIS TO FUNCTIONAL AREA
• Examples of objectives
No. List
O1 Ensure high service delivery standards
O2 Ensure timely order deliveries
O3 Expand customer base
O4 Improve HR service delivery capability
O5 Increase revenues
O6 Maintain high levels of internal customer satisfaction
O7 Optimize recruitment
O8 Optimize call response time
O9 Provide good value for money to the organization
O10 Seek efficiencies to minimize departmental costs
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 145
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
CASCADE KPIS TO FUNCTIONAL AREA
• Examples of KPIs for Human Resources
1 # Certifications per HR employee % HR projects on time, on budget
11
2 # Complaints with HR services and according to specifications
3 $ Cost avoidance savings 12 % HR operating expense rate
4 $ Cost per hire # Innovation ideas received from HR
13
# Employee complaints resolution employees
5
timeliness % On-time delivery of HR service
14
6 # Employee engagement index requests
7 % Employee retention rate 15 # Open requisitions
8 # FTEs per HR department FTE 16 # Time to fill a vacant position
% HR customer satisfaction with # Training hours per HR full time
9 17
service levels equivalent (FTE)
10 % HR processes optimized 18 % Turnover
19 % Succession plans in place
20 % Voluntary separation rate
© The KPI Institute 2015 The World Understand KPI KPI KPI Working with Data Data Course 146
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Alignment Documentation Targets Gathering Visualization Review
AGENDA
Activation prerequisite
Automation enabler
Knowledge management
WHY
• Simplify communication
• Alignment
• “Setting the rules”
HOW
• Standardized KPI documentation form
Comments:
• The use of predefined checklist, to
standardize response options;
25 21 19
20 18
15 13 12 11
10 8 7 7 6
5
0
Name Definition Calculation Data source KPI ID Purpose Targets/ Subordinate Limitations Standard
formula record Thresholds measures reporting
used for frequency
calculation
Images:
• HSE (2012), KPI guidelines. Available at:
http://www.hse.ie/eng/services/Publications/corporate/performancereports/kpiguidelines2012.pdf
• Khaled, A., Sanjoy, K. P., Ripon, K. and Salahuddin A. (2011), Selection of suppliers through different
multi-criteria decision making techniques. Available at:
journalofbusiness.org/index.php/GJMBR/article/download/479/426
• KPI Institute (2014), Human Resources Performance Management Toolkit. Available at:
http://store.kpiinstitute.org/medical-practice-performance-management-system-toolkit.html
• Ontario Buys (2009), Performance measurement. Phase II - User guide. Available at:
http://www.doingbusiness.mgs.gov.on.ca/mbs/psb/psb.nsf/Attachments/BPSPerformMeasurePhaseII-
UserGuide-pdf-eng/$FILE/perf_meas_userguide-eng.pdf
• SmartKPIs.com (2015), Net promoter score. Available at: http://www.smartkpis.com/kpi-key-
performance-indicator/net-promoter-score-1303.html
• Impact behavior
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 161
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
TARGET SETTING PROCESS
Consultations in target
setting should start with
the top management. As KPIs are active and data
is gathered, targets may be
reviewed and recalibrated Targets need to be
adjusted periodically as
the internal and external
environment of the
company is in a
permanent change.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 162
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
TARGET SETTING SOURCES
Contextual External analysis
Analysis (market trends)
External
Benchmarking
Internal
Benchmarking
Historical
records
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 163
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
TARGET SETTING APPROACHES
Top-down
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 164
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
TARGET SETTING APPROACHES
Bottom-up
# Turn time
15 min
• Some activities can take place in the same time like cabin grooming and cargo
loading or unloading, allowing the process to be more efficient
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 165
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
TARGET SETTING APPROACHES
Establishing thresholds
Set target
value
• Increasing
Determine • Decreasing
trend • Within range
• Above target
Establish • In tolerance range
thresholds • Below target
Define each
threshold
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 166
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
KPIS TREND
Increasing
Within range
Decreasing
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 167
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
KPI THRESHOLDS
Popular methodologies to express thresholds
Traffic light:
• 2 points scale • 4 points scale
Meets or exceeds target Above target
Below target
Meets target
Acceptable range
• 3 points scale
Far below target
Meets or exceeds target
Acceptable range
Far below target
© The KPI Institute 2015 The World Understand KPI KPI Working
Workingwith
with Data Data Course 168
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering Visualization Review
Targets
KPI THRESHOLDS
Perspective / Strategic Objectives / KPIs SRF Actual result Target Thresholds Status
Financial
Ensure financial stability
>10,000
$ Revenue M 10,500 10,000 9,000-10,000
<9,000
Customers
Maintain high level of customer satisfaction
>80%
% Customer satisfaction Q 65% 80% 70-80%
<70%
Internal Processes
Ensure efficient production
<30
# Production cycle time M 20 30 30-35
>35
People, Learning and Growth
Develop staff competencies
24-28
# Training hours per employee Y 30 24 20-24; 28-32
<20; >32
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 169
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
ESTABLISH TARGETS
Scenario 1:
• You are the Marketing Manager of a company that sells bicycles on the
national and international market. The company is an average player in
the industry in terms of turnover and company size.
• After the annual strategic planning session, the Board has decided that
the target of 5 % for % National market share should be revised.
Task:
• Based on the 4 sources of information provided you are requested to
propose a new target for % National market share.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 170
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
ESTABLISH TARGETS
Historical data
% National market share performance results
2010 2011 2012 2013 2014
Q1 5.5% 7% 7.3% 6% 6%
Q2 5.6% 7% 7.2% 6.1% 6.5%
Current target: 5%
Q3 5% 6% 7% 5.7% 6.8%
Q4 5% 4.5% 7% 5.7% 5.5%
Average 5.3% 6.1% 7.1% 5.9% 6.2%
Total average 6.1%
Internal benchmarking
The international Marketing division that operates on a similar market size
registered the following results for % International market share:
2014
Q1 7.5%
Q2 8%
Q3 9%
Current target: 8%
Q4 9%
Average 8.4%
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 171
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
ESTABLISH TARGETS
External benchmarking
% Market share at national level % Market share at international level
Market leader 20% Market leader 30.0%
2nd 18% 2nd 25%
3rd 17% 3rd 24%
Average players 8% Average players 10%
Market analysis
• The governmental initiative to build bicycle tracks in all major cities is progressing
according to schedule and the budget for 2015 has increased compared to 2014.
• In the last years, this sport has become more and more popular not only among young
people, but also among adults. It is estimated that in the following 3 years each family
will posses at least 2 bicycles and they will not be used exclusively for leisure, but also
as means of transportation.
• This will definitely reflect in a more fluent traffic and a lower environmental foot
print.
• You are responsible for managing the inbound Call Center Division A and
in the last quarters, performance results indicate that the current target
of 10% for % Call abandon rate should be reconsidered.
Task:
• Based on the 2 sources of information provided, you are requested to
propose a new target for % Call abandon rate.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 173
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
ESTABLISH TARGETS
Historical data
% Call abandon rate
2010 2011 2012 2013 2014
Q1 10% 11% 12.3% 13% 10%
Q2 9% 12% 13.2% 12% 8%
Current target: 10%
Q3 9.5% 11.5% 12% 10% 8%
Q4 10% 11.9% 11% 11% 7%
Average 9.6% 11.6% 12.1% 11.5% 8.3%
Total average 10.6%
External benchmarking
Inbound Call Center 1 2%
Inbound Call Center 2 3%
Inbound Call Center 3 5%
Outbound Call Center 1 3%
Outbound Call Center 2 5%
Outbound Call Center 3 7%
Average inbound 3.3%
Average outbound 5.0%
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 174
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
ESTABLISH TARGETS
Scenario 3:
• You are the Marketing Manager of a distribution company that provides
delivery services nationally and internationally.
• Following the strategic planning for 2015, you are requested to activate
the objective under your ownership: Increase customer advocacy. The KPI
used to measure this objective is % Net promoter score (NPS).
• This KPI needs to be activated until the next month and all the KPI
documentation is prepared except one field: the target.
Task:
• There is no historical data for this KPI and no reliable benchmarking data.
Under these circumstances you are requested to propose a target for %
NPS.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 175
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
CHALLENGES IN WORKING WITH TARGETS
Technical Social
• Historical data does not • Targets are perceived
exist; either too high or too low;
• Assigning weights.
© The KPI Institute 2015 The World Understand KPI KPI Working
Workingwith
with Data Data Course 176
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering Visualization Review
Targets
WEIGHTS AND INDEXES
Weights Indexes
• Emphasizing the importance of • A set of items that aggregate
reaching targets, by distributing multiple, but distinctly related
100 points amongst all KPIs in the aspects under a single indicator;
scorecard / dashboard.
• They are an accumulation of
scores from a variety of individual
Weight X Actual Result items.
=
Score
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 177
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
WEIGHTS
PROs CONs
• Keep focus on what • Establishing weights can be
matters by correlating subjective;
importance with weight
value; • Aggregating KPI results into
a performance score/index
• Enable an overall brings no value for the
performance score; decision making process;
Comments: Assigning
weights can be subjective
– try to reduce this to the
minimum.
© The KPI Institute 2015 The World Understand KPI KPI Working
Workingwith
with Data Data Course 179
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering Visualization Review
KPI Documentation Targets
WEIGHTS – EMPLOYEE ASSESSMENT
Positive aspects:
Weights are assigned
for special projects,
outlining on what
should the employee
focus with priority.
Recommendations:
Include KPIs to
measure the
fulfillment of key
accountabilities.
Comments: Ensure a
proper aggregation of
weights with scores.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 180
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
WEIGHTS – EMPLOYEE ASSESSMENT
Positive aspects: Weights
are assigned to objective
measures of performance
such as KPIs.
Recommendations:
If used, weights should
cover all elements of
assessing employee
performance.
© The KPI Institute 2015 The World Understand KPI KPI Working
Workingwith
with Data Data Course 181
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering Visualization Review
Targets
WEIGHTS – SUPPLIER ASSESSMENT
Context: Weight are also used in supplier assessment to outline the
importance of reaching certain targets of the service level agreement.
Positive aspects:
Weights are included
in the supplier
evaluation sheet /
scorecard.
Recommendations:
Ensure the weights
assigning system
contributes to
improving the quality
of the service.
© The KPI Institute 2015 The World Understand KPI KPI Working
Workingwith
with Data Data Course 182
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering Visualization Review
Targets
INDEXES - # EMPLOYEE ENGAGEMENT INDEX
The Global Employee Engagement Index
• Applied in 47 different countries;
• More than 100 questions survey.
6.7 6.1
5.8
6.7
6.9
6.0
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 183
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
INDEXES - # LEADERSHIP CONFIDENCE INDEX
The National Leadership Index
• 1,000 Americans
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 184
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
CHALLENGES IN WORKING WITH TARGETS
Which negative behaviors are associated with performance
based pay? Allocate the correct number in front of each
statement.
Match Description No. Behavior
Establishing lower targets than the realistic
1 Gaming
level estimated as possible.
Looking after the achievement of own
targets, without consideration of the
2 Sandbagging
implications for other areas in the
organization.
Disregarding environmental and safety
considerations in the process of meeting 3 Tunnel behavior
targets.
Influencing results through unapproved means Unethical
4
to ensure target achievement. behavior
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 185
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
SESSION REVIEW
1. Checklist for working with targets:
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 186
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
REVIEW DAY 2 – RELAY RACE FOR CROSSWORDS
Scenario
• You are split in teams, with the objective of recalling as many
key concepts as possible, connected to today’s sessions, starting
from the central theme of the crossword game.
Tasks
• The rally race lasts for 3 minutes and team members take turns
to run to the board and write down a key term starting from the
letters provided by the central theme;
• Words can be written as well based on the letters provided by
other team members, both vertically and horizontally.
• The team who generates as many relevant concepts in the
limited timeframe wins the game.
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 187
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
REVIEW DAY 2 – RELAY RACE FOR CROSSWORDS
Example
• Consider the following example to understand how key
concepts can be build around the central theme (SUMMER)
and around other team members ideas.
S U N
H U
O M
L M
I C E C R E A M
D R
A
Y
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 188
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
REVIEW DAY 2 – RELAY RACE FOR CROSSWORDS
K
P
I
S
E
L
C
T
I
O
N
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 189
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
REFERENCES
• Philips Hotel (2011), Net promoter score at Philips. Available at:
https://www.youtube.com/watch?v=lckcJeae5Ds
• Bain & Company, Satmetrix Systems (2013), Measuring your Net Promoter Score. Available at:
http://www.netpromotersystem.com/about/measuring-your-net-promoter-score.aspx
Images:
• Arcan, A. (2011), Performance measurements and metrics: An analysis of supplier evaluation. Available
at: http://scm.ncsu.edu/scm-articles/article/performance-measurements-and-metrics-an-analysis-of-
supplier-evaluation
• Effectory International (2014), Global Employee Engagement Index. Avaliable at:
http://www.employee-engagement-index.com/
• Eneco (2013), Performance report 2012. Available at:
http://annualreport2012.eneco.com/progress/strategic-kpis
• Harvard Kennedy School, Center for Public Leadership (2012), A national study on confidence in
leadership. Available at: http://www.centerforpublicleadership.org/images/pdf/NLI/cpl_nli_2012.pdf
• Lindsey, M. (n.d.), Supplier performance ratings - Scorecards, rankings, and awarding business.
Available at: http://www.asq-qm.org/resourcesmodule/download_resource/id/348/
© The KPI Institute 2015 The World Understand KPI KPI Workingwith
Working with Data Data Course 190
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets
Targets Gathering Visualization Review
AGENDA
# Time to fill a vacant position 35 HR Allan Smith Finance Manager 20-05-14 01-06-14
% Deals closed 234 Sales Julien Harrison Sales Manager 18-06-14 01-06-14
# Production plants functional 4 Production Dan McKenny Production Manager 25-05-14 01-06-14
$ Time to produce 1 item 30 Production Dan McKenny Production Manager 21-05-14 01-06-14
% Brand awareness 50% Marketing Joe Linch Marketing Manager 17-05-14 01-06-14
% Production uptime 10% Production Dan McKenny Production Manager 17-05-14 01-06-14
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 192
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DATA QUALITY DIMENSIONS
Is the data available
at the time needed?
Does data Timeliness
reflect the
real world
Accuracy Is all the necessary
objects or
Completeness data present?
a verifiable
source?
Data
quality
Are there Is the data
no presenting the same
Uniqueness Consistency values in different
duplicate
records for systems?
the same
data? Conformity
Is the data compliant with the
format, type and range
requested?
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 193
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DATA QUALITY DIMENSIONS
Most common challenges:
Completeness
Availability
Timeliness Accuracy
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 194
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
THE KPI ACTIVATION / DATA GATHERING PROCESS
1
• Meet with data custodians
4
• Communicate the template to data custodians
5
• Send KPI data gathering notification On-going
data
• Send reminder email
6 gathering
7
• Receive data process
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 195
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DATA GATHERING GOVERNANCE
Report Generator
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 196
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DISCOVER DATA CUSTODIAN ROLES
1. Analyze KPI measurement options
2. Reach the targets for the KPIs
3. Document KPIs
4. Select KPIs
5. Activate KPIs
6. Take decisions based on KPI results
7. Cascade KPIs to lower organizational levels
8. Find solutions for inactive KPIs
9. Ensure quality of data gathered: compliance with
measurement methodology, accuracy and timeliness of
submission
10. Update KPI documentation forms
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 197
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI DATA GATHERING SOURCES
Internal
Operations
Production reports
HSSE observation sheets
ERP Benchmarking
reports
SAP
External
Oracle
benchmarking reports
External entities
Surveys Sources (accreditations,
ratings)
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 198
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TOOLS
Data gathering process map
1
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 199
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TOOLS
Data gathering process map
1
1
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 200
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TOOLS
Data gathering template
1
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 201
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TOOLS
KPI Documentation form
1
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 202
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION / GATHERING TECHNIQUES
Meeting KPI data custodians in
1 person
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 203
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TECHNIQUES
Meeting KPI data custodians in person
1
Maritz Institute - 3 main benefits for conducting face
to face meetings:
2
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 204
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TECHNIQUES
Involving data custodians in a community of
1 practice
• Provides a common platform for data custodians to
2 communicate and share work related experience;
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 205
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
KPI ACTIVATION TECHNIQUES
Sending reminder email
1
# KPIs to # KPIs already
Custodian name KPIs not reported on yet Due date Status Comment
report reported on
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 206
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
WORKING WITH DATA CUSTODIANS
Scenario:
• As a part of the KPI implementation project team, following the
strategic planning session, your have to deal with a list of currently
inactive KPIs for the organization.
Task:
• You are required to meet with all data custodians and discuss the
inactive KPIs. To guide your discussion use the agenda provided and
make sure each topic is debated and solutions are found.
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 207
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
WORKING WITH DATA CUSTODIANS
Agenda
No. Topics No. KPIs to discuss
1 Present the scope of the meeting # Complaints registered from
1
Explain each KPI (definition, customers
2 calculation formula, data collection 2 % Project on time
frequency) 3 # Employee engagement index
Identify resources needed to activate
3
each KPI (infrastructure, people, costs)
Propose solutions to gather data for
4
each KPI
5 Establish activation dates for each KPI
6 Next steps and closing the meeting
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 208
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DATA COLLECTION METHODS
• Automated:
Off-the shelf software;
Custom-designed software.
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 209
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
DATA COLLECTION METHODS
• During the last years, companies have oriented their IT investments
towards BI tools and analytics in order to facillitate data gathering and
provide accurate and timely information for decision making.
IT Investment Priority
60%
50%
50%
41%
40% 37% 36%
34%
31% 32%
30% 27% 26%
24%
20%
10%
0%
BI/analytics Infrastructure and data Cloud ERP Mobile
center
2014 2015
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 210
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
SPIDER STRATEGIES
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 211
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
SOFTWARE SPOTLIGHT
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 212
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
SESSION REVIEW
1. Data quality dimensions: completeness, validity, accuracy,
consistency, integrity, timeliness.
Images:
• KPI Institute (2014), Call Center Performance Management Toolkit. Available at:
http://store.kpiinstitute.org/call-center-scorecard.html
• Gartner (2015), Magic Quadrant. Available at: http://www.gartner.com/technology/reprints.do?id=1-
2AEDBU3&ct=150223&st=sb
© The KPI Institute 2015 The World Understand KPI KPI Working with Data
Data Data Course 214
KPI Typology KPI Taxonomy KPI Alignment
of KPIs KPIs Selection Documentation Targets Gathering
Gathering Visualization Review
AGENDA
10 Data visualization
1. Guidelines to design efficient templates
2. Usability in terms of visual design
3. Scorecard and dashboard design
B D
A
C
28% 33%
24%
15%
23.71% 16.79%
8.46%
Biscotti Capuccino
Coffee Grinder Coffee Pot Biscotti Capuccino
Croissant Espresso Coffee Grinder Coffee Pot
Latte Mug Croissant Espresso
Scone Thermos Latte Mug
Scone Thermos
Product Share
Latte
Latte 23,71% Croissant
Croissant 16,79% Biscotti
Biscotti 11,40% Mug
Mug 9,80% Scone
Bar charts
1
Bullet graphs
2
3 Dial charts
4 Line charts
5 Pie charts
6
Sparkline
France
20
2
2 15
10
North America
Emerging markets
5
UK & Ireland
3
0
3 2009 2010 2011 2012 2013
Germany & Austria
Japan
4
4 Stacked-bar chart
Benelux
Gender distribution in 2013 (%)
Italy
5
5 All managers Nordics
6 Branch managers
LHH
Switzerland
0% 20% 40% 60% 80% 100%
1 % Community Target
satisfaction
2 0% 20% 40% 60% 80% 100%
Actual performance
3 % Medical practitioner
satisfaction
4 0% 20% 40% 60% 80% 100%
% Practice manager
5 satisfaction
0% 20% 40% 60% 80% 100%
6
% Pharmacist satisfaction
4
2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Net profit (EUR million)
6,000
5,000
5 4,000
3,000
6 2,000
1,000
0
2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
2 33%
3 67%
43%
6 49%
13%
51%
29%
1 3D
2 Pie chart
3 Donut chart
4 Crowded graphs
5 Scales from 0
6
Background
1 90
80
2
70
60
3
50
4 40
30
5
20
10
6
0
1 2 3 4 5
1 90 82
77
80 71
2
70 62
60
3 51
50
4 40
30
5
20
10
6
0
1 2 3 4 5
expenditure
India
4 United States India
30%
United States
25.6% 25.9% 30% 25.6% 25.9% 25.1%
25.1% 23.9% 23.9%
30% 25.6% 25.9% 25.1% 23.9% 30% 25%
25%
25% 25%
20% 20%
16.6% 16.2%
5 20% 20% 15.9%
14.0% 15%
15% 15%
15%
10% 10% 10% 10%
5% 5% 5% 5%
0%
6 2009 2010 2011 2012
0%
2009 2010 2011 2012
0%
2009 2010 2011 2012
0%
2009 2010 2011 2012
Protection 1%
Healthcare, 27%
Transportation 3%
3 Wefare, 11% Education 3%
Interest 6%
4 Wefare 11%
Defense 22%
5 Defense, 22%
Pensions 25%
Healthcare 27%
Variable
Base salary
Variable
Bonus Bonus
Bonus
36% PSP 39%
3 29%
34% PSP 32% AZIP
27% PSP
AZIP
AZIP
4 2010
2009 2011
1 ¥250.0 ¥250.0
*The black line represents the average ¥200.0 ¥200.0
value of the 5 analyzed years
2 *The green column represents the average
¥150.0 ¥150.0
¥50.0 ¥50.0
3
¥0.0 ¥0.0
1,991
2,000
3 1,500
3,000
5 2,500
2,000
1,500
6 1,000
500
0
2009 2010 2011 2012 2013
2
70% 64.8% 62.5% 62.4% 70% 62.5%62.4%
59.4% 59.4% 59.4%59.4%
60% 60%
50% 50%
40%
40%
30%
30%
3 20%
10%
20%
10%
0%
United States Northeast Midwest South West 0%
United States Northeast Midwest South West
• 6 perspectives identified:
Financial, Services, Internal
Business Processes, Growth and
Development, People, Social and
Environment;
• Fields like KPI definition, formula and purpose are not necessary on a scorecard, however data fields
(acceptable score, score this month, variance, trend) are important for understanding performance
results.
Source: Victoria Government (n.d.)
• No gridlines, no
strong colors;
• No indication if
the actual
results
compared with
expected results
(targets) are
positive or not.
Source: World Bank (2014)
• Combines a variety of
visual representations
that are well
positioned in one
page.
• Interactive charts,
providing more
details for each set
of data.
• Monthly evolution
trends.
Tasks:
• Select the most relevant KPIs for the clusters already identified.
2. Dashboards:
• Bar charts: to compare individual values;
• Bullet graphs: to compare actual results to targets;
• Dial charts: to indicate threshold values;
• Line charts: to track trends;
• Pie charts: to compare different parts of a whole;
• Sparklines: to show trends in a condensed manner.
3. Avoid using:
• 3D graphs: distort data
• Pie and donut charts: inefficient use of space;
• Crowded graphs: data is no longer visible;
• Strong colors for backgrounds: hinder visibility.