Ceb Talent Analytics Quarterly q1 2017
Ceb Talent Analytics Quarterly q1 2017
Ceb Talent Analytics Quarterly q1 2017
Quarterly
Q1 2017
In This Issue:
Starting Simple at EY
Talent Analytics
Innovations: Separating
Fact from Hype
The Advantages of
Machine Learning in
Candidate Selection
(and Pitfalls to Avoid)
Q1 2017
Q1 2017
CEB Corporate Leadership
Council™
Editors
Brian Kropp
Daniel Metz
4 What Are Your 2017 Talent Analytics Priorities? Authors
Infographic Danielle Douglas
Matt Dudek
Caitlin Dutkiewicz
6 What We Heard from You in 2016 Blakeley Hartfelder
Omar Hoda
Jessica Knight
Andrea Kropp
Susannah Schools
9 Aligning Talent Analytics to CHROs’
Marianne Stengel
Strategic Priorities
Content Publishing
Solutions
11 Starting Simple at EY Graphic Designer
An Interview with Blair Hopkins Stacey Phipps
Editor
Melanie Meaders
14 Talent Analytics Innovations: Separating
Fact from Hype
31 In the News
It’s an exciting time to be involved in talent analytics; in many ways, the field
is exploding. The ranks of talent analytics professional groups are swelling:
three-quarters of large organizations are increasing their investments in talent
analytics this year, and CEOs and boards are giving increasing attention to
analytics’ potential to improve talent management’s impact.
For the first two issues of Talent Analytics Quarterly, we’ve approached these
changes from a variety of perspectives. In our first issue, we focused on
foundations—interviews with talent analytics leaders who were building their
functions and creating their organizations’ talent analytics strategies, advice on
how to build foundational data management capabilities, and hiring guidance
for building a successful talent analytics team. In our second issue, we focused
on the future, with specific features on how to set priorities for 2017, key
trends and influences on talent analytics organizations, and how to manage
the emerging trend of organizations working with both chief data officers and
talent analytics groups.
In our third issue of Talent Analytics Quarterly—and the first in 2017—we dive
deep. In the pages that follow, readers will find an excellent primer from CEB’s
Talent Management Labs on using text analytics, an article on the use of
machine learning in candidate selection, an early look at major trends in talent
analytics technologies and innovations, and a look at how we can draw lessons
from marketing analytics on how to communicate data-centric insight to
clients—an important and perennial issue for talent analytics leaders as well.
Sincerely,
Daniel Metz
Research Leader
CEB Corporate Leadership CouncilTM
Q1 2017 3
What Are Your 2017
Talent Analytics
Priorities?
Just
1 in 10
talent analytics leaders believes his
or her organization effectively uses
talent data to inform decisions.
2.
In response to 3.
1.
sponsorship or To address
To address key
demand from specific business
talent risks
senior HR challenges
leaders
Functional
Specific Projects Maturity Data Quality
Strategic workforce Staff costs are the Inadequate data
planning and attrition biggest expenditure quality inhibits over
projects are top for talent analytics 50% of organizations
priorities for budgets from using talent
2017. in 2017. data.
65.5% 61.1%
60.2% 58.4% 55.8% 52.2%
Q1 2017 5
What We Heard
from You in 2016
By Marianne Stengel
A
s we built our support for heads of • The idea of sharing imperfect data to help leaders
talent analytics and their teams over realize they need to hold data owners accountable for
data quality came up a few times in our discussions. For
the past six months, we spoke to many
example, one organization took this a step further by
of you around the globe. We heard four primary deciding to formally measure and report data quality. The
challenges—and a few solutions—from you. organization established a data quality score, published it
in a quarterly dashboard, and pushed accountability for it
1. Engage users in improving data quality.
to data owners (HRBPs or business leaders).
Data quality came up in nearly every conversation. For Creating transparency on data quality weak spots across
54% of organizations participating in our recent survey, it the organization pushed data owners to improve it. The
is the top barrier to talent analytics effectiveness, and it talent analytics team further supported data owners by
often appears insurmountable. However, we heard a few compiling a data and metrics dictionary.
encouraging stories of how far you can get with less-than-
perfect data and how you can partner with talent analytics
clients to improve it:
• One organization built a simple attrition model starting Takeaway
with publicly available data from consultants on the
possible cost savings from reducing turnover. Combining Don’t let poor data quality hold you back. Use
this information with its own incomplete and unreliable the data you have anyway to get a reaction from
data on turnover, the organization built a forecast model data owners, and share a few simple steps with
and let business leaders tinker with different assumptions. them to get them started on improving it. See
a replay of our event, Three Critical Obstacles
While imperfect, this model showed leaders that even to Creating Talent Analytics Capability, on the
with turnover rates remaining the same, current diversity CEB Corporate Leadership Council™ website
hiring strategies were not going to achieve the desired for more tips.
goal. And more importantly, it started a conversation
about what needed to be done to improve data quality
over time.
• Several talent analytics leaders have made data privacy Keep data privacy top of mind. After viewing
the centerpiece of their strategy, above even technology the replay of Three Critical Obstacles to Creating
or team skills development. For one company, this takes Talent Analytics Capability, consider who on
the shape of a formal commitment to only use employee your team could take the lead on data security
data for purposes that employees would expect and privacy and how they should evaluate risks
(e.g., analyzing diversity drivers but not predicting against potential data use benefits.
individual attrition likelihood). This builds employees’
trust in talent analytics and increases the team’s access
to employee data.
• Building trust in talent analytics is particularly important. 3. Focus on HR staff’s analytics skills to drive talent
One talent analytics leader described to us how he analytics impact.
tries to build the image of talent analytics as a neutral
Most talent analytics leaders report frustration with their
consultant; for example, he involves universities—which
peers in the wider HR function when it comes to analytics
are only interested in knowledge—in projects, and he
understanding or skills. Too often, HRBPs struggle to make
posts the results of each project for everyone to review.
Q1 2017 7
sense of analytics insights and 4. Align talent analytics
therefore don’t use them with with business needs and
their line leaders to initiate capability to drive impact.
change. We have heard many The team asks the
Many organizations mentioned
different strategies to improve requestor to consider the
HRBPs’ or specialists’ skills and the need to prove the impact
comfort level with analytics:
questions: What do you of talent analytics. This is
think the answer is going easier to do in cases such
• While many organizations as attrition projects where
push e-learnings or webinars, to be? If I tell you the
there are direct links to cost
the most effective training answer, what will you do savings. It is harder, however,
focuses on in-person, practical
about or with it? Over time, to show how concepts such
exercises. Two organiza-
as engagement or leadership
tions described to us how this teaches requestors to
make the business more
they organized traditional, ask better questions. profitable—or at least a better
classroom-based training
place to work.
sessions in which HRBPs work
on real-life questions from the Talent analytics leaders have
HR leadership team. This gives found different ways of tackling
them hands-on experience of this challenge:
simple modeling and teaches them how to ask good
• Several talent analytics teams rely on close partnerships
questions. It also builds their confidence not only with
across the organization to identify where to focus their
using data but also with presenting and defending it to
time. By getting the business to tell them its problems,
their line leaders.
they ensure they are aligned to business priorities and
• One talent analytics leader who hasn’t been able to fund that analytics insights will be acted on. This in turn gets
this type of training instead ensures that he and his team them invited back for other projects.
evolve from simply delivering answers to teaching their
• One talent analytics leader didn’t wait for the business to
clients how to self-serve. Whenever a request comes in
tell him what it needed. Observing a disruptive change
for which this is feasible, they consult with the requestor
in the industry, he decided to have his team develop a
one-on-one to show them how to think through getting
workforce planning tool. When the business realized
the answer and teach them simple analytics skills.
what it needed, the tool was close to ready, and it is now
• This is echoed by another organization where the talent being rolled out across the organization.
analytics team forces requestors to state what they are
• Several organizations have stressed the harm in getting
going to do with the data they are asking for. The team
too sophisticated too early. One team aims to deliver the
asks the requestor to consider the questions: What do
analytics quality and insight that is required plus a bit
you think the answer is going to be? If I tell you the
more; anything beyond that risks leaving the business
answer, what will you do about or with it? Over time, this
behind and not getting used. It is more important to focus
teaches requestors to ask better questions; and in the
on application rather than on sophisticated analytics.
interim, it can drive requestors to realize when they can
answer their own questions, or that the question might • Another organization names a business sponsor for every
not be worth asking in the first place. strategic analytics project. This ensures that the business
is involved in the work instead of just receiving the
results. Talent analytics teams have to recognize that the
answers they provide require change, and this change is
Takeaway easier to execute when the business has been engaged in
the search for the right answer.
Focus on building analytics skills in every
interaction with HR data users. Start by sharing
the HRBP Guide: Deliver on Talent Analytics Takeaway
Initiatives on the CEB Corporate Leadership
Council™ website with interested HRBPs to help Don’t overwhelm your clients, but engage them in
them identify when to apply talent analytics, defining the key questions to answer with talent
how to select the right metrics, and how to analytics. See our case study of Gap Inc.’s method,
communicate talent insights. Analytics Prioritization Principles, on the CEB
Corporate Leadership Council website.
C
HROs know that talent analytics can play Using metrics to create the illusion of change is easy. But
a big role in achieving their goals. That’s behavior change is what truly defines a culture shift, not
the metrics organizations typically focus on (e.g., interim
why 68% of CHROs want to improve
objectives, improvement in business results, employee
their organizations’ talent analytics capabilities attitudes). Talent analytics should define metrics up front to
in 2017. To help talent analytics leaders like be able to identify whether employees are actually working
you prepare for 2017, we have taken the top in new ways.
insights from our global survey of heads of HR
2. Strengthen cross-functional analytics partnerships.
and identified five opportunities to get ahead
of potential CHRO needs. CHROs spend nearly 25% of their time on enterprise-wide ini-
tiatives, necessitating strong cross-functional partnerships.
1. Create a line of sight between culture
CHROs reported that the chief financial officer (CFO), chief
and strategy via metrics.
information officer (CIO), and chief
Culture goes hand-in-hand with strategy officer (CSO) are the most
business transformation. So given the important C-suite peers to partner with
increasing number of organizational as they look to bring attention to tal-
68%
changes, it is not surprising that 76% ent issues in new ways in 2017. For ex-
of organizations anticipate undergoing ample, CHROs can partner with these
a culture change in 2017. leaders to redesign processes that may
of CHROs want to causes managers to redirect resources
CHROs are confident in HR’s improve their talent away from large growth projects, build
analytics capabilities
ability to define a new culture, in 2017. a robust digital workforce pipeline, and
but confidence decreases by 30% create a change-capable HR function.
when it comes to embedding the
new culture. In fact, only 37% of Knowing that the head of HR will
CHROs are currently confident in HR’s ability to define need to partner with Finance, IT, and
metrics and collect data on culture-change progress— strategy leaders, talent analytics teams can (and should)
one of the more challenging aspects of embedding a begin to form their own partnerships with their counterparts
new culture. in these areas. These relationships will give the talent
Q1 2017 9
analytics team an advantage if it is asked to support cross- 1. Improving business acumen to ensure the team
functional projects because the team will know whom to understands the key priorities of the business
reach out to for different data. In addition, these relationships 2. Improving the data presentation (i.e., translating
will certainly prove beneficial to the talent analytics team for complex analysis into a consumable format) to engage
best practice sharing, data access, tools, technology ideas, the board and push leaders to action.
and more.
5. Apply leader analytics to strengthen
3. Analyze employee needs to create succession strategy.
consumer-like experiences.
Key business stakeholders are beginning to question current
External, macro trends such as the rise of big data, on- succession management approaches, and boards seem
demand service expectations, and digital disruption are
dissatisfied, asking about the succession process, current
prompting CHROs to look internally for ways to transform bench strength, and overall pipeline sustainability. It is
the HR function. One-third of heads of HR are planning to
therefore not surprising that executive succession is the top
innovate by creating a consumer-like employee experience.
talent issue on which heads of HR feel pressure from the
This transformation includes applying product management board to provide more insight. At the same time, heads of HR
discipline to HR offerings (e.g., Agile are questioning traditional succession
methods), building HR apps, and practices, such as the nine-box grid
gamifying talent management. and talent reviews.
67%
For HR to move away from the The number and depth of these
proficiency and performance measures succession doubts indicate that CHROs
it is often preoccupied with and may be looking for new-in-kind ways to
become more consumer focused, it of CHROs think they
must better communicate supplement, or even replace, existing
must draw inspiration from functions
talent management succession management practices.
that concentrate on external customers insights to the board. To get ahead of this, talent analytics
(e.g., Marketing and Sales). The first leaders should focus on leader
step to an effective consumer-like analytics—a systematic, data-driven
strategy is to understand and segment approach for identifying the drivers
your audience. and outcomes of effective leadership.
(See Seven Lessons for Impactful Leader Analytics on the
Talent analytics teams can help HR begin to understand
CEB Corporate Leadership Council™ website for more
unique employee needs by analyzing data, such as life stages
information.)
and context, that influence employee behaviors, motivations,
and actions. The goal is to build a demand landscape for Using past data on effective leadership to predict future
employees as a means of better understanding the workforce, performance, leader analytics can help organizations with
similar to what occurs in the consumer space. succession planning by more effectively identifying essential
leadership qualities and by identifying leaders earlier and
Read our interview online to learn how Hershey identified
from unexpected places.
nontraditional employee segments.
An Interview with
Blair Hopkins
EY is a global leader in assurance, tax, transaction and Blair Hopkins is the Director
advisory services. The insights and quality services it of Global People Data,
delivers help build trust and confidence in the capital Reporting and Analytics
markets and in economies the world over. EY develops based in Glasgow, Scotland,
outstanding leaders who team up to deliver on its and has been with EY for
promises to all of its stakeholders. In so doing, it plays more than 10 years. The
a critical role in building a better working world for its objective of the Global
people, for its clients, and for its communities. People Data, Reporting
and Analytics team is to
EY refers to the global organization, and may refer to improve the control, quality,
one or more of the member firms of Ernst & Young and efficiency of people data, reporting, and analytics
Global Limited, each of which is a separate legal entity. to allow better decision making for leaders across
Ernst & Young Global Limited, a UK company limited the EY global Talent function and across the broader
by guarantee, does not provide services to clients. organization.
For more information about EY, please visit ey.com.
Blair oversees people data governance, helping confirm
data standards and policies are met for talent data
across EY member firms in more than 150 countries,
and the Global People Reporting team, comprising
a globally distributed center of excellence and an
India-based shared services reporting team. He is also
accountable for the establishment and management of
an advanced Analytics team focused on strategic HR
issues impacting EY globally.
Q1 2017 11
E
very quarter, we interview talent analytics of data management, from data definitions and the
leaders to gain their perspectives on processes that gather data through to guidance on how
to best leverage our data for analytics while respecting
issues facing them and their teams. This
the intent of the rules and regulations.
quarter we spoke with Blair Hopkins about his
work at EY. After we’ve set the rules, our Global People Reporting
team acts as a gatekeeper and applies these rules to data
requests. It’s an approach that works because we have
data governance as a foundation for our way of working.
When you created the Global People Data, Reporting
and Analytics organization at EY three years ago, what Let’s go back to how you generate insights from data.
did you decide to invest in first? You mentioned competency with Excel—what other
skills does an analytics team need?
BLAIR: Aside from hiring the right people—initially good
storytellers—my focus was to rapidly demonstrate the BLAIR: In the early stages, we recruited storytellers
business value of the new function to our leadership, then rather than data scientists. In our case, our first projects
focus on data governance. Technology investments came wouldn’t have been sophisticated enough to keep data
later. Decisions made on our findings impact real people scientists busy, and that’s an important consideration.
in real terms, hence the focus on data. With technology We concentrated on low-hanging fruit in order to build a
investment, too much analytical sophistication early business case for talent analytics and why it would pay off
on could have run the risk of overwhelming our internal to invest more in our team. In order to do that, we needed
clients, as advanced methods and technology can make people who were technically clever (e.g., modeling skills,
analytics seem unapproachable. Microsoft Excel) and could also tell a compelling story.
We were able to communicate a high-impact, simple, and As general advice, I would recommend to start simply
effective message through having a highly competent before pursuing more elegant analytics solutions that
user of spreadsheets generate insight from Microsoft can be difficult to explain and tie into leaders’ objectives.
Excel. When you consider many HR generalists have a Again, do not overcomplicate things at first. As we have
limited understanding of statistics, there was no need to matured, we have been able to add deep statistical
immediately dive deeply, using more sophisticated tools knowledge, psychology, modeling, and a dedicated data
like SPSS or R. scientist to manage data and technology environments. Of
note, while some of the team has HR domain experience,
Why do you think data governance should be at the we actually seek deep HR domain knowledge from our
center of your analytics strategy? clients on a project-by-project basis. While desirable,
this is not an essential hiring skill and can be developed
BLAIR: I was primarily driven by concerns with respect
on the job.
to data privacy, which carries a much greater risk when
dealing with people data compared to market, consumer, Can you give us an example of what one of those early
or financial data. The conventional starting point for projects looked like?
any analytics project is “Give me all the data, and let’s
see what we can do with it.” The challenge is that you BLAIR: One of our first projects focused on retention. We
are often limited in taking this approach, as regulations spent only a week on our initial exploratory analysis, but
covering collection of personal data often require explicit we came up with a bottom-line impact figure in excess
permission—and that can be hard to obtain. of US$100 million that could be derived from just a small
improvement in retention. That’s a compelling story to tell
There are also considerations around how data is managed. based on fairly simple, yet robust analysis.
For example, an analyst might send out analytics results,
hiding an employee list in the spreadsheet but leaving the Our global Talent vice chair took this to the global
data potentially accessible. In a lot of countries, this might executive team, leading to the initiation of a project across
constitute a breach of employee data privacy regulation, our organization—mobilizing hundreds of HR business
leaving our executives exposed to regulatory risk. partners and organization development leaders—as well
as the central development of more sophisticated tools to
How are you addressing these risks? support regular analysis.
BLAIR: I currently chair our Global People Data So storytelling skills combined with an aptitude for
Governance committee, which identifies what the numbers and an eye for business context took us farther
boundaries are and confirms we have common definitions. than if we had solely pursued data knowledge within our
We have membership drawn from our data privacy team, team. Given the success of the retention project and our
as well as IT and the business. We focus on all aspects ability to make the case that we could have tremendous
Q1 2017 13
Talent Analytics
Innovations: Separating
Fact from Hype
By Blakeley Hartfelder
O
rganizations today face
a rapidly expanding
marketplace of emerg- HRIS predictive Nearly half of organizations do not use their HRIS for
analytics predictive analytics, and only 30% of those that do
ing technologies and vendors capabilities are report that the features provide high value. As a result,
in the talent analytics space— insufficient. these organizations may be turning to other platforms
offering everything from data to provide analytics support, unnecessarily increasing
coordination and data compatibility costs.
aggregation to attrition predic-
tion and social network anal-
The importance
ysis. Although these vendors of data More than half of organizations use data visualization
software for talent analytics, and another one-third are
promise improvements, each visualization
drives software planning to use it soon. Of users, about 70% report
requires substantial investment receiving high value from the software and will increase
investments.
of your time and resources. So investment.
Organizations
plan increased Few organizations currently use consultants to conduct
investment one-off analytics projects, but the number may increase.
in analytics About 80% of organizations think these services provide
consulting. high value, and nearly half plan to increase investments
in this area.
Learn More
http://ceburl.com/1qwc Q1 2017 15
Beginner’s Guide
to Text Analytics
for HR
By Andrea Kropp
W
ords underpin nearly every aspect would prove a difficult starting point for teams delving into
of business—from e-mails between text analytics for the first time because they require multiple
text processing and analytical techniques. A good rule of
team members and phone-based
thumb is to scope your initial text mining projects so that
customer service requests to live sales visits
each has no more than two required steps or methods your
with prospects and résumés submitted by team has never encountered before. This is especially true
candidates. Add to that list the more-structured if the team is learning the software and methods at the
final reports and presentations stored on your same time.
company’s network and the less-structured
This article details three foundational capabilities and some
instant messages and breakroom chatter.
related projects you can use as starting points in your text
When you begin to think of words as data, new analytical analytics journey. As your team masters these capabilities,
possibilities emerge across all the major HR domains. For you can build up to more complex analyses by chaining the
example, you may wonder if it’s possible to: basic methods together. In this way, you can take incremental
steps toward big ideas.
• Monitor employees’ engagement levels passively
via their language, A Note on Software Choices and Finding Help
• Predict how well a person will perform in a role from
their interview responses, This article will not list or contrast the many text-handling
and text-analysis software choices available. The suite of
• Identify future leaders from the content and style
open-source and proprietary tools to facilitate text mining
of their communications,
is growing every month. For most common tasks, excellent
• Assess how well a team is working together from their written and video tutorials are available, and many include
exchanges during a meeting, or sample code created by a very active user community.
• Create tailored coaching for individual sales
One consideration is that text mining cuts across nearly all
representatives based on transcripts of their customer
academic fields, and it is not uncommon to jump between
interactions?
resources created by computer scientists, linguists,
These types of big ideas will help talent analytics leaders historians, political scientists, psychologists, and more when
make the business case for seeding and nurturing text researching a new method. Don’t expect or try to find many
mining competencies within their teams. However, these HR-specific examples.
How: The methods you’ll need to apply are tokenizing and Examples: The MyPersonality Project, which relates over four
n-gram counting. Tokenization is the process of breaking million Facebook profiles to over six million psychometrics
a passage of text into words, phrases, symbols, or other tests, has resulted in the publication of hundreds of papers
meaningful elements, called tokens. The tokens can then be and interactive applications that show how word and phrase
counted and reported as single words (unigrams), two-word
use relate to demographics, personality, and mental and
phrases (bigrams), three-word phrases (trigrams), and so on.
physical health (see figure 1). Explore the demos available
The result will be dominated by functional words such as
on the World Well-Being Project website (wwbp.org/demos.
“and,” “in,” or “the,” which can be removed by specifying a
list of stop words. Experiment with removing all punctuation html), and try the four ideas in the project suggestions table
before tokenizing; this will cause “e-mail” and “email” and at the end of this article for some quick wins using only this
“Ph.D.” and “PhD” to become the same token. first capability.
Q1 2017 17
Figure 1: MyPersonality Project Words, by Age excited
:)
i am thankful
Standardized Relative Frequency
3
wonderful
2
(1)
(2)
(3)
10 15 20 25 30 35 40 45 50 55 60 65
Age
Source: University of Pennsylvania Positive Psychology Center: The World Well-Being Project, “Words Across Age,” 2017,
http://wwbp.org/age_plot.html.
ideas and how they feel about the topic. Press, 2011) 229–231.
Q1 2017 19
who stayed past six months and those who didn’t stay for
six months. Then you’d use the application data to generate
as many features as possible. Your feature set would include
n-grams (capability 1), topics (capability 2), and derived
features from all three categories (capability 3). It would
not be uncommon to have 5,000 or more features to work
with at this point.
Allow me to close with a personal story that exemplifies the There is much to learn,
profound impact text analytics can have on your analysts and
organization. A few months ago, I participated in a corporate
and these building blocks
event where teams of four people had roughly three days are just the starting point.
to develop a working prototype of a big data product. The
participants were mostly midcareer professional IT staff,
data scientists, and computer scientists, but many had never
worked with text as data. Around 10:00 p.m. on day two,
I was roaming the halls to stretch my legs when I heard a
woman from another team exclaim in an exhilarated voice,
“It worked! I made a word cloud! Come look.”
Count Word Count words and phrases in a single open-ended Examine how responses differ by employee segments
and Phrase employee survey field with a variety of responses. such as level, location, or ethnicity.
Frequencies
Count words and phrases in the course comments for Provide feedback to individual instructors.
an internal training course that is taught by multiple
instructors.
Count words and phrases in your organization’s reviews Monitor changes over time.
on Glassdoor or a similar website.
Count words and phrases in the hiring manager’s notes Correlate success in the role with the manager’s notes.
on candidate interviews for a specific role.
Identify the Apply stemming to your text before word counting to In future projects, try stemmed and un-stemmed text to
Main Topics group words with the same root (e.g., nurse, nursing, see which yields the better result.
and Themes nurses, nursed).
Create a word cloud of all job postings from the past Limit your data to a single job title or category, and
year after removing stop words. compare your historical job postings with those of your
main talent competitors.
Create a topic model of your organization’s reviews on Examine topic frequency by job title and location as
Glassdoor or a similar website. (Tip: Keep the pros, cons, reported on Glassdoor.
and advice to management separate.)
Apply an open-source sentiment dictionary to open- Manually read and tag the comments as positive,
ended comments from internal surveys. negative, or neutral, and assess how accurate your
chosen sentiment tagger was. Learn how to make it
more accurate for your own use cases.
Derive Use a part-of-speech tagger to calculate what Correlate stylistic language features to outcomes of
Additional percentage of a speaker’s or writer’s words are verbs, interest. For example, there is substantial literature on
Contextual adjectives, proper nouns, etc. the relationship between personal pronoun use and
Features leadership.
from Text
Use the name of the college listed on a résumé to link Look for patterns among successful and unsuccessful
to an external table of data about the institution (e.g., hires in what type of college they attended.
urban or rural location, public or private, average
SAT score).
Apply a word categorization dictionary such as WordNet Use linguistic word categories to infer psychometric
(open source) or LIWC (fee applies) to a collection of traits of the author, such as personality or
documents, e-mails, or comments. cognitive ability.
Apply named-entity recognition (NER) to employee Aggregate all the survey responses that pertain to a
survey comments to identify the people, places, certain person or department. (NER is more powerful
departments, programs, etc. most often referred than a keyword search because it will find instances
to by name. where pronouns refer back to the same entity.)
Q1 2017 21
The Advantages of
Machine Learning in
Candidate Selection
(and Pitfalls to Avoid)
By Marianne Stengel and Omar Hoda
W
hile many talent analytics teams This automated prediction replicates what the human mind
are still struggling with cleaning attempts to accomplish when selecting from the applicant
pool, but at a much higher level of sophistication.
data or getting buy-in to invest
in data warehouses, some talent analytics The Benefits of Machine Learning
leaders are turning their attention to machine for Candidate Selection
learning. Here, we consider machine learning’s Several decades ago, organizations made the move away
application to candidate selection, outlining its from relying entirely on human judgment to administering
possible benefits as well as its potential risks. predictive tools such as psychometric assessments before
hiring a candidate. Psychometric assessments allow
What Is Machine Learning? companies to understand a candidate’s competencies and
potential success in the role and are more objective than
Machine learning is the automated version of human learning.
relying on a hiring manager’s reaction alone (e.g., through
It mimics how our brains automatically recognize patterns
unstructured interviews).
based on previous experience.
Organizations now find themselves at a similar turning point as
Machine learning capabilities enable the creation and they consider including algorithm assessments as an integral
implementation of algorithmic assessments (using component of the candidate selection process. Traditional
algorithms to score large amounts of application data to assessment tools, such as psychometric assessments, tie
determine the most qualified candidates for the role). By candidate competencies, abilities, behavioral styles, and
applying machine learning principles during the algorithm preferences to outcomes like performance and retention.
development process, organizations can predict which Now psychometric assessments can be complemented by
features show up disproportionately in successful versus cutting-edge algorithmic assessments, where advanced
unsuccessful hires. The statistical engine powering the machine learning and semantic tools are used to predict
machine learning platform can compute large amounts of specific business outcomes, such as retention in role, using
data quickly and accurately, considering every feature— application data alone. This dual-pronged approach provides
and combination of features—available on the candidate’s companies with superior efficacy and versatility in improving
application or résumé. post-hire outcomes.
Q1 2017 23
How Do You Predict
Top Performers?
All we need is their application.
Learn more at
cebglobal.com/sunstone-analytics.
24 Talent Analytics Quarterly © 2017 CEB. All rights reserved.
Drawing Bold
Conclusions
at AstraZeneca
An Interview with
Christian Cormack
Q1 2017 25
E
very quarter, we interview talent analytics for data visualization. Another teammate comes from a
leaders to gain their perspectives on clinical development background, where attention to detail
is critical. The third teammate came from a consulting
issues facing them and their teams. This
background, so can manage stakeholders and keep the
quarter we spoke with Christian Cormack about
commercial perspective in mind.
his work at AstraZeneca.
We don’t have a data scientist on our team, but we are
able to collaborate with statisticians and data scientists
Tell us about your team at AstraZeneca and your main in other parts of the business. My advice to other
responsibilities. organizations about recruiting is that you don’t always
have to select the strongest person overall, or those with
CHRISTIAN: As a company focused on science, our superior technical skills; instead, you should select the
HR function aims to be a true strategic partner to the person who best fills the gaps in your team.
business, using data, analytics, and planning to inform our
people strategy. The final—and perhaps most important—capability is to
be able to build a compelling story based on the data. If
The HR analytics team consists of four people—myself you want analytics to result in action, then this is critical.
and three analysts. The primary job of our team is to A table of numbers doesn’t drive action. But a compelling
ensure that leaders in the business and HR have the story, which describes the trends and implications
right information to make the right decisions around our positioned in the context of the business, can. To do this,
workforce. Overall, our team does four things: you need to spend time with leaders and really understand
• Describes what is happening through quarterly the business.
summaries of key metrics
On the topic of skills, what are some good training
• Conducts more sophisticated deep-dive analytics or development experiences to develop talent
projects to increase understanding of the workforce analytics skills?
• Uses predictive analytics to understand the long-term
impact of current trends CHRISTIAN: Picking up on the last point, spending time
with the business is a critical development experience.
• Uses our understanding of the current state and future Workforce analytics is about providing the business
trends to support workforce planning with the information to make better decisions to drive
performance. But if you don’t know the business, you
What is your role on this team?
can’t do this; you end up shooting in the dark, developing
CHRISTIAN: My role is largely focused on stakeholder a solution in search of a problem!
management and how to position and communicate
analyses to have the highest impact. Fortunately, we For the broader HR function, we offer some formal training
have a separate team for reporting that covers basic data on how to make the best use of talent analytics. However, I
requests. Since we are a small team, we aren’t able to think the most impactful experiences come from working
provide every manager in every part of the business with in partnership with others. Whenever possible, I try to
insights, so we tend to focus on the requirements of our involve the customer in the analysis we do, which leads
senior leaders. to a higher-quality output and ensures they understand
the thought process and the limitations. By doing this, the
What are the skills that are critical for talent analytics? next time we work together they tend to be clearer and
Do you have any advice for where organizations should more specific about what they want to achieve.
look for them?
Q1 2017 27
Lessons from Marketing:
Communicating
Data-Centric Insight
By Susannah Schools
T
oo many talent ana- Marketing research team at CEB, which Learning from these results, talent
lytics professionals recently looked at four critical success analytics teams can rely on four
factors for getting stakeholders to act simple communication principles to
are faced with a frus-
on insight: create a more effective strategy for
trating challenge: they work
communicating data-centric insight.
extensively on a new report 1. Communicating data-centric
Apply these principles both when you
or analysis only to have their insight
present data in person to a stakeholder
work glanced at and set aside 2. Attracting and developing and when you design reports or
with no follow-up. In fact, analytics talent databases for self-service.
only 15% of business leaders
3. Creating momentum 1. Real-Time: Keep data up to
report that talent analyt-
for analytics date, minimizing lag time.
ics has recently led them to
change a business decision. 4. Establishing a data 2. End-User Focused: Present
infrastructure
data in a way that is tailored to
HR can invest more in talent analytics,
Communicating data-centric insight the audience for easy use.
but HR must find a way to help
stakeholders (business leaders, HR emerged as the most important factor,
3. Visual: Present data using
COE staff, HRBPs) to act on the creating twice the impact of attracting
graphs, charts, and pictures
analytics produced. And it’s no easy and developing analytics talent and 2.8
times the impact of establishing a data rather than in more raw forms
task—many stakeholders have limited
infrastructure. These results make sense like database records and
time, limited data experience, and
preconceived notions about how given that effective communication spreadsheets.
things are done. strategies help you avoid the risk
of leaving your stakeholders bored, 4. Interactive: Present data in a
Knowing we have much to learn from confused, frustrated, or in danger of way that allows the end user to
those who came before HR on the misinterpreting or not seeing value in analyze and interpret it himself
analytics journey, we turned to our your findings. or herself.
5
of your stakeholders.
Questions to Improve Your Data
• Gauge your stakeholders’ level of comfort with data Visualization
(figure 1).
1 Are we presenting or circulating
• Outline the decisions your stakeholders are information? Presentations require less
trying to make. detail and more conciseness.
2 What kind of chart or table is best?
3 Does the visual bring attention
to my message?
Figure 1: Typical Stakeholder
Decision-Making Profiles 4 Do the visuals accurately represent
Based on Reliance on Data Versus the numbers?
Reliance on Intuition 5 Is this memorable?
Visceral Decision Maker
• Seldom trusts data Source: CEB analysis.
High
analysis
• Makes decisions
unilaterally
Reliance on
Informed Skeptic
Intuition
• Applies judgment to
Case in Point: Beta Company1
analysis
• Listens to others and Thinking about how to use a visually creative
is comfortable with communication vehicle for your data can help it
dissent
capture stakeholders’ attention and enable you to
Unquestioning narrate how the data should be used. Beta Company,
Low
Empiricist
Low High
• Trusts data over
for instance, published FAQs from customers in
Reliance on Data
judgment a visually appealing coffee-table book. Using this
Source: CEB analysis. • Values consensus format made it much more likely that the recipients
will indeed read the list of FAQs and think about how
the questions apply to the work they are doing.
1
Pseudonym.
Q1 2017 29
4. Interactive
Intermediate
Senior
Staff
Senior Staff
Principal
Fellow
Q1 2017 31
The Challenge of Mainstreaming Human Capital Reporting
By Matt Dudek, Jessica Knight, and Blakeley Hartfelder and originally appearing on Talent Daily
I
n an article for CFO,1 David among customer-facing professionals. This makes sense; some objective
McCann takes a look at The metrics that come out of the human capital measures link directly
investor groups’ engagements with to the bottom line in retail (e.g., if staff
two groups—Principles
retailers may be used to compare the aren’t on the floor or knowledgeable
for Responsible Investment companies with one another, but it’s about products, customers won’t buy).
and the Human Capital unknown how granular the information But those links are weaker in other
Management Coalition is, so therefore it’s unknown how useful industries.
(HCMC)—that encourage such comparisons will be.”
Deciding how to measure certain
organizations to publicly This discussion is evidence that metrics is another challenge.
disclose human capital metrics investors are starting to understand Absenteeism and turnover have
(e.g., turnover, absenteeism, the importance of human capital near-universally accepted definitions,
employee engagement). It’s when looking at a company’s value, but metrics such as engagement
an uphill battle for these and they are looking for ways to get and productivity have competing
data and information related to that. definitions used by different vendors.
advocates, McCann writes,
But actually understanding what the Therefore, investors and analysts
as not everyone is convinced metrics indicate and how to interpret cannot benchmark across firms,
these metrics are worth using them is harder than it may seem. This limiting the momentum of mainstream
or disclosing. might be an opportunity for talent reporting for these metrics.
analytics professionals, and HR leaders
For the opposition, McCann cites Tom more broadly, to step in and educate Improving human capital data
McGuire, former finance and marketing their peers in corporate leadership collection and reporting are worthy
executive and now talent strategy endeavors to better understand and
about which metrics to share as well
leader at Talent Growth Advisors. communicate the value of talent. But
as how to think about them. People
McGuire states, “Whether a company given these challenges, it’s not hard to
data is only going to be as strong as
is well run is a good question, but a see why efforts to make human capital
the story built around it.2
more relevant one is, how do its people reporting a standard practice have
impact its value? To understand that, One potential barrier to increased been slow to gain steam.
you need to look at the company’s reporting of human capital metrics David McCann, “The Holes in Human Capital
1
intellectual capital—patents, brands, is the need for guidelines equivalent Metrics,” CFO, 11 October 2016, http://ww2.cfo.
and proprietary technologies and com/human-capital-management/2016/10/
to the generally accepted accounting
holes-human-capital-metrics/.
methodologies. The only source of any principles. Not having such guidelines
of those things is people.” may also limit that data’s usefulness in 2
For more information, see our article at
cebglobal.com/talentdaily/hr-needs-to-know-
comparing companies’ relative value sentiment-analysis/.
McCann also quotes Jeff Higgins, CEO and performance. To address this
of the Human Capital Management issue, the Center for Talent Reporting
3
CEB Learning & Development Leadership
Council members can watch our 2014
Institute: “If you lose 20% of has created what it calls Talent webinar with Dave Vance, the center’s
management in a year, that’s way too Development Reporting Principles executive director, at cebglobal.com/member/
learning-development/events/replays/14/
high. Losing 20% of your call-center (TDRp) as a standard for human talent-development-reporting-principles-new-
workers is okay. It’s also fine if 20% capital reporting.3 standards-for-the-m.html.
of a retailer’s customer-facing staff is
lost. But it’s disastrous if a professional McCann notes that HCMC has started
services firm has 20% turnover to push for disclosure among retailers.
In Winning on HR Analytics, Ramesh Soundararajan The book also succeeds in dispelling common myths in talent
and Kuldeep Singh address how to take “an analytics—for example, that you need to have perfect data or
analytic view to HR.” With chapters focused make large technology investments to run successful analyses.
on key HR domains—organizational design,
Soundararajan and Singh’s work however, sweeps over some
talent acquisition, learning and development,
of the difficulties talent analytics teams face today—challenges
engagement and retention, competencies, and
such as accessing and synthesizing data from different
compensation and benefits—the book walks
systems, developing strong internal partnerships with data
readers through traditional forms of measurement
owners and line leaders, and creating clear processes for
and highlights ways organizations can mature their
project scoping and prioritization.
analytical approach.
But if you’re new to HR measurement and analytics, this
The book strongly emphasizes grounding analytics work in
book will serve as a good primer for the possibility and
business questions by aligning to key strategic initiatives. As
power of data for the HR function. It’s full of examples and
we know, solving leaders’ most pressing challenges not only
offers thoughtful questions and tactical advice to get you
drives impact but also secures buy-in and creates momentum
approaching HR analytically.
for analytics projects moving forward.
I
n an article for the Harvard As evidence, Veeramachaneni cites identified their main challenges
Business Review,1 MIT his experience participating in a panel as deriving better insights from
of machine learning enthusiasts: “I the data they were collecting and
research scientist Kalyan
polled the audience of about 150 communicating those insights to their
Veeramachaneni details internal clients. Many participants said
people, asking, ‘How many of you
some research into the have built a machine learning model?’ their organization was still ineffective
question, “What would it take Roughly one-third raised their hands. at using talent analytics to drive
for businesses to realize the Next, I asked, ‘How many of you have business decisions.
full potential of their data deployed and/or used this model to
In HR, analytics teams generally do not
generate value, and evaluated it?’ No
repositories with machine have too much data or models that are
one had their hand up.”
learning?” One key challenge too complex. We hear quite often that
he identifies is that “machine In other words, the machine they know better than to hire data
scientists who are only interested in
learning experts often didn’t learning experts wanted to spend
creating beautiful models. Rather, their
build their work around the their time building models, not
first priority is building a team that can
processing massive datasets or
final objective—deriving translate whatever data they have into
translating business problems into
business value.” meaningful reports that drive business
prediction problems.
leaders to act. At a time when many
“In most cases,” Veeramachane- To get more value from their data, organizations are just starting to build
ni states, “predictive models are Veeramachaneni concludes that their talent analytics capabilities, it’s
meant to improve efficiency, in- a good reminder to keep aspirations
companies “need to focus on
crease revenue, or reduce costs. small and to not be discouraged if your
accelerating human understanding of
But the folks actually working analytics efforts don’t yet live up to the
data, scaling the number of modeling
on the models rarely ask ‘What stories you’ve heard about the Googles
questions they can ask of that data in
value does this predictive and IBMs of the world.
a short amount of time, and assessing
model provide, and how can we their implications.” These are valuable 1
Kalyan Veeramachaneni, “Why You’re Not
measure it?’ Asking this ques- principles for talent analytics leaders
Getting Value from Your Data Science,”
Harvard Business Review, 7 December 2016,
tion about value proposition to keep in mind. https://hbr.org/2016/12/why-youre-not-
often leads to a change in the getting-value-from-your-data-science.
original problem formulation, Business impact is not easy to achieve. 2
For more information, see our article at
and asking such questions is In a peer benchmarking conversation2 cebglobal.com/talentdaily/4-trends-in-talent-
analytics/.
often more useful than tweak- at our September ReimagineHR event
ing later stages of the process.” in Miami, talent analytics professionals
Q1 2017 33
A Lesson in Using Predictive Analytics to Drive Retention
By Blakeley Hartfelder and originally appearing on Talent Daily
W
hen we talk to Wright then provides some background what is driving its most important
HR leaders about on this school’s effective process: “In employees to leave the organiza-
2001, the school undertook a new tion—and stop them.
predictive analytics,
technology initiative spurred and
the first thing they usually funded by the No Child Left Behind 3. Anderson has gone beyond analysis
want to do with this new legislation. Using Ultimate Software’s and numbers to develop clear plans of
advanced tool is improve UltiPro, Paulk said the company ‘grew… action when it does discover that a key
employee is thinking of leaving.
retention. That’s definitely and kept head count flat, reduced paper
easier said than done— [processes] by 95%, and increased the
To be able to act on insights and data
especially if you want the time spent on employee development
from predictive retention analytics, the
by 30%. The software also allows
project to actually drive most successful organizations think
staff to manage time and attendance about how they will use those results
results instead of just being from anywhere [and yields] improved even before the analysis starts coming
an interesting research topic. reporting and compliance. in. Who will they share the information
Aliah Wright at the Society for Human with? What steps will HR and managers
“‘The software also helped us avoid the
Resource Management highlights1 the take to encourage employees to stay?
loss of key talent with predictive tools.
success story of one organization And are those steps the same for
It’s really powerful, and it’s astonishing
that had a strong need to retain its all employees?
the results we’ve seen,’ Paulk said.
highly skilled employees and used ‘[The tools] helped us understand our These best practices apply whether you
predictive analytics to help meet that challenges and put the puzzle pieces are managing retention with advanced
goal: “When a top employee at the together.’” analytics or with low-tech tools like stay
Anderson Center for Autism, a private
interviews and career conversations.
school in Staatsburg, NY, handed It looks like Anderson has done a
CEB Corporate Leadership Council™
in her resignation, the school’s HR few things really well, which makes
members can read more about how
department was expecting her. The it a great example of how to apply
to measure and mitigate attrition risk
HR staff had been using a predictive analytics most effectively.
in our HRBP Quarterly.
analytics program to help them gauge
retention. 1. Anderson didn’t just choose to Aliah D. Wright, “How One Company’s Foray
1
1
The link is available to CEB Corporate Leadership Council™ members only. Q1 2017 35
About Talent Analytics Quarterly
We’ve heard your demand for more dedicated
support on talent analytics. Talent Analytics
Quarterly, our quarterly publication featuring
business and functional insights for talent analytics
leaders, is one of a series of new resources we have
created to meet this demand.