Hands-On-Agile-38 6 Scrum Master Interview Questions 2017-03-21
Hands-On-Agile-38 6 Scrum Master Interview Questions 2017-03-21
Hands-On-Agile-38 6 Scrum Master Interview Questions 2017-03-21
expanded with
new questions!
Stefan Wolpers
with Andreea Tomoiaga
This booklet has been formatted to be viewed electronically.
Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 02
Sprint planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Standups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Retrospectives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Agile metrics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
If youre looking to hire a scrum master for your organization, youll find the fol-
lowing 38 (plus 6 new) interview questions useful in identifying the right candidate.
Being cognisant of what to listen for in a candidates answers to these questions
will allow you, as an interviewer, to more quickly understand not only a candidates
familiarity with scrum but also their agile mindset. Given the complexity of ap-
plying agile to any organization, multiple choice questions are insufficient when you
need to discern a candidates agile mindset.
The authors, Stefan Wolpers and Andreea Tomoiaga, share a holistic view on agile
methodologies:
1. This text assumes a familiarity with what scrum is. If youre unfamiliar with agile software develop-
ment frameworks, and scrum in particular, read the Wikipedia entry here.
2
Introduction
The examples and guidance provided in this book reflect this view and the personal
experiences of the authors, and may not be valid for every organization. Please keep
in mind that what works for another organization may not work for yours.
These questions are derived from Stefan Wolpers eleven years of practical experi-
ence with kanban 2 , scrum, XP 3 , and several product discovery frameworks. Stefan
has worked at different times as a product owner, scrum master, and agile coach
with a variety of teams and organizations of all sizes and levels of maturity. On
behalf of clients and employers he has interviewed dozens of candidates throughout
his career for the role of scrum master.
2. Unlike scrum, kanban is not a framework but a methodology, and much less structured than scrum.
Often used together with scrum, kanban introduces the concept of a kanban board to provide a
system for introducing change through incremental improvement.
3. XP (Extreme Programming ) is a lightweight software development methodology.
Many of these questions were first introduced by a blog post written by Stefan
on the Age of Product web site. The post led to a public discussion on LinkedIn,
following which Andreea and he decided it would be helpful to create a handbook
that provides examples of, and guidance interpreting, the answers that they believe
would indicate suitable candidates for the role of scrum master. 38 Scrum Master
Interview Questions to Avoid Hiring Agile Imposters, now in its third edition, is the
outcome of that.
If youd like to be notified when the fourth edition of this book becomes available,
please do not unsubscribe from the newsletter. Your subscription is the only way
we can know that you once downloaded this book.
If you received a copy of this book from a friend or colleague and are interested in
subscribing to the Age of Product newsletter, or if youd simply like to learn more,
visit us at www.age-of-product.com .
4
set
The role of a 1
scrum master
Background
Scrum is not a methodology, but a framework. There are no rules that apply to
each and every scenario just best practices that have worked before in other
organizations.
The best practices of other organizations cannot simply be copied to your own.
Every best practice requires a particular context to work.
A scrum team 4 is an agile team. As somebody hiring for an agile team, you
need to determine for yourself what works for your organization which is a
process, not a destination.
4. A scrum team is a software development team comprising a scrum master, product owner, and
less than 10 members who are cross-functional and can do the work necessary to create a product
increment.
The role of a scrum master is primarily one of leadership and coaching. It is not
a management role.
Being a scrum master does not entail, and should never entail, enforcing
processes.
Scrum is not designed for bean counters, although some metrics are helpful
in understanding the health of a scrum team. Generally, insisting that the team
achieve specific KPI 5 (e.g. commitments vs. velocity) does not help.
5. KPI (Key Performance Indicators) are metrics used to evaluate an organizations success at
reaching targets.
6
The role of a scrum master Background
Scrum doesnt elaborate on the process that enables a product owner to add
valuable, usable, and feasible user stories to the product backlog 6 . Product
discovery using the Design Thinking , Lean Startup , or Lean UX methodologies
may help, but in any case a good scrum master will want the scrum team to
be a part of this process (whether participating in user interviews or running
experiments).
6. A product backlog is a list of items to work on, such as bugs, technical work, and knowledge
acquisition.
7. A sprint is the basic time-measured (and time-restricted) unit of development in scrum. A sprint is
always particular to a scrum team.
8. Sprint reviews are the meetings that follow sprints. During a sprint review, work planned for the
sprint that was not completed during the sprint is discussed, and work that was completed is
demonstrated for the projects stakeholders.
Question 01
A scrum master does not wield any real authority. The scrum team does not report
to them. This question is meant to help reveal whether your candidate understands
that their role is to lead as opposed to manage the team. Asking this question
is also likely to reveal why your candidate is interested in the role of a scrum master
in the first place.
I am the facilitator for the scrum team. Its my job to make them successful.
I am neither a project manager, nor a people manager. I support the scrum
team in achieving self-management. I do not tell people what to do.
I am the scrum teams facilitator as teacher, coach, or mentor, encouraging
them to excel as an agile team.
8
The role of a scrum master Question 02
Question 02
However, although mostly indirect, there are various indicators that may be useful
in determining success:
9. Team velocity is a measurement of work completed within a given time period based upon relevant
comparisons.
Question 03
10. Technical debt is the extra development work that arises when code that is easier or faster to imple-
ment in the short run is used instead of applying the best overall solution.
11. Cycle time is the number of days between starting and ending an experiment suitable to validate or
falsify the motivating hypothesis.
12. Part of the sprint review, the sprint demo is the event during which the scrum team presents work
completed during the sprint to its stakeholders.
10
The role of a scrum master Question 03
of the scrum team, no matter how often this requirement is mentioned in job
advertisements. If a scrum master acts like a scrum mom, their team will never
become self-organizing.
A scrum team must make its own decisions. This almost inevitably results in
failures, dead-ends, and other unplanned excursions when the team is learning
something new. Consequently, in the beginning, a team will need more guidance
than usual from the scrum master and of a different kind than exemplified by
drawing offline boards (see Questions 31 and 32 ) or updating tickets in JIRA 13 . Such
guidance should not, however, become an exercise in protective parenting a team
must be allowed to learn from their failures.
Read more: Scrum Master Anti PatternsBeware of Becoming a Scrum Mom (or
Scrum Pop) .
13. JIRA is a proprietary issues tracking and project management software system published by
Atlassian Pty Ltd.
Question 04
Communicating honestly and openly is the best way for a scrum master to get
the cooperation of a product owner. Both must serve as leaders without being
authoritative, and each depends upon the other working reciprocally for a scrum
teams success (e.g. accomplishing a sprints goal). They are allies with respect to
coaching the organization to become, and remain, agile.
14. A product delivery team comprises everyone involved in delivering a product to market, including the
scrum teams involved.
12
The role of a scrum master Question 05
Question 05
There are two principal reasons why a scrum team should be involved in the product
discovery process as early as possible:
01 The sooner engineers participate in the product discovery process, the lesser
the chances solutions will be pursued that are technically not viable or would
not result in a return on investment.
02 Involving a scrum team early on ensures that the team and its product owner
develop a shared understanding and ownership of what will be built. This helps
significantly with allocating resources to the right issues, maximizing value for
the customer, and mitigating investment risk.
Involving a scrum teams engineers early in the process ensures their buy-in, and
the teams willingness to participate in all phases of a products development. This
motivates the team to participate when making changes necessary to accomplish
the goals defined for each sprint or product release.
Question 06
This question revisits the previous. Again, your candidate should focus on explaining
why involving the scrum team early in the product discovery process is beneficial
for both the product owner and the organization. Essentially, the team either wins
together, or loses together.
Question 07
When answering this question, your candidate should explain that there is no easy
way to ensure access to stakeholders.
14
The role of a scrum master Question 08
Question 08
There are various tactics a scrum master can use to engage stakeholders with
scrum:
Most importantly, a scrum master should live and breathe the principles of the
Agile Manifesto . They should talk to everyone in the organization involved in
building the product, and they should be transparent about what they do. Read
more: 10 Proven Stakeholder Communication Tactics During an Agile Trans-
ition .
Product and engineering teams can demonstrate that scrum mitigates risk (i.e.
the prediction of when new features could be made available), thus contributing
to other departments successes in planning and execution.
A scrum team can be transparent with respect to their work and proactively
Question 09
A good candidate is likely to talk about the necessity of selling agile to the
organization in order to win the hearts and minds of the stakeholders. At the begin-
ning of a transition any organization shows inertia to change, so to overcome this
resistance executives and stakeholders need to know how agile will benefit them
before theyre likely to make a commitment.
16
The role of a scrum master Question 10
Read more: The Big Picture of Agile: How to Pitch the Agile Mindset to Stake-
holders .
There are no right or wrong answers to this question. Best practices need to take
into consideration an organizations culture, size, product maturity, legal and com-
pliance requirements, and the industry its operating in.
Question 10
your candidates experience. We have published a list of agile failure patterns at Age
of Product.
Your candidate should also be familiar with the particular challenge middle man-
agers face in any transition to agile practices. Moving from a command-and-control
style (i.e. managing people and telling them what to do) to a servant-leadership style
thus abandoning Taylors principles 15 is not for everyone.
15. F.W. Taylors principles of scientific management are an industrial-era organization and manage-
ment theory according to which workers are seen as commodities and should be managed as such.
18
set
Background
Estimation and backlog refinement are essential tasks for every scrum team.
Although the product owner (at least officially) is in charge of keeping the
product backlog at peak value delivery, they need the assistance of the entire
team to do so.
dependent upon deliveries from other teams (e.g. API endpoints 16 ) and deliv-
erables from the UX 17 or UI 18 department.
There are two essential ingredients for good scrum team performance:
01 Writing the user story as a team. When something should be built, the
product owner first explains why, and provides the necessary background
(i.e. market intelligence, results from experiments, user interviews, stat-
istical data). Writing user stories 19 , then, is a corresponding and collab-
orative effort involving the entire scrum team. The process should create
a shared understanding of what will be built and for what reasons (the
product owner providing the why, the scrum team detailing the how,
both defining the what), and a shared sense of ownership among team
members.
02 Sharing a definition of ready. In order to ensure a flow of well-drafted
16. An application programming interface (API) endpoint is a URL, and the commands that may be
issued through it, for use within software to instruct other software.
17. UX, or user experience design, is a design practice that focuses on optimizating products for user
satisfaction by designing with consideration for all perceivable aspects. UX encompasses all human-
software interfaces, including visual.
18. UI, or user interface design, is the predominantly visual presentation and interactivity of a software
product, and the design practice concerned with this.
19. An agile software development tool, a user story is a description of the desired functionality for a
requirement.
20
Backlog refinement and estimation Background
user stories for the development process, the scrum team and the product
owner need to agree on a definition of ready (see Question 15 ) for these
stories. This definition is an agreement about what needs to be provided
for a user story to be considered ready for estimation. If even one of the
defined requirements is not met, a user story isnt ready for estimation.
A user story without a previous estimation is an unknown entity and,
therefore, not ready to be made part of a sprint backlog 20 because a scrum
team cant commit to an unknown entity in a sprint. Consequently, the
scrum team must learn to say No.
A well-groomed product backlog probably has user stories detailed for about
two or three sprints, and probably less than half of these stories conform to the
scrum teams definition of ready. There may also be additional user stories that
no one except the product owner is working on at the moment.
20. The sprint backlog is the prioritized list of tasks to be completed during a sprint.
Question 11
A product owner should never turn requirements documents 21 received from stake-
holders into tickets, and a scrum master should never accept such a procedure. Its
nothing more than a waterfall process 22 dressed-up in a pseudo-agile methodology.
21. Requirements documents might include, for example, software requirements specifications (SRS).
22. A waterfall process is a sequential design process that generally adheres to the waterfall model tra-
ditionally used in software development.
22
Backlog refinement and estimation Question 12
Question 12
Information that a scrum master might require from a product owner when wanting
to update their team on the product, or a markets reaction to it, would include any
information that could provide the scrum team with an understanding of why some-
thing is of value to customers. Such information may be of a quantitative nature (e.g.
analytical data describing how a process is utilized) or of a qualitative nature (e.g.
transcripts, screencasts, or videos from a user testing session).
An excellent suggestion on the part of your candidate would be for the scrum team
to participate in gathering qualitative signals by taking part in user interviews.
Question 13
Writing user stories should be a joint effort by all members of a scrum team. If its
not, the team might not feel that they have ownership of the stories inevitably
Question 14
includes a description,
has acceptance criteria defined,
can be delivered within a single sprint,
has all UI deliverables available,
has all (probable) dependencies identified,
has performance criteria defined,
has tracking criteria defined, and
is estimated by the scrum team.
24
Backlog refinement and estimation Question 15
Question 15
The discussion at Question 14 includes an outline of what a good user story should
include. Another approach is to use a framework for user stories such as the
INVEST mnemonic by Bill Wake:
Estimable: You must always be able to estimate the size of a user story.
Small: User stories should not be so big as to become impossible to plan, task,
and prioritize with some certainty.
Testable: The user story (or its related description) must provide the necessary
information to make test development possible.
Question 16
Story points 23 are much better suited to estimating than man-hours in all situ-
ations, but especially in tricky situations, because they accurately reflect both the
23. Story points are units of measure expressing estimates of the overall effort required to fully imple-
ment a product backlog item.
26
Backlog refinement and estimation Question 17
complexity of the task and the effort required to complete it. Using man-hours
instead of story points typically shifts the focus from value creation for customers
to the more traditional project management of costs and budgeting, effectively
imposing a waterfall process.
A good candidate would mention the ongoing discussion in the agile community as
to whether estimations are useful in general. They would also likely point to the no
estimates (e.g. #noestimates ) concept.
Question 17
The product owner for your scrum team tends to add ideas
of all kinds to the product backlog as a reminder to work on
them at a later stage. Over time, this has led to over 200
tickets in various stages. What are your thoughts on this?
Can a scrum team work on 200 tickets?
Any product backlog larger than the scope of two or three sprints is not manage-
able. Misusing a backlog by adding hundreds of items to it is a clear sign that the
product owner needs help from the scrum team or the scrum master to better cope
with an influx of ideas, suggestions, and requirements. A smaller backlog avoids
misallocating resources; a larger backlog is an indication of waste.
Your candidate should make it clear that they would support a product owner in
managing with the size of the product backlog, and with processing input from
stakeholders.
28
set
Sprint planning 3
Background
It used to be that a product owner would explain high value user stories in a
product backlog to the scrum team during sprint planning. The team would
then turn these into more detailed user stories, and estimate the subsequent
stories. There is now, however, a consensus among agile practitioners that
working on these high-level user stories in separate backlog refinement and
estimation meetings before sprint planning actually improves the quality
of the stories and thus the outcome of the teams work.
Sprint planning can create a sense of ownership among a scrum teams mem-
bers by enabling them to make a valid commitment to the items in the sprint
backlog. But this only happens if a teams uncertainty about the quality of the
user stories theyre receiving is eliminated. To be certain that their team can
be certain, a scrum master should run weekly product backlog refinement and
estimation sessions, only allowing into sprint planning those user stories that
meet the teams definition of ready standard.
Sprint planning I: During the first part of sprint planning, a product owner
presents to the scrum team the product owners choice of the most valuable
user stories from the product backlog as a ranked list. The team then selects
from the top of the list down those stories it can commit to delivering by the end
of the sprint taking into consideration their present constraints including,
for example, available capacity, or the required technical tasks that need to be
addressed during the same sprint.
Sprint planning II: During the second part of sprint planning, the scrum team
adds detail to the user stories in the sprint backlog (e.g. splitting the stories
into tasks, identifying parts of the stories that need further clarification, and
agreeing on who will be working on what tasks). The product owner does not
necessarily need to participate in this second part of sprint planning, but does
need to be available to answer questions that the team may have.
A scrum team should usually avoid allocating more than 80% of their capacity
30
Sprint planning Background
to new tasks including user stories, technical tasks, bugs, and probably
spikes 24 . Flow theory 25 shows that a 90% or higher allocation of available ca-
pacity will not lead to a team achieving their peak performance.
Incomplete and poorly prepared user stories seriously hamper the effective-
ness of a scrum team. These stories should never be selected for the sprint
backlog, but instead sorted out during backlog refinement and estimation
meetings.
24. A spike is a small task done to reduce uncertainty about a larger task.
25. Flow theory is the theory that an optimal psychological state can be experienced which results in
immersion and concentrated focus on a task.
Question 18
01 to ensure that the scrum team is involved in the product discovery process at
an early stage;
02 to ensure that the product backlog refinement process is well understood by
both the scrum team and the product owner (this should be supported, for ex-
ample, by the creation of a definition of ready standard for user stories); and
03 to ensure that all user stories are created in a collaborative effort between the
product owner and the scrum team (the goal being a shared understanding of
the user stories and thus joint ownership).
Your candidate should note that although the product owner defines the scope of
the sprint (and the sprints goal), it is the prerogative of the scrum team to address
technical debt and bugs during the same sprint (a team should be able to allocate
up to 25% of their available capacity for this).
32
Sprint planning Question 19
Question 19
revenue increases,
cost cutting benefits achieved by internal process improvements,
increases in customer satisfaction rates (NPS 26 ),
increases in signups for new products, or
positive customer feedback received by the customer care team.
26. NPS (Net Promoter Score) is a customer loyalty metric and registered trademark of Fred
Reichheld, Bain & Company, and Satmetrix Systems.
Question 20
If a scrum team is involved early enough in either user story selection (preferably
by jointly creating the stories with the product owner) or product discovery, a scrum
master will probably not need to provide guidance to see that the most valuable
stories are chosen. Most teams will support the product owners choice of user
stories for a given sprint.
If a team resorts to cherry picking choosing user stories only to satisfy personal
preferences during sprint planning, the backlog refinement process needs to be
seriously inspected. In all likelihood the product owner is choosing user stories that
are not maximizing customer value.
34
Sprint planning Question 21
Question 21
Apart from sprints during which there are critical and urgent tasks to address (such
as fixing a problem that has taken the web site offline), a good rule of thumb is a
15105 allocation of a scrum teams capacity to refactoring, fixing, and research.
Specifically, this means dedicating
A scrum team may, of course, deviate from this when it comes to individual sprints.
But, generally, consistently making these allocations will satisfy both the code qual-
ity and maintenance requirements of most software applications.
Question 22
Question 23
A scrum team has autonomy in how its members choose to distribute tasks, so
it may be that a presumed cherry-picking of tasks by individual team members is
in fact a valuable and crucial part of the teams path to performance. However, if
team members are complaining about how the others are choosing their tasks, the
scrum master needs to address the issue. Additional training might help some team
members accommodate a greater variety of tasks. Or, perhaps, other team mem-
36
Sprint planning Question 24
bers may need to be gently pushed out of their comfort zone so that they will more
readily choose different kinds of tasks over what theyve become accustomed to.
Question 24
Whether an incomplete user story should be added to the sprint backlog depends
upon the teams present concerns and experience with the circumstances that
caused the story to not meet their definition of ready. In the case of an incomplete or
missing user interface (UI) design, for example, if the design team is almost certain
to deliver because they have done so in the past, and if the user story is high value,
and if the story can be accomplished within the sprint despite its UI deliverables
arriving late, and if the team agrees to it then an exception may be acceptable.
exception had been made. Instead, they will most likely view the agile process itself
as having failed.
Your candidates may either accept or reject exceptions to the agile process. But they
should also be able to analyze situations in which exceptions have been made, and
explain the collateral damage that the scrum team may be exposed to.
Question 25
When the member of a scrum team behaves as described, the teams scrum
master needs to take action. Counterproductive behaviour can neither be ignored
nor tolerated if the team is to continue functioning. Effective action is likely to
require a series of escalating steps:
38
Sprint planning Question 25
01 The scrum master should start by addressing the team member privately to
discuss their reservations and, perhaps, more coaching or a longer training
period.
02 Following private discussion, the entire team can be involved by making the
team members reservations a topic of discussion during one or more
retrospectives (see Set 5). This enables the team to offer their support.
03 If there is still no change in the team members attitude, a meeting with the
team member and their manager is advisable.
Situations such as described highlight how scrum is not meant for everybody.
Standups 4
Background
Standups (also known as daily scrums) are meetings well suited to discuss a
current sprints progress: is all going as planned, or does the scrum team need
to adjust?
Standups are a convenient time for a scrum team to meet and communicate
with a projects stakeholders.
Standups are valuable if the scrum team is already collaborating well and the
basics such as the product backlog, and sprint planning are in order.
The more experienced a scrum team, and the better the internal communica-
tions, the more a standup will seem a time consuming ritual of little value.
40
Standups Background
An advanced scrum team may consider virtual meetings instead of real meet-
ings using, for example, a Slack 27 channel.
A two person scrum team does not necessarily need a formal standup meet-
ing for coffee would be a practical alternative.
Standups are not reporting sessions for the benefit of product owners or
participating stakeholders.
Offline boards are valuable: physically taking a card and moving it instills a
certain ownership of a user story. If you have to let go of either an online or off-
line board and youre a co-located team, consider letting go of the online board.
27. Slack is a popular online messaging software for team communication and collaboration.
Question 26
In answering this question, your candidate should exhibit common sense regarding
formal standups. Standups are an important part of scrum, but not all standups
need to be formal. A small, experienced, and co-located team may use a coffee
break for their standup.
However, taking a relaxed, informal approach to standups for a large team with
several junior members would probably achieve nothing if it doesnt first descend
into chaos. For large teams, a formal meeting is needed to provide format and
guidance.
For distributed teams who cant easily meet for coffee, a formal standup is neces-
sary to accommodate technical constraints, and must be scheduled and conducted
in an organized fashion.
42
Standups Question 27
Question 27
When impeded, members of a scrum team should never need to wait, neither for a
standup nor any other event, to ask for help. A team waiting to ask for help is a team
delaying progress. If the more experienced members of a scrum team are waiting
for the next standup before either asking for help or themselves dealing with an
impediment, the scrum master has team-building work to do.
Question 28
There are no official leadership roles in scrum. However, its not uncommon for
some members of a scrum team to assume leadership. This typically happens when
a particular team member possesses superior (technical) expertise, communica-
tion skills, or simply a greater level of engagement.
Its important that when a member of a scrum team assumes leadership this does
not result in other members reporting to them. A scrum master must be vigilant
and intervene if necessary to ensure that all team members communicate and work
together during standups and otherwise in the spirit of scrum.
Question 29
Refer to Question 25 , where addressing this similar attitude and behavioural prob-
lem is discussed at length. Your candidates answers should address those same
points.
44
Standups Question 30
Question 30
Asking this question can easily spark a philosophical discussion about whether
stakeholders should be allowed to participate in a scrum teams standups. Try to
avoid this.
Question 31
Standups for scrum teams whose members are distributed between different
offices or working remotely are not much different to standups for scrum teams
whose members are co-located. The exception is that distributed teams sharing
board activity may require video conferencing when working with offline boards that
mirror each other.
If a scrum team is using online task management or planning software like JIRA,
the teams boards can be online and updates can take place on-screen. This
generally makes it easy for members of a distributed team to follow board activity.
With online boards in place, a Skype or Google Hangouts 28 call will likely be enough
for a distributed team to have their standup.
28. Skype and Google Hangouts are popular computer-based video telephony applications.
46
Standups Question 32
Question 32
In this question, the qualifier kanban is a teaser. Anyone interviewing for the role
of scrum master should be able to draw a simple offline board.
01 Backlog
02 In progress
03 Code review
04 Quality assurance
05 Done
Your candidate should mention that a scrum master is not obligated to provide the
scrum team with an offline board. A board is the responsibility of the team working
with it. The scrum master should, however, provide an introductory workshop on the
subject if no member of the team is familiar with offline boards.
48
set
Retrospectives 5
Background
The blame game is not helpful. During a retrospective, the members of a scrum
team should focus on how to improve a situation and avoid blaming one
another.
29. A retrospective, also known as a sprint retrospective, is a meeting held at the end of a sprint during
which the members of a scrum team may discuss the sprint.
Some scrum teams always include the product owner in their retrospectives,
while other teams insist that the product owner should be expressly invited.
The format for a scrum teams retrospectives should be changed regularly. The
same format should not be run more than twice.
50
Retrospectives Background
What to introduce?
What to keep doing?
What to stop doing?
What to do more of?
What to do less of?
According to Diana Larsen and Esther Derby in their book Agile Retrospectives:
Making Good Teams Great , there are five stages to running a retrospective:
setting the stage, gathering data, generating insights, deciding what to do, and
closing the retrospective.
30. Mad Sad Glad is a retrospective exercise designed to elicit feedback and possible corrective actions.
A retrospective should set SMART 31 goals for action items (the tasks to be
done):
Action items should be specific and measurable (do X more often does
not meet that criteria).
A single member of the scrum team should be made responsible for each
action item.
Each action item should include an estimate of when results can be
expected.
Action items should be placed on a board to make tracking progress visual
and more prominent.
Every new retrospective should start with reviewing the status of the action
items decided upon during the previous retrospective.
Question 33
Only the immediate members of a scrum team should participate in that teams
31. SMART is a mnemonic for various acronyms that generally provide guidelines to be used during the
process of setting goals.
52
Retrospectives Question 34
The only exception is the product owner. Its generally a good idea to include the
product owner in a scrum teams retrospectives because the product owner is a
crucial member of the larger team. But its not mandatory. Some teams may prefer
that the product owner not participate and a teams wishes must always be
considered.
Question 34
Measuring the health of a scrum team that is, getting an idea about current levels
of engagement and satisfaction is useful for identifying trends that may affect
productivity.
During the retrospective, upon completing the questionnaire, the team should
discuss the results with an aim to uncover any concerns or frustrations they may be
harbouring.
Question 35
There are various retrospective formats in common use, and each is meant to
accommodate different situations. Your candidate should have experience applying
more than one of these formats, and should be able to share their logic for having
done so:
54
Retrospectives Question 35
Start doing
Do less of
Do more of
Stop doing
Continue doing
32. This is the format described in the book Agile Retrospectives: Making Good Teams Great by Diana
Larsen and Esther Derby.
Question 36
There are many possibilities for variation that can be used to prevent a retrospective
from being boring, and team members from becoming bored. A different location, a
different format, and shortening or lengthening the allotted time box are just some
of the variations that can be tried. Scrum masters might also use a teams choice
of action items to encourage and structure discussions around issues that matter
to the team, thus creating engagement through acknowledgement. Web sites like
Retromat offer hundreds of different games and exercises to make retrospectives
enjoyable and valuable for the whole team.
Read more: How to Curate Retrospectives for Fun and Profit with Retromat .
56
Retrospectives Question 37
Question 37
During a retrospective, the members of a scrum team are usually expected to pick a
series of action items (tasks to be done). If these action items are subsequently not
completed in a timely manner, the scrum master needs to follow up.
A team might not be completing the action items theyve picked because theyve run
into an external impediment. If this is the case, the scrum master must address the
cause, and the team can then catch up during a later sprint. However, if there is no
external impediment, the problem is likely due to motivation, attitude, or personal
issues within the team. In this latter case, the scrum master needs to provide the
offending team members with sufficient encouragement or motivation to overcome
the problem and then see that they deliver on their commitments.
If a team is not completing the action items theyve picked and the problem ulti-
mately cannot be resolved, picking action items becomes a useless exercise and the
team will suffer as a result.
Question 38
A scrum master is expected to follow up on the action items (tasks to be done) that
members of a scrum team pick during their teams retrospectives. A good way for a
scrum master to do this is to start talking about the status of the action items picked
during the last retrospective before picking new ones by initiating a discussion at the
beginning of each new retrospective. If this discussion uncovers action items picked
during a previous retrospective that havent been completed as expected, the team
needs to understand why and prevent it from happening again.
58
set
Agile metrics 6
Background
Metrics in an agile context are not used to manage, and certainly not micro-
manage, an individual (particularly the creative worker) contrary to tradi-
tional command-and-control management structures.
The metrics most suitable to agile reflect either a teams progress in becoming
agile or the organizations progress in becoming a learning organization.
The metrics that the scrum master should be tracking are only those that apply
to the scrum team. Metrics that measure the individual should be ignored.
Parameters that are easy to follow should not be measured for that reason
60
Agile metrics Question 39
Question 39
Are there any standard metrics that you would track? If so,
which, and for what purpose?
When tracking metrics at the organizational level, the effects of any process or
change can be measured quantitatively with a metrics scoring model. The effects
measured would include
the ability to respond to change and produce valuable code (e.g. the capacity to
break down features);
the duality of planning at both release and sprint;
the flexibility to adapt to changing facts, time boxes, and continuous delivery;
the frequency with which scrum teams are bidding on stories, and whether the
teams are exercising any freedom in their approach to solving them;
the creation and growth of a culture of shared learning; and
the continuity with which features are delivered.
The design of a metrics scoring model should take into account the agile maturity
of the organization such that qualitative aspects may be quantified, and thus
compared. If the metrics scoring model can be designed before introducing an
agile framework into an organization, the status quo should be surveyed in order
to establish a baseline against which to measure these effects and track their
evolution over time.
Any metrics useful to measuring the effects of a relevant process or change should
be recorded regularly, throughout the agile journey. Surveying the members of an
organizations scrum teams is a good start.
Question 40
If a scrum team is exhibiting a volatile velocity and consistently failing to meet their
commitments, it suggests that velocity is being used as the prevalent metric for
measuring that teams progress. Your candidate should mention this, and talk about
the notoriety of velocity as an industry metric for measuring a teams progress.
They should further be able to explain why velocity is altogether a doubtful agile
metric, and point out that quantitative metrics are not ideally suited to measuring a
teams progress in mastering scrum.
There are many factors that may make a scrum teams velocity volatile:
62
Agile metrics Question 40
Another common cause for a scrum team to consistently fail in meeting their
commitments is that the teams commitments are frequently too aggressive. This
might indicate that the user stories are being poorly prepared (e.g. not meeting the
teams definition of ready), thus making the stories difficult for the team to estimate.
Conversely, the projects being given the team might suffer from poorly documented
legacy code, excessive technical debt, or just too much buggy and poorly written
code all of which make estimation a gamble.
Your candidate should not align themselves with the fallacy that an agile adoption
is working only because a scrum teams commitment and velocity are aligned.
Cooking the agile books is easy to do!
Question 41
The purpose of qualitative metrics in agile is to gain insight into how one or more of
an organizations scrum teams are progressing with agile.
There are several self-assessment tests available that a scrum team can regularly
run to collect qualitative metrics about their implementation of scrum the Scrum
Checklist by Henrik Kniberg is a good example. The interval to test via self-assess-
ment is every 412 weeks, with teams of lesser maturity running their tests at the
lower end of this range. The individual values recorded by these tests are not very
important, but the trend over time is. To visualize these trends, a scrum master will
need to aggregate the results in the case of Henrik Knibergs checklist, an agile
practice map 33 may be created over time.
While self-assessment tests like Henrik Knibergs checklist are usually team
exercises for recording implementation metrics, sentiment metrics are best cap-
tured by running anonymous opinion polls to ensure the participation of the more
introverted team members. Using opinion polls, typical questions for recording sen-
timent metrics include
33. An agile practice map is a method of organizing user stories to prevent failures that may be caused
by incremental delivery.
64
Agile metrics Question 41
Its best to run opinion polls after every sprint; these polls should only require a
few seconds to complete. As with the self-assessment tests, the individual values
recorded by running anonymous opinion polls are not very important its the trend
over time that matters. Trends derived from these polls are great talking points
during a teams retrospectives.
Concerning metrics in general, your candidate should support the Agile Manifesto
and its principle of transparency: all metrics should be available to all members of
a scrum team, and largely also to those working in the product delivery organiza-
tion 34 generally.
Read more: Agile MetricsThe Good, the Bad, and the Ugly.
34. A product delivery organization is effectively everyone within an organization whos involved with
getting a product to market.
How to kick-off a 7
transition to scrum
Background
Every transition to scrum should start with understanding the why: why
should the organization become agile?
66
How to kick-off a transition to scrum Background
The recognized benefits of transitioning to scrum and other agile practices are
Agile and its benefits need to be sold to an organization before beginning its
transition to scrum agile is not everybodys darling, and personal agendas
will be affected by a successful transition.
izations products and services, team size, and current project management
practices.
The first step of any transition to scrum is the creation of the first scrum team.
There is a huge difference between doing Agile and being agile. Transitioning
to scrum successfully means becoming and being agile.
Creating a happy agile island for the product and engineering department
is a valid objective. However, in comparison to breaking up functional silos
68
How to kick-off a transition to scrum Question 42
Question 42
If you dont know where you are going, any road will get you there. Your candidate
should understand that an agile transition needs to have an objective and a goal
which means planning ahead.
To prepare for kicking off a transition to scrum is to listen and observe: your
candidate should express interest in interviewing as many team members and
stakeholders as possible, before jumping into action. These interviews should
include everyone, no matter their role engineers, quality assurance (QA) profes-
sionals, UX and UI designers, product managers in order to identify the patterns
underlying current problems, failures, and dysfunction within the organization.
Merging those patterns with the most pressing technical and business issues will
identify the most likely objectives for the first scrum teams. This observation phase,
during which a scrum master performs their interviews, will typically require
between four and eight weeks depending upon the size and structure of the
organization.
The training of future team members and stakeholders should commence and run
parallel to the interviews.
Creating the first scrum teams from the existing engineering and product depart-
ments is the second step in kicking off a transition to scrum.
Your candidate should be able to sketch the rough plan of a transition, and address
common issues that might arise during kickoff.
Question 43
When an organization is transitioning to scrum and at the same time dealing with
significant organizational, business, and technical problems, the founding members
of its scrum teams should be volunteers who fully understand the challenge ahead
of them, rather than people pressed into service. The best volunteers are those
eager to prove that becoming agile is the most effective way to reach an objective.
Candidates for the role of scrum master should be astute enough to suggest inviting
every member of the product delivery team, as well as the C-level executives spon-
soring the transition, to a kickoff meeting. The objective of a transition kickoff
70
How to kick-off a transition to scrum Question 44
meeting is to support the members of the engineering and product teams in how
they choose to self-organize into the first cross-functional scrum teams. Transition
kickoff meetings can last a few hours or several days, depending upon the circum-
stances of a particular organization.
Despite the importance of the kickoff meeting to a scrum transition, going much
deeper into its structure will take too much time from the interview. Its more
important that your candidates present a brief roadmap of what should happen next
for the newly formed scrum teams.
Although somewhat dependent upon the existing skills, experience, and training
of the members of an organizations new scrum teams, your candidates should
anticipate having to teach the very basics of scrum following a kickoff meeting.
They might propose doing this through a series of workshops or on-the-job training
with exercises in product backlog refinement, writing user stories, estimating, and
creating offline boards.
Question 44
The first critical issue for the majority of newly formed scrum teams is the existing
legacy product backlog. Answers to this question need not reference Tuckmans
It is a rare occasion for a scrum master to start from scratch with a brand new team
and no existing product even more so in a nascent organization like a startup.
Most often, its an existing product delivery organization with existing products and
services who will go agile. For these cases your candidate should point out that
refining the legacy product backlog is the practical first step.
72
How to use these
interview questions
At the interview, move as fast as possible from the theoretical to the practical. Be
careful not to waste too much time discussing the advantages of agile methodolo-
gies or other likely opinionated topics. Two or three questions from each of the sets
in this handbook will provide more than enough ground for an engaging 60 minute
conversation.
Scrum has always been a hands-on business, so your candidate needs to have a
passion for getting their hands dirty if theyre going to be successful. Although the
rules are basic, building an effective team from a group of individuals with different
backgrounds, levels of engagement, and personal agendas is a complex task as
is often the case when people and communication are involved.
The larger an organization, the more levels of management there are, the more
likely there will be resistance or possibly even failure when applying agile. In these
circumstances you would be wise to choose the pragmatic veteran who has exper-
ienced failure at other organizations (and who carries the scars to prove it) over a
junior scrum master.
37. An industry certification provided by (and trademarked by) Scrum Alliance, Inc.
74
About the authors
Stefan Wolpers
Author
/in /stefanwolpers
Despite originally studying chemistry Stefan has
stefan @age-of-product.com never worked in a laboratory, and instead
continued his education in business administra-
tion and law. Following school he discovered a
passion for software and, in 1996, launched the
38. LeSS ( Large-Scale Scrum) is a product development framework that extends scrum with scaling
rules and guidelines.
76
About the authors
Andreea Tomoiaga
Contributor
78
Other publications
By Stefan Wolpers. Published and distributed by Berlin Product People GmbH. First published 2017 March 21.
Edited by Candace Chapman and Jourdan Ritchey. Typesetting and design by Jourdan Ritchey.
Age of Product, its associated logos and images, and the Hands-on Agile Fieldnotes series title and its associated logos
and images, are trademarks of Berlin Product People GmbH. All rights reserved.
No part of this publication or its text may be made publicly available or, excepting personal use, reproduced or distributed
or translated into other languages without the prior written permission of Berlin Product People GmbH. If you would like
permission to reproduce or otherwise publish any part or all of this publication or its text, including translations thereof,
write to us at [email protected] addressed Attention: Permissions Request.
Trademarked names, logos, and images other than those belonging to Berlin Product People GmbH may appear in this
publication. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image, we use the
names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of
infringing upon the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms,
even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to
proprietary rights.
The advice and information included in this publication was carefully researched and written and believed true and
accurate as of the date first published. However, neither the author nor the editor nor the publisher can accept legal
responsibility for the accuracy thereof, or for any errors or omissions that may have been made. The publisher makes no
warranty, express or implied, with respect to the material herein.
Borsigstrasse 8
10115 Berlin
Germany