A Survey of Executive Coaching Practices
A Survey of Executive Coaching Practices
A Survey of Executive Coaching Practices
coaching
Liability insurance 1.56 .50 1.38 .49 .18
Note. N = 428 for all except demographic variables, where Ns range from 391 (hourly
fees) to 424 (gender); N = 172 psychologists and 256 nonpsychologists. Psychologist
coded 1 = nonpsychologist, 2 = psychologist. r = correlation coefcient, where a positive
value indicates a higher mean for psychologists than nonpsychologists. Education coded:
1 = high school, 2 = associate degree, 3 = bachelors degree, 4 = masters degree,
5 = doctorate. Gender coded: 1 = male, 2 = female. Race coded: 1 = not Caucasian,
2 =Caucasian. Percentage of income from coaching coded: 1 =025%, 2 =2550%, 3 =
5075%, 4 =75100%. Management experience, liability insurance, licensed psychologist,
certied coach coded: 1 = No, 2 = Yes.
a
1 = never, 2 = rarely, 3 = occasionally, 4 = sometimes, 5 = often, 6 = always.
b
1 = rarely, 2 = occasionally, 3 = sometimes, 4 = often, 5 = always.
p < .05.
p < .01.
p < .001.
In Table 2, we compare coaching methods for psychologist and
nonpsychologist coaches. Results indicate that psychologists were more
likely than nonpsychologists to conduct coaching in a face-to-face set-
ting, and less likely to coach by phone. Generally psychologists reported
fewer coaching sessions with the average coaching participant than did
nonpsychologists (e.g., 38% of nonpsychologist coaches reported often
JOYCE E. BONO ET AL. 371
TABLE 2
Coaching Methods for Psychologists and Nonpsychologists
Psychologists Nonpsychologists
Variable Mean SD Mean SD r
Medium
Telephone 3.37 1.13 3.70 1.17 .14
p < .05.
p < .01.
p < .001.
holding 2130 sessions with a client as compared to 19% of psycholo-
gists). In comparing the scientic or philosophical approaches of psychol-
ogist and nonpsychologist coaches, we found that nonpsychologists were
more likely than psychologists to use behavior modication, neurolin-
guistic programming, and psychoanalytic or psychodynamic techniques.
There were no differences between the two types of coaches in their use
of cognitive-behavioral or goal-setting approaches.
Table 3 presents results comparing the assessment tools and activi-
ties used by psychologist and nonpsychologist coaches, along with the
topics they address in coaching. Results indicate that nonpsychologists
were signicantly less likely to interview the client (or his or her super-
visor or peers) than were psychologist coaches. Psychologists were also
more likely to use aptitude or ability tests and multisource ratings than
nonpsychologists, and less likely to use interest inventories. Psycholo-
gists were also more likely to have access to performance data on the
individual being coached than were nonpsychologists. We found no
372 PERSONNEL PSYCHOLOGY
TABLE 3
Assessment Tools, Activities, and Topics for Psychologists and Nonpsychologists
Psychologists Nonpsychologists
Variable Mean SD Mean SD r
Assessment tools
Interview with client 4.80 .60 4.64 .89 .10
Activities
Building rapport 4.65 .78 4.41 .97 .13
p < .05.
p < .01.
p < .001.
JOYCE E. BONO ET AL. 373
TABLE 4
Methods to Evaluate Effectiveness Used by Psychologists and Nonpsychologists
Psychologists Nonpsychologists
Variable Mean SD Mean SD r
Client reports
Satisfaction with process 4.16 .98 4.44 .72 .17
Boss reports
Satisfaction with process 3.17 1.24 3.15 1.40 .01
Satisfaction with outcomes 3.53 1.27 3.35 1.37 .07
Attainment of written goals 3.25 1.32 3.12 1.41 .05
Attainment of implicit goals 3.11 1.29 3.09 1.32 .01
Behavior change 3.44 1.21 3.24 1.28 .08
Learning or skill development 3.08 1.25 3.05 1.31 .01
Others reports (peer, HR)
Behavior change 2.87 1.26 2.60 1.31 .10
p < .05.
p < .01.
p < .001.
signicant differences between the two types of coaches in most of their
activities (e.g., increasing motivation, developing insight, teaching a new
skill or holding the coaching participant accountable for results), but we
did nd that psychologist coaches were more likely to focus on building
rapport with the person being coached, more likely to assist clients with
applying new skills at work, and more likely to set goals for behavior
change with their client. With respect to the topics of coaching, there was
considerable overlap between psychologist and nonpsychologist coaches.
374 PERSONNEL PSYCHOLOGY
The top three topics addressed by psychologist coaches were leadership,
interpersonal skills, and management style, and the top three topics ad-
dressed by nonpsychologist coaches were communication, leadership, and
interpersonal skills. There were a number of areas (e.g., stress manage-
ment, time management, sales or nancial performance, mentoring, and
planning) that were more likely to be engaged in by nonpsychologist
coaches.
Table 4 compares methods of evaluating effectiveness for psychologist
and nonpsychologist coaches; fewdifferences were found. Generally, psy-
chologists were less likely than nonpsychologists to depend on the reports
of the individuals they coached (e.g., satisfaction with process, increased
self-understanding) to evaluate coaching effectiveness. They were also
more likely to use others reports (e.g., HR or peers) of behavior change
to evaluate the coaching effectiveness.
Comparing Psychologists by Discipline
Our next set of analyses examines consistency (or inconsistency)
among psychologists, comparing coach practices and methods across sub-
disciplines of psychology. Tables 58 replicate the analyses presented in
Tables 14 but use data only from psychologists, reporting overall F tests
from ANOVAS to compare types of psychologists. There were enough
coaches in our sample to do a comparison across four psychological
disciplines: industrial-organizational psychologists (N = 83), counseling
psychologists (N = 39), clinical psychologists (N = 30), and person-
ality/social psychologists (N = 20). Table 5 results reveal statistically
signicant differences in age (counseling and personality/social psychol-
ogists tended to be older), education (counseling and personality/social
psychologists were less likely to have a doctorate: 50% counseling, 65%
personality/social, 81% industrial-organizational, and 83% clinical), and
gender (70% female for counseling, 68% personality/social, 49%
industrial-organizational, and 30% clinical). There were also differences
between types of psychologists on all the elements of coaching practices
examined in Table 5, including licensure, certication, percent income
obtained from coaching, and whether they carried liability insurance.
Psychologists also varied in the extent to which they tended to coach
CEOs and entrepreneurs and in how they obtained client referrals.
Table 6 presents results comparing coaching methods; few signicant
differences were found. There were also only a few signicant differences
between types of psychologists in their use of assessment tools and topics
addressed in coaching (see Table 7), but some statistically signicant dif-
ferences were found for activities (i.e., teaching a new skill, assisting with
skill application, and holding a coaching participant accountable). Table 8
JOYCE E. BONO ET AL. 375
T
A
B
L
E
5
D
e
s
c
r
i
p
t
i
v
e
I
n
f
o
r
m
a
t
i
o
n
C
o
m
p
a
r
i
n
g
D
i
s
c
i
p
l
i
n
e
s
W
i
t
h
i
n
P
s
y
c
h
o
l
o
g
y
C
l
i
n
i
c
a
l
C
o
u
n
s
e
l
i
n
g
I
n
d
u
s
t
r
i
a
l
&
o
r
g
a
n
i
z
a
t
i
o
n
a
l
P
e
r
s
o
n
a
l
i
t
y
&
s
o
c
i
a
l
V
a
r
i
a
b
l
e
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
F
C
o
a
c
h
d
e
m
o
g
r
a
p
h
i
c
s
A
g
e
5
1
.
9
7
1
0
.
1
3
4
7
.
3
2
8
.
5
4
4
5
.
5
4
1
0
.
7
4
5
2
.
8
9
1
0
.
6
3
4
.
5
2
E
d
u
c
a
t
i
o
n
4
.
8
0
.
4
8
4
.
3
1
.
8
3
4
.
8
0
.
4
4
4
.
3
0
1
.
1
3
7
.
2
0
R
a
c
e
.
9
0
.
3
1
.
8
7
.
3
4
.
9
5
.
2
1
.
8
5
.
3
7
1
.
1
5
S
e
x
1
.
3
0
.
4
7
1
.
6
6
.
4
8
1
.
4
9
.
5
0
1
.
7
0
.
4
7
4
.
0
7
M
a
n
a
g
e
m
e
n
t
e
x
p
e
r
i
e
n
c
e
1
.
9
3
.
2
5
1
.
9
7
.
1
6
1
.
9
3
.
2
6
1
.
8
9
.
3
2
.
5
6
Y
e
a
r
s
c
o
a
c
h
e
d
1
4
.
4
0
7
.
7
9
1
0
.
7
8
6
.
9
4
1
0
.
4
8
8
.
8
5
1
3
.
6
5
1
0
.
2
5
2
.
0
9
C
o
a
c
h
p
r
a
c
t
i
c
e
i
n
f
o
r
m
a
t
i
o
n
H
o
u
r
l
y
f
e
e
s
$
2
5
0
8
3
.
0
0
$
2
4
3
9
7
.
0
5
$
2
8
5
2
9
9
.
4
6
$
1
9
9
1
7
1
.
5
6
.
8
2
%
i
n
c
o
m
e
f
r
o
m
c
o
a
c
h
i
n
g
2
.
4
3
1
.
1
0
2
.
3
8
1
.
3
3
1
.
6
1
.
8
1
2
.
1
0
1
.
1
2
7
.
4
5
L
i
a
b
i
l
i
t
y
i
n
s
u
r
a
n
c
e
1
.
8
3
.
3
8
1
.
5
1
.
5
1
1
.
5
2
.
5
0
1
.
3
9
.
5
0
4
.
2
1
L
i
c
e
n
s
e
d
p
s
y
c
h
o
l
o
g
i
s
t
.
7
0
.
4
7
.
5
4
.
5
1
.
3
4
.
4
8
.
2
8
.
4
6
5
.
3
1
C
e
r
t
i
e
d
c
o
a
c
h
.
2
3
.
4
3
.
2
1
.
4
1
.
0
7
.
2
6
.
2
8
.
4
6
2
.
9
0
%
c
o
a
c
h
i
n
g
i
n
U
.
S
.
8
3
.
0
7
3
3
.
2
8
7
5
.
8
9
3
9
.
3
7
8
0
.
1
3
3
3
.
7
7
5
5
.
5
0
4
6
.
5
4
2
.
7
8
P
a
r
t
i
c
i
p
a
n
t
j
o
b
r
o
l
e
s
a
C
E
O
/
p
r
e
s
i
d
e
n
t
4
.
2
7
.
9
4
3
.
4
1
1
.
3
9
2
.
9
5
1
.
3
8
3
.
6
5
1
.
5
0
7
.
5
8
V
P
/
d
i
r
e
c
t
o
r
4
.
7
7
.
8
2
4
.
2
1
1
.
2
2
4
.
1
9
1
.
3
1
4
.
3
0
1
.
2
2
1
.
7
9
M
i
d
-
l
e
v
e
l
m
a
n
a
g
e
r
4
.
4
3
.
5
7
4
.
0
3
1
.
0
4
4
.
1
4
1
.
2
4
4
.
3
0
.
8
7
.
9
5
E
n
t
r
y
-
l
e
v
e
l
o
r
s
u
p
e
r
v
i
s
o
r
2
.
7
0
1
.
1
8
3
.
0
3
1
.
3
9
3
.
2
4
1
.
5
0
3
.
0
0
1
.
2
6
1
.
1
4
E
n
t
r
e
p
r
e
n
e
u
r
3
.
9
3
.
9
6
3
.
3
5
1
.
4
2
2
.
5
1
1
.
3
8
3
.
4
2
1
.
5
0
9
.
8
1
c
o
n
t
i
n
u
e
d
376 PERSONNEL PSYCHOLOGY
T
A
B
L
E
5
(
c
o
n
t
i
n
u
e
d
)
C
l
i
n
i
c
a
l
C
o
u
n
s
e
l
i
n
g
I
n
d
u
s
t
r
i
a
l
&
o
r
g
a
n
i
z
a
t
i
o
n
a
l
P
e
r
s
o
n
a
l
i
t
y
&
s
o
c
i
a
l
V
a
r
i
a
b
l
e
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
F
S
o
u
r
c
e
o
f
p
a
r
t
i
c
i
p
a
n
t
r
e
f
e
r
r
a
l
b
D
i
r
e
c
t
c
o
n
t
a
c
t
f
r
o
m
p
a
r
t
i
c
i
p
a
n
t
2
.
9
7
1
.
0
7
3
.
3
6
1
.
1
8
3
.
1
0
1
.
1
8
3
.
8
5
1
.
0
9
3
.
0
0
R
e
f
e
r
r
e
d
b
y
m
a
n
a
g
e
r
3
.
5
7
.
6
3
2
.
9
2
1
.
0
4
3
.
0
0
1
.
2
0
3
.
0
0
1
.
2
6
2
.
4
4
R
e
f
e
r
r
e
d
b
y
H
R
3
.
4
7
.
8
6
2
.
9
0
1
.
2
7
3
.
2
7
1
.
1
7
2
.
4
5
1
.
1
0
4
.
1
7
C
o
a
c
h
c
o
n
t
a
c
t
e
d
p
a
r
t
i
c
i
p
a
n
t
2
.
2
7
1
.
0
2
2
.
1
5
1
.
1
8
1
.
6
7
1
.
0
0
1
.
8
0
1
.
2
4
3
.
1
6
N
o
t
e
.
N
=
1
7
2
f
o
r
a
l
l
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
P
s
y
c
h
o
l
o
g
i
s
t
.
E
d
u
c
a
t
i
o
n
c
o
d
e
d
:
1
=
h
i
g
h
s
c
h
o
o
l
,
2
=
a
s
s
o
c
i
a
t
e
d
e
g
r
e
e
,
3
=
b
a
c
h
e
l
o
r
s
d
e
g
r
e
e
,
4
=
m
a
s
t
e
r
s
d
e
g
r
e
e
,
5
=
d
o
c
t
o
r
a
t
e
.
S
e
x
c
o
d
e
d
:
1
=
m
a
l
e
,
2
=
f
e
m
a
l
e
.
R
a
c
e
c
o
d
e
d
:
1
=
n
o
t
C
a
u
c
a
s
i
a
n
,
2
=
C
a
u
c
a
s
i
a
n
.
P
e
r
c
e
n
t
a
g
e
o
f
i
n
c
o
m
e
f
r
o
m
c
o
a
c
h
i
n
g
c
o
d
e
d
:
1
=
0
2
5
%
,
2
=
2
5
5
0
%
,
3
=
5
0
7
5
%
,
4
=
7
5
1
0
0
%
.
M
a
n
a
g
e
m
e
n
t
e
x
p
e
r
i
e
n
c
e
,
l
i
a
b
i
l
i
t
y
i
n
s
u
r
a
n
c
e
,
l
i
c
e
n
s
e
d
p
s
y
c
h
o
l
o
g
i
s
t
,
c
e
r
t
i
e
d
c
o
a
c
h
c
o
d
e
d
:
1
=
N
o
,
2
=
Y
e
s
.
D
e
g
r
e
e
s
o
f
f
r
e
e
d
o
m
f
o
r
F
t
e
s
t
s
(
3
,
1
6
8
)
.
a
1
=
n
e
v
e
r
,
2
=
r
a
r
e
l
y
,
3
=
o
c
c
a
s
i
o
n
a
l
l
y
,
4
=
s
o
m
e
t
i
m
e
s
,
5
=
o
f
t
e
n
,
6
=
a
l
w
a
y
s
.
b
1
=
r
a
r
e
l
y
,
2
=
o
c
c
a
s
i
o
n
a
l
l
y
,
3
=
s
o
m
e
t
i
m
e
s
,
4
=
o
f
t
e
n
,
5
=
a
l
w
a
y
s
.
p
<
.
0
5
.
p
<
.
0
1
.
p
<
.
0
0
1
.
JOYCE E. BONO ET AL. 377
T
A
B
L
E
6
C
o
m
p
a
r
i
s
o
n
o
f
C
o
a
c
h
i
n
g
M
e
t
h
o
d
s
A
c
r
o
s
s
D
i
s
c
i
p
l
i
n
e
s
o
f
P
s
y
c
h
o
l
o
g
y
C
l
i
n
i
c
a
l
C
o
u
n
s
e
l
i
n
g
I
n
d
u
s
t
r
i
a
l
&
o
r
g
a
n
i
z
a
t
i
o
n
a
l
P
e
r
s
o
n
a
l
i
t
y
&
s
o
c
i
a
l
V
a
r
i
a
b
l
e
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
F
M
e
d
i
u
m
T
e
l
e
p
h
o
n
e
3
.
2
7
1
.
1
7
3
.
5
9
1
.
1
6
3
.
3
0
1
.
0
9
3
.
4
0
1
.
1
9
.
6
8
F
a
c
e
t
o
f
a
c
e
4
.
4
0
.
8
9
3
.
8
7
1
.
2
6
4
.
1
9
.
8
5
4
.
1
5
1
.
1
8
1
.
6
7
E
-
m
a
i
l
3
.
3
7
1
.
2
5
3
.
0
0
1
.
3
8
2
.
8
9
1
.
1
6
2
.
9
5
1
.
3
2
1
.
0
8
W
e
b
s
i
t
e
/
c
h
a
t
1
.
3
0
.
7
0
1
.
1
3
.
5
7
1
.
1
1
.
3
8
1
.
2
5
.
6
4
1
.
2
2
V
i
d
e
o
c
o
n
f
e
r
e
n
c
e
1
.
2
3
.
5
0
1
.
2
8
.
8
6
1
.
1
9
.
5
1
1
.
2
0
.
5
2
.
2
1
T
r
a
d
i
t
i
o
n
a
l
m
a
i
l
1
.
3
7
.
8
9
1
.
2
1
.
5
7
1
.
3
4
.
6
5
1
.
3
5
.
5
9
.
4
5
T
y
p
i
c
a
l
n
u
m
b
e
r
o
f
s
e
s
s
i
o
n
s
5
o
r
f
e
w
e
r
3
.
0
0
1
.
1
5
3
.
2
1
1
.
4
7
3
.
3
4
1
.
6
3
3
.
3
5
1
.
7
9
.
3
9
6
1
0
3
.
9
7
1
.
0
3
3
.
5
1
1
.
4
7
3
.
7
0
1
.
4
0
3
.
1
0
1
.
3
7
1
.
8
1
1
1
2
0
4
.
2
3
1
.
1
4
3
.
5
9
1
.
4
3
3
.
1
7
1
.
4
8
3
.
0
5
1
.
8
2
4
.
5
2
2
1
3
0
3
.
2
7
1
.
5
7
2
.
9
5
1
.
7
9
2
.
3
5
1
.
4
9
2
.
6
5
1
.
6
9
2
.
8
9
S
c
i
e
n
t
i
c
/
p
h
i
l
o
s
o
p
h
i
c
a
l
a
p
p
r
o
a
c
h
B
e
h
a
v
i
o
r
m
o
d
i
c
a
t
i
o
n
2
.
5
0
1
.
2
0
3
.
3
1
1
.
4
5
3
.
0
0
1
.
4
2
2
.
7
5
1
.
6
5
1
.
9
9
C
o
g
n
i
t
i
v
e
b
e
h
a
v
i
o
r
a
l
3
.
8
0
1
.
0
0
3
.
9
2
1
.
1
8
3
.
8
9
1
.
1
5
3
.
4
0
1
.
1
4
1
.
1
4
P
r
o
c
e
s
s
/
f
a
c
i
l
i
t
a
t
i
o
n
o
r
i
e
n
t
e
d
4
.
2
0
.
6
6
3
.
9
5
1
.
1
2
3
.
9
0
.
9
3
4
.
1
0
.
9
7
.
8
4
G
o
a
l
s
e
t
t
i
n
g
4
.
5
0
.
6
8
4
.
5
4
.
7
2
4
.
2
7
.
7
3
4
.
5
0
.
8
3
1
.
7
1
N
e
u
r
o
l
i
n
g
u
i
s
t
i
c
p
r
o
g
.
2
.
3
3
1
.
9
0
2
.
1
5
1
.
6
3
2
.
3
4
2
.
0
8
1
.
6
5
1
.
1
8
.
7
8
P
s
y
c
h
o
a
n
a
l
y
t
i
c
/
d
y
n
a
m
i
c
2
.
5
0
1
.
8
2
2
.
1
3
1
.
3
6
2
.
4
7
2
.
0
4
2
.
4
0
1
.
8
5
.
3
5
S
k
i
l
l
t
r
a
i
n
i
n
g
3
.
5
0
1
.
1
7
3
.
6
2
1
.
2
3
3
.
1
8
1
.
2
2
2
.
9
5
1
.
4
7
1
.
8
7
N
o
t
e
.
N
=
1
7
2
f
o
r
a
l
l
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
.
R
e
s
p
o
n
s
e
s
w
e
r
e
c
o
d
e
d
u
s
i
n
g
t
h
e
f
o
l
l
o
w
i
n
g
s
c
a
l
e
:
1
=
r
a
r
e
l
y
,
2
=
o
c
c
a
s
i
o
n
a
l
l
y
,
3
=
s
o
m
e
t
i
m
e
s
,
4
=
o
f
t
e
n
,
5
=
a
l
w
a
y
s
.
D
e
g
r
e
e
s
o
f
f
r
e
e
d
o
m
f
o
r
F
t
e
s
t
s
(
3
,
1
6
8
)
.
p
<
.
0
5
;
p
<
.
0
1
.
378 PERSONNEL PSYCHOLOGY
T
A
B
L
E
7
C
o
m
p
a
r
i
s
o
n
o
f
A
s
s
e
s
s
m
e
n
t
T
o
o
l
s
a
n
d
O
u
t
c
o
m
e
A
s
s
e
s
s
m
e
n
t
A
c
r
o
s
s
D
i
s
c
i
p
l
i
n
e
s
o
f
P
s
y
c
h
o
l
o
g
y
C
l
i
n
i
c
a
l
C
o
u
n
s
e
l
i
n
g
I
n
d
u
s
t
r
i
a
l
&
o
r
g
a
n
i
z
a
t
i
o
n
a
l
P
e
r
s
o
n
a
l
i
t
y
&
s
o
c
i
a
l
V
a
r
i
a
b
l
e
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
F
A
s
s
e
s
s
m
e
n
t
t
o
o
l
s
I
n
t
e
r
v
i
e
w
w
i
t
h
c
l
i
e
n
t
4
.
8
7
.
3
5
4
.
8
7
.
5
2
4
.
7
0
.
7
5
5
.
0
0
.
0
0
1
.
8
7
I
n
t
e
r
v
i
e
w
w
i
t
h
s
u
p
e
r
v
i
s
o
r
4
.
0
0
1
.
0
8
3
.
5
1
1
.
3
9
3
.
6
4
1
.
3
3
3
.
1
0
1
.
3
3
1
.
9
9
I
n
t
e
r
v
i
e
w
w
i
t
h
p
e
e
r
s
3
.
6
3
.
8
9
3
.
1
0
1
.
2
3
3
.
1
7
1
.
2
6
2
.
7
5
1
.
2
9
2
.
3
4
I
n
t
e
r
v
i
e
w
w
i
t
h
f
a
m
i
l
y
1
.
6
3
.
8
1
1
.
6
9
1
.
0
3
1
.
4
5
.
8
6
1
.
5
0
1
.
0
5
.
7
7
A
b
i
l
i
t
y
o
r
a
p
t
i
t
u
d
e
t
e
s
t
2
.
3
7
1
.
2
5
2
.
0
8
1
.
2
9
2
.
5
4
1
.
4
6
1
.
9
5
1
.
3
6
1
.
6
2
I
n
t
e
r
e
s
t
i
n
v
e
n
t
o
r
y
2
.
2
7
1
.
2
9
2
.
3
8
1
.
1
6
2
.
1
6
1
.
1
7
2
.
4
0
1
.
2
3
.
4
4
P
e
r
s
o
n
a
l
i
t
y
i
n
v
e
n
t
o
r
y
3
.
4
0
1
.
2
8
2
.
6
2
1
.
4
6
3
.
2
9
1
.
3
0
3
.
0
0
1
.
5
6
2
.
6
7
M
u
l
t
i
s
o
u
r
c
e
r
a
t
i
n
g
s
3
.
5
3
.
9
7
3
.
2
6
1
.
3
1
3
.
6
1
1
.
0
9
3
.
2
5
1
.
4
1
1
.
1
3
R
o
l
e
p
l
a
y
s
2
.
8
0
1
.
0
3
2
.
6
7
1
.
2
4
2
.
7
3
1
.
1
9
2
.
7
5
1
.
2
9
.
0
7
A
c
c
e
s
s
t
o
p
e
r
f
o
r
m
a
n
c
e
d
a
t
a
3
.
4
0
1
.
0
0
3
.
0
0
1
.
3
6
3
.
0
8
1
.
2
2
2
.
6
5
1
.
0
9
1
.
6
1
A
c
t
i
v
i
t
i
e
s
B
u
i
l
d
r
a
p
p
o
r
t
4
.
8
7
.
5
7
4
.
7
9
.
5
7
4
.
5
8
.
8
3
4
.
3
5
1
.
0
4
2
.
5
3
I
n
c
r
e
a
s
e
m
o
t
i
v
a
t
i
o
n
3
.
7
3
1
.
0
8
3
.
8
5
1
.
2
7
3
.
3
9
1
.
1
6
3
.
3
5
1
.
3
9
1
.
7
4
D
e
v
e
l
o
p
i
n
s
i
g
h
t
4
.
4
7
1
.
0
1
4
.
6
7
.
4
8
4
.
4
0
.
8
4
4
.
3
5
1
.
0
4
1
.
0
7
T
e
a
c
h
a
n
e
w
s
k
i
l
l
4
.
1
3
.
8
6
3
.
8
5
1
.
1
1
3
.
4
5
1
.
0
3
2
.
9
5
1
.
3
6
6
.
2
8
A
s
s
i
s
t
w
i
t
h
s
k
i
l
l
a
p
p
l
i
c
a
t
i
o
n
4
.
7
7
.
4
3
4
.
3
8
.
9
4
4
.
2
5
.
7
9
4
.
0
5
1
.
0
5
3
.
9
4
H
o
l
d
p
a
r
t
i
c
i
p
a
n
t
a
c
c
o
u
n
t
a
b
l
e
4
.
5
0
.
9
0
4
.
5
4
.
8
9
4
.
0
4
1
.
0
6
4
.
3
0
.
9
2
3
.
0
9
S
e
t
g
o
a
l
s
f
o
r
b
e
h
a
v
i
o
r
c
h
a
n
g
e
4
.
6
3
.
4
9
4
.
4
4
.
8
2
4
.
2
5
.
8
8
4
.
0
5
1
.
1
0
2
.
4
7
JOYCE E. BONO ET AL. 379
T
o
p
i
c
a
d
d
r
e
s
s
e
d
i
n
c
o
a
c
h
i
n
g
I
n
t
e
r
p
e
r
s
o
n
a
l
s
k
i
l
l
s
4
.
0
0
.
5
9
3
.
8
7
.
8
9
3
.
9
2
.
6
7
3
.
8
5
.
7
5
.
2
4
S
t
r
e
s
s
m
a
n
a
g
e
m
e
n
t
2
.
9
3
1
.
1
7
2
.
8
7
1
.
1
1
2
.
5
4
1
.
1
2
2
.
9
5
1
.
1
9
1
.
5
4
S
t
r
a
t
e
g
i
c
t
h
i
n
k
i
n
g
2
.
8
0
1
.
0
0
3
.
2
1
.
8
9
3
.
1
3
1
.
0
8
3
.
0
5
.
9
5
1
.
0
5
T
i
m
e
m
a
n
a
g
e
m
e
n
t
2
.
5
7
.
9
4
2
.
8
2
1
.
1
0
2
.
6
1
1
.
0
0
2
.
9
0
1
.
0
7
.
7
9
C
o
n
i
c
t
m
a
n
a
g
e
m
e
n
t
3
.
3
7
.
7
2
3
.
3
6
.
8
4
3
.
2
3
.
8
5
3
.
5
5
.
8
9
.
9
1
S
t
a
f
n
g
2
.
3
0
.
9
9
2
.
3
6
.
9
6
1
.
9
8
1
.
0
1
2
.
5
0
.
9
5
2
.
4
5
M
a
n
a
g
e
m
e
n
t
s
t
y
l
e
3
.
9
3
.
5
8
3
.
9
5
.
8
6
3
.
7
6
1
.
0
1
3
.
7
5
.
7
9
.
6
0
L
e
a
d
e
r
s
h
i
p
4
.
0
7
.
6
9
4
.
1
3
.
6
6
3
.
8
0
1
.
0
1
3
.
8
5
.
8
8
1
.
6
3
C
o
m
m
u
n
i
c
a
t
i
o
n
3
.
9
7
.
7
7
3
.
8
7
.
9
2
3
.
6
0
.
9
2
3
.
7
5
.
9
1
1
.
5
7
A
d
a
p
t
a
b
i
l
i
t
y
/
v
e
r
s
a
t
i
l
i
t
y
3
.
1
3
1
.
0
1
3
.
1
8
1
.
2
1
2
.
8
7
1
.
1
1
2
.
7
5
1
.
1
2
1
.
1
6
M
o
t
i
v
a
t
i
o
n
2
.
1
7
.
8
7
2
.
6
9
1
.
3
0
2
.
2
5
1
.
2
4
2
.
4
5
1
.
2
8
1
.
5
1
D
e
l
e
g
a
t
i
o
n
3
.
0
0
.
9
1
3
.
1
8
1
.
1
4
2
.
7
5
1
.
0
3
2
.
4
5
1
.
0
0
2
.
7
9
P
l
a
n
n
i
n
g
2
.
7
0
.
7
0
3
.
0
8
.
9
8
2
.
6
3
1
.
0
3
2
.
7
0
1
.
0
8
1
.
9
4
S
a
l
e
s
/
n
a
n
c
i
a
l
p
e
r
f
o
r
m
a
n
c
e
2
.
2
0
.
9
6
2
.
2
3
1
.
1
4
1
.
9
0
1
.
0
4
1
.
8
0
.
8
9
1
.
4
9
M
e
n
t
o
r
i
n
g
2
.
3
3
.
9
6
2
.
7
2
1
.
1
2
2
.
2
2
1
.
0
8
2
.
7
5
1
.
1
6
2
.
6
5
N
o
t
e
.
N
=
1
7
2
f
o
r
a
l
l
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
.
R
e
s
p
o
n
s
e
s
w
e
r
e
c
o
d
e
d
u
s
i
n
g
t
h
e
f
o
l
l
o
w
i
n
g
s
c
a
l
e
:
1
=
r
a
r
e
l
y
,
2
=
o
c
c
a
s
i
o
n
a
l
l
y
,
3
=
s
o
m
e
t
i
m
e
s
,
4
=
o
f
t
e
n
,
5
=
a
l
w
a
y
s
.
D
e
g
r
e
e
s
o
f
f
r
e
e
d
o
m
f
o
r
F
t
e
s
t
s
(
3
,
1
6
8
)
.
p
<
.
0
5
.
p
<
.
0
1
.
p
<
.
0
0
1
.
380 PERSONNEL PSYCHOLOGY
T
A
B
L
E
8
C
o
m
p
a
r
i
s
o
n
o
f
M
e
t
h
o
d
s
U
s
e
d
t
o
E
v
a
l
u
a
t
e
E
f
f
e
c
t
i
v
e
n
e
s
s
A
c
r
o
s
s
D
i
s
c
i
p
l
i
n
e
s
o
f
P
s
y
c
h
o
l
o
g
y
C
l
i
n
i
c
a
l
C
o
u
n
s
e
l
i
n
g
I
n
d
u
s
t
r
i
a
l
&
o
r
g
a
n
i
z
a
t
i
o
n
a
l
P
e
r
s
o
n
a
l
i
t
y
&
s
o
c
i
a
l
V
a
r
i
a
b
l
e
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
M
e
a
n
S
D
F
C
l
i
e
n
t
r
e
p
o
r
t
s
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
p
r
o
c
e
s
s
4
.
3
0
.
7
5
4
.
2
6
.
9
4
3
.
9
9
1
.
0
5
4
.
4
5
.
9
5
1
.
8
1
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
o
u
t
c
o
m
e
s
4
.
3
0
.
6
0
4
.
3
1
.
7
7
4
.
1
2
.
9
9
4
.
5
5
.
5
1
1
.
6
1
A
t
t
a
i
n
m
e
n
t
o
f
c
o
a
c
h
i
n
g
g
o
a
l
s
4
.
3
7
.
6
2
4
.
2
8
1
.
0
0
3
.
9
6
.
9
6
4
.
4
5
.
6
9
2
.
8
4
I
n
c
r
e
a
s
e
d
c
o
n
d
e
n
c
e
3
.
9
7
1
.
0
3
3
.
8
7
1
.
2
0
3
.
2
4
1
.
2
4
4
.
0
0
1
.
0
3
5
.
0
5
I
n
c
r
e
a
s
e
d
s
e
l
f
-
u
n
d
e
r
s
t
a
n
d
i
n
g
4
.
2
0
1
.
0
6
4
.
0
8
1
.
1
3
3
.
5
4
1
.
3
3
4
.
0
5
1
.
1
5
3
.
1
8
B
o
s
s
r
e
p
o
r
t
s
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
p
r
o
c
e
s
s
3
.
8
0
.
7
6
3
.
2
3
1
.
2
9
2
.
9
5
1
.
2
8
3
.
0
5
1
.
3
6
3
.
6
7
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
o
u
t
c
o
m
e
s
3
.
9
7
.
6
7
3
.
5
1
1
.
4
3
3
.
4
3
1
.
3
5
3
.
3
0
1
.
2
6
1
.
5
7
A
t
t
a
i
n
m
e
n
t
o
f
w
r
i
t
t
e
n
g
o
a
l
s
3
.
6
3
.
7
2
3
.
2
6
1
.
4
6
3
.
1
6
1
.
4
2
3
.
0
5
1
.
2
3
1
.
1
4
A
t
t
a
i
n
m
e
n
t
o
f
i
m
p
l
i
c
i
t
g
o
a
l
s
3
.
5
3
.
8
2
3
.
1
5
1
.
4
1
3
.
0
1
1
.
3
4
2
.
8
0
1
.
3
2
1
.
6
7
B
e
h
a
v
i
o
r
c
h
a
n
g
e
3
.
8
7
.
6
8
3
.
4
9
1
.
3
0
3
.
3
4
1
.
3
2
3
.
1
5
1
.
0
4
1
.
8
8
L
e
a
r
n
i
n
g
o
r
s
k
i
l
l
d
e
v
e
l
o
p
m
e
n
t
3
.
4
7
.
8
6
3
.
1
8
1
.
3
7
2
.
9
2
1
.
3
0
3
.
0
0
1
.
2
6
1
.
5
5
O
t
h
e
r
s
r
e
p
o
r
t
s
(
p
e
e
r
,
H
R
)
B
e
h
a
v
i
o
r
c
h
a
n
g
e
3
.
2
3
1
.
0
7
2
.
9
0
1
.
3
1
2
.
7
7
1
.
3
3
2
.
6
5
1
.
0
4
1
.
2
2
L
e
a
r
n
i
n
g
o
r
s
k
i
l
l
d
e
v
e
l
o
p
m
e
n
t
2
.
9
3
1
.
0
8
2
.
8
7
1
.
2
6
2
.
4
6
1
.
2
4
2
.
4
0
1
.
0
5
1
.
9
8
JOYCE E. BONO ET AL. 381
O
b
j
e
c
t
i
v
e
r
e
p
o
r
t
s
B
u
s
i
n
e
s
s
o
u
t
c
o
m
e
s
(
$
,
s
a
l
e
s
)
2
.
3
7
1
.
1
0
2
.
3
8
1
.
2
9
2
.
2
5
1
.
2
9
2
.
5
0
1
.
3
6
.
2
6
P
r
o
m
o
t
i
o
n
2
.
8
3
1
.
0
2
2
.
3
3
1
.
2
0
2
.
3
6
1
.
1
1
2
.
4
5
1
.
2
3
1
.
4
6
R
e
d
u
c
e
d
c
o
m
p
l
a
i
n
t
s
1
.
7
7
.
9
0
2
.
1
0
1
.
2
3
1
.
9
3
1
.
1
2
2
.
1
5
1
.
0
4
.
7
4
R
O
I
b
a
s
e
d
o
n
u
t
i
l
i
t
y
a
n
a
l
y
s
i
s
1
.
9
0
1
.
3
7
2
.
0
3
1
.
3
1
1
.
6
1
1
.
0
8
1
.
7
5
1
.
0
2
1
.
2
1
A
t
t
i
t
u
d
e
c
h
a
n
g
e
2
.
3
0
.
8
8
2
.
3
8
1
.
2
1
2
.
0
7
1
.
1
7
2
.
3
0
.
9
8
.
8
6
C
o
a
c
h
e
s
a
s
s
e
s
s
m
e
n
t
o
f
E
f
c
a
c
y
o
f
c
o
a
c
h
i
n
g
p
r
o
c
e
s
s
4
.
2
7
1
.
0
2
4
.
1
8
1
.
1
0
4
.
1
2
.
9
8
4
.
2
5
1
.
0
7
.
2
0
E
f
c
a
c
y
o
f
c
o
a
c
h
i
n
g
o
u
t
c
o
m
e
s
4
.
3
3
.
9
2
4
.
1
5
1
.
0
9
4
.
1
3
.
9
7
4
.
3
5
.
9
9
.
4
9
A
t
t
a
i
n
m
e
n
t
o
f
w
r
i
t
t
e
n
g
o
a
l
s
4
.
1
0
1
.
0
3
4
.
0
3
1
.
0
9
3
.
8
8
1
.
1
3
4
.
0
0
1
.
1
2
.
3
6
A
t
t
a
i
n
m
e
n
t
o
f
i
m
p
l
i
c
i
t
g
o
a
l
s
4
.
1
0
1
.
0
3
3
.
7
2
1
.
3
0
3
.
9
8
1
.
0
1
4
.
2
5
.
9
7
1
.
3
0
I
n
c
r
e
a
s
e
d
s
e
l
f
-
u
n
d
e
r
s
t
a
n
d
i
n
g
4
.
2
7
1
.
0
5
4
.
1
0
1
.
1
4
3
.
9
9
1
.
1
4
4
.
2
0
1
.
1
1
.
5
4
N
o
t
e
.
N
=
7
2
f
o
r
a
l
l
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
.
R
e
s
p
o
n
s
e
s
w
e
r
e
c
o
d
e
d
u
s
i
n
g
t
h
e
f
o
l
l
o
w
i
n
g
s
c
a
l
e
:
1
=
r
a
r
e
l
y
,
2
=
o
c
c
a
s
i
o
n
a
l
l
y
,
3
=
s
o
m
e
t
i
m
e
s
,
4
=
o
f
t
e
n
,
5
=
a
l
w
a
y
s
.
D
e
g
r
e
e
s
o
f
f
r
e
e
d
o
m
f
o
r
F
t
e
s
t
s
(
3
,
1
6
8
)
.
p
<
.
0
5
.
p
<
.
0
1
.
382 PERSONNEL PSYCHOLOGY
presents cross-discipline comparisons for psychologists on evaluation.
Once again, few statistically signicant differences were found.
Considering Tables 14 as a set (comparing psychologists vs. nonpsy-
chologists) with Tables 58 as a set (comparing disciplines within psychol-
ogy), one might reach the conclusion that considerably more differences
can be found between psychologists and nonpsychologists than between
the various disciplines in psychology. This would not be a valid conclu-
sion. Because we focused on statistically signicant differences across
groups, such a comparison would be misleading, as the overall number of
coaches in the two sets of analysis vary greatly (N = 428 in Tables 14,
and N = 174 for Tables 58). For this reason, a comparison of the mag-
nitude of differences (not just signicance tests) between psychologist
coaches of various disciplines with the magnitude of differences between
psychologist and nonpsychologist coaches is needed. Examining d values
for all the comparisons in Tables 18 results in computation of 803 val-
ues. We present the full comparison data in the Appendices, but for reader
convenience, we also computed average d values for each general topic of
comparison (e.g., assessment tools, evaluation, and practice information),
using means and standard deviations presented in Tables 18. We then av-
eraged the absolute d values from all the within-psychology comparisons
to form an overall d value representing average differences between psy-
chological disciplines, which can be compared to the d value representing
average differences between psychologists and non-psychologists.
Results in Table 9 indicate that the magnitude of differences between
psychologists and nonpsychologists is roughly equal to the magnitude
of differences between psychologists of differing disciplines. The overall
absolute mean d value, across all topics, tools, outcomes evaluation, and
practices is d = .26 for the psychologists versus nonpsychologists com-
parison and d =.29 for the comparison of psychological disciplines (with
the largest differences occurring when we compare clinical to other types
of psychologists; average d = .34). Although many of the differences we
examined were statistically signicant, as noted in Tables 18, examina-
tion of the d values reveals that, in general, these effects were small to
moderate in magnitude.
Our nal analysis was a comparison of the competencies considered
to be essential for effective coaching. Because the data for this analysis is
qualitative, we restricted our comparison to psychologists versus nonpsy-
chologists. In the rst step of our analysis, three of the authors read all
the competencies (blind to whether they were provided by psychologists
or nonpsychologists) and developed a list of competencies found in the
data. Through discussion, we developed a nal set of competencies (see
Table 10). In the next step, two authors counted the number of times
each competency was mentioned by psychologists and nonpsychologists.
JOYCE E. BONO ET AL. 383
T
A
B
L
E
9
C
o
m
p
a
r
i
s
o
n
o
f
O
v
e
r
a
l
l
,
A
v
e
r
a
g
e
E
f
f
e
c
t
S
i
z
e
s
f
o
r
P
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
C
o
u
n
v
s
.
I
-
O
C
l
i
n
v
s
.
I
-
O
P
/
S
o
c
v
s
.
I
O
C
o
u
n
v
s
.
C
l
i
n
C
l
i
n
v
s
.
P
/
S
o
c
C
o
u
n
v
s
.
P
/
S
o
c
O
v
e
r
a
l
l
a
v
e
r
a
g
e
d
v
a
l
u
e
.
2
6
.
2
9
.
2
4
.
3
4
.
2
5
.
2
8
.
4
0
.
2
4
D
e
s
c
r
i
p
t
i
v
e
i
n
f
o
r
m
a
t
i
o
n
.
4
2
.
3
9
.
2
9
.
4
5
.
4
0
.
4
2
.
5
1
.
2
5
C
o
a
c
h
d
e
m
o
g
r
a
p
h
i
c
s
.
3
9
.
3
6
.
3
3
.
2
8
.
4
8
.
4
7
.
3
4
.
2
5
P
r
a
c
t
i
c
e
i
n
f
o
r
m
a
t
i
o
n
.
6
4
.
4
1
.
3
3
.
5
2
.
4
4
.
2
4
.
5
8
.
3
4
P
a
r
t
i
c
i
p
a
n
t
s
j
o
b
r
o
l
e
s
.
2
3
.
3
7
.
2
4
.
6
6
.
3
1
.
5
2
.
3
8
.
2
2
S
o
u
r
c
e
o
f
p
a
r
t
i
c
i
p
a
n
t
r
e
f
e
r
r
a
l
.
4
4
.
4
1
.
2
6
.
3
6
.
3
7
.
4
5
.
7
4
.
2
9
C
o
a
c
h
i
n
g
m
e
t
h
o
d
s
.
2
2
.
2
4
.
2
0
.
2
8
.
1
7
.
2
6
.
3
1
.
2
3
M
e
d
i
u
m
.
1
7
.
1
7
.
1
8
.
2
0
.
0
9
.
2
7
.
1
4
.
1
7
T
y
p
i
c
a
l
n
u
m
b
e
r
o
f
s
e
s
s
i
o
n
s
.
3
1
.
3
2
.
2
2
.
4
5
.
1
8
.
3
1
.
5
5
.
2
2
S
c
i
e
n
t
i
c
/
p
h
i
l
o
s
o
p
h
i
c
a
l
a
p
p
r
o
a
c
h
.
1
7
.
2
3
.
1
9
.
2
0
.
2
4
.
2
1
.
2
3
.
2
9
T
o
o
l
s
,
a
c
t
i
v
i
t
i
e
s
,
t
o
p
i
c
s
.
2
1
.
2
9
.
2
7
.
2
8
.
2
4
.
2
3
.
4
3
.
2
9
A
s
s
e
s
s
m
e
n
t
t
o
o
l
s
.
2
7
.
2
6
.
2
1
.
1
9
.
2
8
.
2
6
.
4
1
.
1
9
A
c
t
i
v
i
t
i
e
s
.
1
4
.
3
9
.
3
3
.
4
5
.
2
2
.
2
5
.
6
1
.
4
6
T
o
p
i
c
s
a
d
d
r
e
s
s
e
d
i
n
c
o
a
c
h
i
n
g
.
2
3
.
2
3
.
2
8
.
2
2
.
2
1
.
1
9
.
2
8
.
2
3
O
u
t
c
o
m
e
e
v
a
l
u
a
t
i
o
n
.
1
7
.
2
4
.
2
0
.
3
4
.
2
0
.
2
0
.
3
3
.
1
9
C
l
i
e
n
t
r
e
p
o
r
t
s
.
3
4
.
2
8
.
3
4
.
4
2
.
5
0
.
0
7
.
1
8
.
1
8
B
o
s
s
r
e
p
o
r
t
s
.
0
8
.
3
3
.
1
3
.
4
9
.
1
0
.
4
0
.
6
9
.
1
9
O
t
h
e
r
s
r
e
p
o
r
t
s
.
1
9
.
2
8
.
2
1
.
3
8
.
0
7
.
1
7
.
5
3
.
3
0
O
b
j
e
c
t
i
v
e
r
e
p
o
r
t
s
.
0
7
.
1
8
.
1
8
.
2
3
.
1
6
.
1
9
.
2
0
.
1
1
C
o
a
c
h
e
s
a
s
s
e
s
s
m
e
n
t
.
1
8
.
1
5
.
1
1
.
1
9
.
1
8
.
1
6
.
0
7
.
1
6
N
o
t
e
.
T
a
b
l
e
v
a
l
u
e
s
a
r
e
a
v
e
r
a
g
e
a
b
s
o
l
u
t
e
d
v
a
l
u
e
s
.
=
p
s
y
c
h
o
l
o
g
i
s
t
s
.
384 PERSONNEL PSYCHOLOGY
T
A
B
L
E
1
0
C
o
m
p
e
t
e
n
c
i
e
s
I
d
e
n
t
i
e
d
b
y
P
s
y
c
h
o
l
o
g
i
s
t
a
n
d
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
C
o
a
c
h
e
s
C
o
m
p
e
t
e
n
c
i
e
s
P
s
y
c
h
o
l
o
g
i
s
t
s
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
2
(
1
d
f
)
D
i
a
g
n
o
s
t
i
c
a
n
d
p
l
a
n
n
i
n
g
c
a
p
a
b
i
l
i
t
i
e
s
Q
u
e
s
t
i
o
n
i
n
g
:
C
a
p
a
c
i
t
y
t
o
a
s
k
i
n
s
i
g
h
t
f
u
l
,
p
r
o
b
i
n
g
,
d
i
s
c
o
v
e
r
y
-
o
r
i
e
n
t
e
d
q
u
e
s
t
i
o
n
s
8
(
2
.
8
4
%
)
4
7
(
8
.
6
9
%
)
4
.
6
7
L
i
s
t
e
n
i
n
g
:
C
a
p
a
c
i
t
y
t
o
a
c
t
i
v
e
l
y
l
i
s
t
e
n
,
h
e
a
r
,
a
n
d
u
n
d
e
r
s
t
a
n
d
t
h
e
p
a
r
t
i
c
i
p
a
n
t
3
3
(
1
1
.
7
0
%
)
1
0
1
(
1
9
.
0
2
%
)
1
.
3
4
C
o
m
m
u
n
i
c
a
t
i
o
n
s
k
i
l
l
s
:
C
a
p
a
c
i
t
y
t
o
c
o
m
m
u
n
i
c
a
t
e
e
f
f
e
c
t
i
v
e
l
y
,
e
x
p
r
e
s
s
i
n
g
c
o
m
p
l
e
x
i
d
e
a
s
s
i
m
p
l
y
1
2
(
4
.
2
6
%
)
2
8
(
5
.
2
7
%
)
.
0
3
A
s
s
e
s
s
m
e
n
t
:
C
a
p
a
c
i
t
y
t
o
i
d
e
n
t
i
f
y
a
n
d
a
n
a
l
y
z
e
k
e
y
i
s
s
u
e
s
,
a
n
d
u
s
e
d
a
t
a
a
n
d
m
e
a
s
u
r
e
m
e
n
t
t
o
o
l
s
1
3
(
4
.
6
1
%
)
1
3
(
2
.
4
5
%
)
5
.
1
9
A
n
a
l
y
s
i
s
a
n
d
p
l
a
n
n
i
n
g
:
C
a
p
a
c
i
t
y
t
o
r
e
a
c
h
g
r
o
u
n
d
e
d
a
s
s
e
s
s
m
e
n
t
s
a
n
d
i
n
s
i
g
h
t
f
u
l
s
o
l
u
t
i
o
n
s
,
t
o
u
s
e
d
a
t
a
t
o
s
o
l
v
e
p
r
o
b
l
e
m
s
,
a
n
d
t
o
d
e
v
e
l
o
p
s
p
e
c
i
c
p
l
a
n
s
1
0
(
3
.
5
5
%
)
6
(
1
.
1
3
%
)
8
.
1
1
I
n
t
e
r
v
e
n
t
i
o
n
s
u
c
c
e
s
s
a
s
s
e
s
s
m
e
n
t
:
E
v
a
l
u
a
t
i
n
g
t
h
e
s
u
c
c
e
s
s
o
f
t
h
e
c
o
a
c
h
i
n
g
i
n
t
e
r
v
e
n
t
i
o
n
,
f
o
l
l
o
w
i
n
g
t
h
r
o
u
g
h
w
i
t
h
c
l
i
e
n
t
s
a
f
t
e
r
c
o
a
c
h
i
n
g
i
s
c
o
m
p
l
e
t
e
d
,
b
e
i
n
g
f
o
c
u
s
e
d
o
n
a
c
h
i
e
v
i
n
g
r
e
s
u
l
t
s
4
(
1
.
4
2
%
)
4
(
.
7
5
%
)
1
.
4
5
I
n
t
e
r
v
e
n
t
i
o
n
a
n
d
p
r
o
b
l
e
m
s
o
l
v
i
n
g
c
a
p
a
b
i
l
i
t
i
e
s
L
a
r
g
e
,
e
x
i
b
l
e
t
o
o
l
b
o
x
:
C
a
p
a
c
i
t
y
t
o
u
s
e
m
u
l
t
i
p
l
e
t
e
c
h
n
o
l
o
g
i
e
s
,
t
o
o
l
s
,
a
n
d
m
e
t
h
o
d
s
0
(
0
%
)
1
2
(
2
.
2
6
%
)
5
.
5
9
M
o
t
i
v
a
t
o
r
:
C
a
p
a
c
i
t
y
t
o
m
o
t
i
v
a
t
e
,
e
n
c
o
u
r
a
g
e
,
e
m
p
o
w
e
r
,
i
n
u
e
n
c
e
,
o
r
p
r
o
m
p
t
6
(
2
.
1
3
%
)
1
2
(
2
.
2
6
%
)
.
1
4
B
u
i
l
d
i
n
g
r
e
l
a
t
i
o
n
s
h
i
p
s
a
n
d
a
c
h
i
e
v
i
n
g
r
a
p
p
o
r
t
:
C
a
p
a
c
i
t
y
t
o
b
u
i
l
d
r
a
p
p
o
r
t
,
m
a
k
e
c
o
n
n
e
c
t
i
o
n
s
,
h
a
v
e
e
m
p
a
t
h
y
/
c
o
m
p
a
s
s
i
o
n
3
5
(
1
2
.
4
1
%
)
4
4
(
8
.
2
9
%
)
8
.
6
9
C
o
u
n
s
e
l
i
n
g
s
k
i
l
l
s
:
C
a
p
a
c
i
t
y
t
o
u
s
e
s
k
i
l
l
s
c
o
n
s
i
s
t
e
n
t
w
i
t
h
t
h
e
p
s
y
c
h
o
d
y
n
a
m
i
c
,
p
e
r
s
o
n
-
c
e
n
t
e
r
e
d
,
m
o
d
e
l
i
n
g
,
o
r
g
o
a
l
-
s
e
t
t
i
n
g
a
p
p
r
o
a
c
h
e
s
t
o
p
s
y
c
h
o
l
o
g
i
c
a
l
t
h
e
r
a
p
y
2
8
(
9
.
9
3
%
)
5
3
(
9
.
9
8
%
)
1
.
1
2
F
e
e
d
b
a
c
k
:
C
a
p
a
c
i
t
y
t
o
g
i
v
e
h
o
n
e
s
t
,
c
l
e
a
r
,
u
n
a
m
b
i
g
u
o
u
s
,
n
o
n
j
u
d
g
m
e
n
t
a
l
f
e
e
d
b
a
c
k
8
(
2
.
8
4
%
)
1
8
(
3
.
3
8
%
)
.
0
5
H
o
l
d
i
n
g
t
h
e
c
l
i
e
n
t
a
c
c
o
u
n
t
a
b
l
e
:
A
b
i
l
i
t
y
t
o
h
o
l
d
c
l
i
e
n
t
a
c
c
o
u
n
t
a
b
l
e
f
o
r
c
l
i
e
n
t
s
c
o
m
m
i
t
m
e
n
t
s
t
o
t
h
e
c
o
a
c
h
i
n
g
p
r
o
c
e
s
s
1
(
.
3
5
%
)
6
(
1
.
1
3
%
)
1
.
2
1
JOYCE E. BONO ET AL. 385
T
A
B
L
E
1
0
(
c
o
n
t
i
n
u
e
d
)
K
n
o
w
l
e
d
g
e
B
u
s
i
n
e
s
s
k
n
o
w
l
e
d
g
e
:
U
n
d
e
r
s
t
a
n
d
i
n
g
b
u
s
i
n
e
s
s
,
o
r
g
a
n
i
z
a
t
i
o
n
a
l
s
t
r
u
c
t
u
r
e
/
s
t
r
a
t
e
g
y
,
c
u
l
t
u
r
e
,
p
o
l
i
t
i
c
s
,
l
e
a
d
e
r
s
h
i
p
3
6
(
1
2
.
7
7
%
)
2
7
(
5
%
)
2
3
.
6
8
K
n
o
w
l
e
d
g
e
a
n
d
u
n
d
e
r
s
t
a
n
d
i
n
g
o
f
h
u
m
a
n
b
e
h
a
v
i
o
r
:
K
n
o
w
l
e
d
g
e
o
f
h
o
w
p
e
o
p
l
e
c
h
a
n
g
e
a
n
d
l
e
a
r
n
,
b
r
o
a
d
p
s
y
c
h
o
l
o
g
i
c
a
l
t
r
a
i
n
i
n
g
,
b
e
h
a
v
i
o
r
a
l
s
c
i
e
n
c
e
b
a
c
k
g
r
o
u
n
d
2
9
(
1
0
.
2
8
%
)
5
(
.
9
4
%
)
5
1
.
2
2
K
n
o
w
l
e
d
g
e
o
f
p
a
r
t
i
c
i
p
a
n
t
b
a
c
k
g
r
o
u
n
d
:
F
a
m
i
l
i
a
r
i
t
y
w
i
t
h
t
h
e
p
a
r
t
i
c
i
p
a
n
t
s
c
o
m
p
e
t
e
n
c
e
i
n
t
h
e
a
r
e
a
t
o
b
e
c
o
a
c
h
e
d
0
(
0
%
)
3
(
.
5
6
%
)
2
.
2
2
P
e
r
s
o
n
a
l
q
u
a
l
i
t
i
e
s
A
u
t
h
e
n
t
i
c
i
t
y
/
s
e
l
f
-
a
w
a
r
e
n
e
s
s
:
S
e
l
f
-
u
n
d
e
r
s
t
a
n
d
i
n
g
1
3
(
4
.
6
1
%
)
1
9
(
3
.
5
8
%
)
1
.
9
1
H
o
n
e
s
t
y
a
n
d
i
n
t
e
g
r
i
t
y
:
B
e
i
n
g
h
o
n
e
s
t
,
e
t
h
i
c
a
l
,
t
r
u
s
t
w
o
r
t
h
y
1
0
(
3
.
5
5
%
)
1
9
(
3
.
5
8
%
)
.
3
5
O
t
h
e
r
p
e
r
s
o
n
a
l
q
u
a
l
i
t
i
e
s
:
C
o
u
r
a
g
e
,
c
u
r
i
o
s
i
t
y
,
p
e
r
c
e
p
t
i
v
e
n
e
s
s
,
h
u
m
o
r
,
i
n
t
u
i
t
i
o
n
2
2
(
7
.
8
0
%
)
2
9
(
5
.
4
6
%
)
4
.
6
9
L
i
f
e
a
n
d
j
o
b
e
x
p
e
r
i
e
n
c
e
:
H
a
v
i
n
g
r
i
c
h
p
e
r
s
o
n
a
l
a
n
d
p
r
o
f
e
s
s
i
o
n
a
l
e
x
p
e
r
i
e
n
c
e
s
0
(
0
%
)
1
2
(
2
.
2
6
%
)
5
.
5
9
C
o
n
t
i
n
u
o
u
s
l
e
a
r
n
i
n
g
:
B
e
i
n
g
r
e
s
p
o
n
s
i
b
l
e
f
o
r
p
r
o
f
e
s
s
i
o
n
a
l
d
e
v
e
l
o
p
m
e
n
t
,
p
u
r
s
u
i
n
g
n
e
w
k
n
o
w
l
e
d
g
e
,
c
e
r
t
i
c
a
t
i
o
n
2
(
.
7
1
%
)
8
(
1
.
5
1
%
)
.
7
0
S
e
l
f
-
m
a
n
a
g
e
m
e
n
t
a
n
d
p
r
o
f
e
s
s
i
o
n
a
l
i
s
m
:
B
e
i
n
g
p
r
e
p
a
r
e
d
,
o
n
t
i
m
e
,
m
a
i
n
t
a
i
n
p
r
o
f
e
s
s
i
o
n
a
l
a
p
p
e
a
r
a
n
c
e
/
d
e
m
e
a
n
o
r
0
(
0
%
)
5
(
.
9
4
%
)
2
.
8
9
C
l
i
e
n
t
f
o
c
u
s
:
B
e
i
n
g
f
o
c
u
s
e
d
o
n
t
h
e
c
l
i
e
n
t
,
p
u
t
t
i
n
g
t
h
e
c
l
i
e
n
t
s
i
n
t
e
r
e
s
t
s
r
s
t
0
(
0
%
)
8
(
1
.
5
1
%
)
4
.
0
1
N
o
t
e
.
T
h
e
r
e
w
e
r
e
a
t
o
t
a
l
o
f
2
8
2
c
o
m
p
e
t
e
n
c
i
e
s
p
r
o
v
i
d
e
d
b
y
p
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
5
3
1
p
r
o
v
i
d
e
d
b
y
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
.
T
w
e
l
v
e
c
o
m
p
e
t
e
n
c
i
e
s
f
r
o
m
p
s
y
c
h
o
l
o
g
i
s
t
s
(
4
%
)
a
n
d
5
2
c
o
m
p
e
t
e
n
c
i
e
s
f
r
o
m
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
(
9
%
)
w
e
r
e
n
o
t
c
l
a
s
s
i
a
b
l
e
,
i
n
m
o
s
t
c
a
s
e
s
b
e
c
a
u
s
e
t
h
e
y
w
e
r
e
t
o
o
v
a
g
u
e
.
p
<
.
0
5
;
p
<
.
0
1
.
386 PERSONNEL PSYCHOLOGY
Because the raw number of competencies provided by psychologists and
nonpsychologists differed (N = 282 for psychologists and N = 531 for
nonpsychologists), in Table 10 we report both our rawcounts and percent-
ages (i.e., the percentage of times that each competency was mentioned
by psychologist and nonpsychologist coaches). Results of
2
tests reveal
a number of signicant differences in the frequency with which compe-
tencies were mentioned by psychologist and nonpsychologist coaches.
For example, in the category of diagnostic and planning capabilities, re-
sults reveal that nonpsychologist coaches were signicantly more likely
to mention questioning skills, whereas psychologist coaches were signi-
cantly more likely to mention assessment and analysis. Nonpsychologists
were more likely to mention building rapport and having a large adapt-
able toolbox (of methods, technologies, and tools). Psychologists were
more likely to mention knowledge of business as a key coaching com-
petency and were signicantly more likely than nonpsychologist coaches
to mention personal characteristics, such as intuition, humor, courage, or
perceptiveness.
Discussion
The primary purpose of our study was to describe the current state
of executive coaching practices with a special emphasis on comparing
the practices of psychologist and nonpsychologist coaches. Perhaps the
two most striking aspect of our resultsconsidered as a wholeare that
(a) differences between psychologist and nonpsychologists coaches are
generally quite small (average d = .26) and (b) there are as many differ-
ences between psychologist coaches of various disciplines (d = .29) as
there are between psychologist and nonpsychologist coaches. Our results
show that a coachs background signicantly predicts how he or she will
conduct coaching, who he or she will coach, what assessments and tools
he or she may choose, and how he or she will evaluate coaching effective-
ness. But, the magnitude of the differences we found is generally quite
small, suggesting that it may be time to move the debate about whether
or not executive coaches should have psychological training to a debate
about what we can expect coaches of differing backgrounds to do best and
what type of training would help all coaches be more effective.
Although we did not nd large differences between psychologist and
nonpsychologist coaches, there are a few moderate-sized ndings worthy
of note, in part because they follow logically from the coachs train-
ing. Our results show that psychologist coaches have more experience
coaching (d = .58), which is not surprising given that performance as-
sessment, development, and behavior change (i.e., coaching) have long
been the domain of psychologists, and specic training and certication
JOYCE E. BONO ET AL. 387
of coaches is a relatively new phenomenon. Nonpsychologist coaches de-
rived a higher percentage of their income from coaching (d = .56) and
were more likely than psychologists to directly recruit clients and less
likely to obtain clients through referrals (d =.56). This may be, in part,
because many of the training and certication programs have marketing
and sales as an emphasis (see the International Coaching Federation Web
site), but graduate psychology programs typically do not. We also found
that nonpsychologist coaches had more sessions with their clients (d =
.49), were less likely to use multisource behavioral ratings as diagnostic
and assessment tools (d =.54), and were more likely to measure coaching
success by directly asking the person being coached about self-condence
(d = .53) and self-understanding (d = .50).
Some smaller differences (d values < .50) in practices between psy-
chologist and nonpsychologist coaches were also found. Psychologist
coaches were more likely to coach clients face-to-face and were less
likely to use approaches where empirical validity evidence is weak (e.g.,
neurolinguistic programming, psychoanalytic/psychodynamic). They also
tended to use multiple methods and sources, such as interviewing third
parties (e.g., supervisors and peers) during both the assessment and out-
come evaluation stages. Many of these differences (e.g., use of empirically
supported approaches, use of multisource assessment tools, and more re-
liance on third party observations than self-reports) reect practices taught
in psychology graduate programs.
Taken as a whole, our results appear to favor psychologist coaches,
especially with respect to strong measurement, use of data from multi-
ple sources, and use of techniques with empirical validity. Nonetheless,
our comparison of the four types of psychologists revealed that there are
as many differences between types of psychologists as there are between
psychologist and nonpsychologist coaches. These results suggests that the
many journal pages devoted to debates about whether or not psychologists
are the best (or worse) executive coaches have missed a key point: Even
among psychologists, there are many, albeit mostly small, differences
that can be linked to the psychological specialty in which the coach was
trained. The largest overall differences were found when clinical psychol-
ogists were compared to industrial-organizational, social/personality and
counseling psychologists (average d = .34)
When it comes to competencies viewed as important by psychologist
and nonpsychologist coaches, we found a number of signicant differ-
ences. Both groups agreed that skills such as the ability to build rapport,
and listening and counseling skills were key coach competencies. It was
in the broad category of knowledge that psychologist and nonpsychologist
coaches differed most. Psychologists were substantially more likely than
nonpsychologists to list knowledge and understanding of human behavior
388 PERSONNEL PSYCHOLOGY
as a key coach competency. In the literature, there is general agreement
among psychologist coaches of various subdisciplines that coaching in-
volves equipping people with the tools, knowledge, and opportunities
they need to develop themselves and become more effective (Peterson,
1996, p. 78) with the ultimate goal of sustained behavior change (Brotman
et al., 1998). The magnitude of the difference between psychologist and
nonpsychologist coaches about the importance of understanding human
behavior as a coach competency suggests that sustained behavior change
may not be the goal of all coaches; some may view increased insight or
self-awareness as an end goal.
We also found that psychologists rated knowledge of business prac-
tices, including strategy, culture, and leadership, as a more important
competency than did nonpsychologist coaches. Another small, yet im-
portant, difference in perceived competencies is that psychologists were
more likely to list competencies related to sound needs assessment prac-
tices (e.g., using data and measurement tools, analysis and planning),
whereas nonpsychologists were more likely to list broader, less specic
assessment and intervention competencies (e.g., questioning and probing
skills, using a exible toolbox). It is worth noting, however, that coaches
perceptions of key competencies may not reect their actual strengths.
As suggested by an anonymous reviewer, psychologists greater emphasis
on business competencies may reect their appreciation for the value of
business knowledge, which they may feel they lack.
Although a growing number of nonpsychologist coaches come from
business (former managers and former HR professionals), historically,
many nonpsychologist coaches came from human services and helping
professions. These coaches tended to be more focused on the personal
goals of the individual and less concerned about the business side of
things. Indeed, when coding the competencies, we observed what appear
to be two distinct types of competency listings that may be indicative of
distinct models or methods of coaching. Some coaches seemed to focus
more on business-related outcomes. These coaches focused on assessment
and skill development, with an implicit goal of behavior change. Others
focused on listening, reecting, and questioning, with more apparent focus
on the personal growth of the individual being coached. Our observations
may reect two distinctly different models (reection vs. intervention)
and goals (business competencies vs. personal growth) of coaching that
exist in the marketplace; however, our data suggest that these models are
not closely aligned with a coachs training or educational background.
Aprimary strength of our study was that we went to great lengths to as-
semble a representative sample of coaches, with a variety of backgrounds
and institutional afliations. This strength is accompanied by some limi-
tations. First, collecting data from over 400 coaches forced us to rely on
JOYCE E. BONO ET AL. 389
a survey with standardized questions and responses, limiting our ability
to collect rich data on the intricacies of coaches work with their clients,
which can be hard to characterize in a 15 response scale. For example,
we did not learn much about the underlying organizational goals that drive
executive coaching (e.g., develop high-potential managers, or change the
organizational culture) or about the processes used by organizations in
selecting coaches or matching coaches with executives. Second, a poten-
tially biasing factor in our interpretation of the data is our own link to
psychology, which may tend to focus our attention on some aspects of
our results over others. Three of the four authors are psychologists by
training (industrial-organizational and counseling); the fourth, although
trained in business, spent several years in a psychology department. We
acknowledge the possibility that our training inuenced the questions that
we asked and the issues we viewed as important. A third limitation of our
study design is that we asked coaches to self-report their behaviors and
approaches. As suggested by an anonymous reviewer, it is quite possible
that some coaches may have responded in a way that was consistent with
howthey thought they should respond, based on their training. For this rea-
son, continued empirical work on executive coaching is important. Even
though coaches may diverge to some degreein practicefrom what
they report on our survey, we still nd the similarities and differences
between coaches of various disciplines to be informative, both because it
is likely that there is an association between what coaches report and what
they actually do, and because reported differences may be indicative of
philosophical differences in approaches to coaching.
Implications and Application
Our review of the literature makes it clear that executive coaching
remains a popular intervention for organizations. One of the reasons that
coaching has grown so rapidly is because organizations have become
aware of the problems and costs caused by high-potential employees with
poor interpersonal skills, because the tight pool of talented employees
makes employee development more attractive to organizations than re-
placement, because retirement among senior executives has prompted
organizations to develop formal succession plans, and because managers,
due to lack of skills and time, tend to outsource feedback and develop-
ment of employees. The question facing organizations is how to choose
the right coach. The results of our study, although informative about many
small differences between coaches, do not provide a clear framework for
matching client needs with coaches on the basis of a coachs training and
background.
390 PERSONNEL PSYCHOLOGY
Given that knowing a coachs educational background is not enough
to tell an organization how a coach will behave, we suggest that organi-
zations can do a better job of matching clients and coaches by asking two
questionsone of themselves and one of coaches they consider hiring.
Question 1: What is the need of the individual to be coached, relative to
the necessary and sufcient conditions for developmentinsight, moti-
vation, capabilities, real-world practice, and accountability? These ve
conditions are referred to as the Development Pipeline (Peterson, 2006).
1
Does the person need additional insight, motivation, and skills? Or does
the person need to be given the opportunity to apply their existing skills
in real-world settings and be held accountable for doing so? The answer
to this question tells the company what they need to look for in a coach
(e.g., someone who can provide feedback and clarify goals in order to
facilitate insight or someone who can provide new knowledge and build
the persons skills). Asking this question will also help organizations re-
alize that if they do not know exactly what elements of development the
person needs, it is critical that they hire a coach who has training, skill,
and experience in problem identication (i.e., developmental assessment
and needs analysis). Our data suggests a potential advantage for psychol-
ogist coaches in this instance, as they are more likely to use effective
tools to diagnose the problem (e.g., multisource behavioral ratings d =
.54, interview with supervisor d = .33, interview with peers d = .35,
ability/aptitude tests d = .30, and review of prior performance data d =
.41). Our data also suggest that if an executive needs to learn to apply
his or her existing skills, a psychologist might be well suited for the task,
as psychologist coaches were more likely to assist with skill application
(d = .21) and to set behavior change goals (d = .22) with the individuals
they coach.
Once the organization has answered Question 1, they are ready to
interview coaches using Question 2: What is the coachs process for ad-
dressing the specic type of need identied in Question 1? Coaches can
be asked to explicitly describe their approach to building insight, enhanc-
ing motivation, helping the person learn new skills and gain knowledge,
1
The Development Pipeline lists the ve necessary and sufcient conditions for system-
atic learning, dened as follows (Peterson, 2006). Insight: the extent to which a person
understands what area(s) they need to develop in order to be more effective. Motivation:
the degree to which a person is willing to invest the time and energy it takes to develop
in those areas. Capabilities: the extent to which a person has the skills and knowledge that
are needed. Real-world practice: the extent to which the person has opportunities to apply
their skills in relevant, real-world settings. Accountability: the extent to which there are
internal and external mechanisms for paying attention to change and providing meaningful
consequences. An analysis of which elements are missing, or most constrained, will iden-
tify where coaching and development efforts should be focused in order to most efciently
facilitate learning.
JOYCE E. BONO ET AL. 391
transfer learning to real-world applications, and/or ensuring that the per-
son is held accountable and sticks to their goals. With that kind of clarity
relative to a specic model of development, organizations can assess how
satised they are with a coachs ability to articulate his or her approach to
addressing the executives need.
2
Our data suggest that knowing a coachs
educational background will provide only limited information of this na-
ture. Indeed, we found it ironic that a common criticism of psychologist
coaches is their assumed use of psychoanalytic techniques in the coach-
ing process because our data suggest that psychologists are signicantly
less likely than nonpsychologists to use such controversial techniques in
executive coaching. Clearly, organizations cannot rely on a coachs edu-
cational background to determine what process they will use in executive
coaching. Thus, organizations need to pose questions, such as Question 2,
directly to potential coaches. Asking questions such as the two we sug-
gest also allows organizations to determine whether a particular coachs
practice tends to focus mostly on behavior change and business goals, or
whether the coach tends to focus more on helping individuals with their
personal growth and development.
In addition to asking coaches questions about their background and
training, organizationsand individual executives looking for a coach
would be well served to clearly communicate their objectives to prospec-
tive coaches. Doing so would allow coaches to better determine whether
their unique training, capabilities, and typical processes are a good t
for the client, potentially resulting in better matches. Similarly, because
our results suggest that a coachs educational background provides only
limited information to an organization, coaches must be clear in their
conversations (and in their marketing materials) about what they bring to
the table, and why their capabilities and processes are appropriate for a
particular situation, based on experience and past success with the given
audience and need. Coaches can also be clear with organizations about
whether their general approach to coaching tends toward intervention ver-
sus reection, and whether the bulk of their coaching is done to develop
business competencies or whether they focus more on personal growth.
Furthermore, if psychologist coaches feel that their graduate training in
human behavior makes them a better coach, it is incumbent on them to
explicitly identify the knowledge, skills, and abilities they bring to exec-
utive coaching as a result of that training and how those capabilities will
make them a better choice for a particular coaching assignment.
2
Additional questions and issues related to selecting coaches and designing coaching
programs are discussed in Executive Coaching Forum (2004), Peterson (2002), and Valerio
and Lee (2006).
392 PERSONNEL PSYCHOLOGY
Future Research
As systematic empirical examination of executive coaching is in its
infancy, there are a number of fruitful avenues for future research. Per-
haps the most pressing need is for continuing sound research on the
effectiveness of coaching in general (e.g., Peterson, 1993a,b), especially
as compared with other methods of training and development, such as
group-based skills training, or broad goal-setting interventions. Quasi-
experiments in organizations, comparing outcomes of coaching versus
other interventions, or looking at the incremental validity of coaching
when combined with other interventions, are needed (e.g., Seifert, Yukl,
&McDonald, 2003). Another critical need, as coaching becomes more and
more popular is to understand the differences (in purpose, process, and
expected outcomes) between external coaching and supervisory coach-
ing. Over time coaching has shifted from remedial interventions to more
positive and proactive needs, such as accelerating high potential devel-
opment, developing special populations (e.g., minority executives), and
special needs (e.g., onboarding or managing remote teams, or managing
a specic project); additional research is needed to better understand how
coaching varies by the nature of the intervention. We also know little
about the processes used in short term, focused coaching, which may also
depend more heavily on electronic communication.
In this research, we began the process of identifying coaching com-
petencies by asking coaches themselves what they think the key compe-
tencies are. An important area for future research is to determine what
knowledge, skills, and abilities coaches must have to address the various
types of issues they face (e.g., facilitating insight, motivation, capabili-
ties). Arriving at a concrete set of KSAs (not based solely on coaches
reports) linked to each element and type of executive coaching would
help coaches and training programs know what knowledge and skills to
develop. Our informal review of graduate training in counseling, clinical,
and industrial-organizational psychology, along with International Coach-
ing Federation certied programs, suggests that most training programs
have gaps. For example, graduate programs in clinical and counseling
psychology focus on human development but typically include no course-
work related to either the business environment or employment law. In
contrast, industrial-organizational psychology programs have a strong fo-
cus on the employee behavior, motivation, attitudes, and performance,
as well the legal issues surrounding employment, but they typically do
not train students in techniques associated with one-on-one coaching or
counseling. Retired executives bring a wealth of business experiences but
may not be trained or knowledgeable about assessment and may not know
howfacilitate sustained behavior change. Coach certication programs are
JOYCE E. BONO ET AL. 393
unique in providing the business and marketing skills needed by coaches,
especially those building a new practice, but due to their brevity, cannot
provide trainees with strong, foundational knowledge related to human
motivation and development.
Another important area in which research is lacking is the coaching
process. There is a need for future research to examine the active ingre-
dients of coaching. What coach behaviors help someone gain insight?
What do coaches actually do to increase motivation? Specically, how
do coaches help someone increase their capabilities and apply those new
capabilities in the workplace? How do they hold the person they coach
accountable? One way to conduct this type of research would be to con-
duct a series of interviews with coaches and the people they coach, either
after each coaching session or at set time periods during the coaching
engagement. The interviewer might ask these questions: Did your coach
inuence your motivation? If so, what did the coach do? Did your coach
do anything to help you build your skills? How did the coach accomplish
this? Asking those same questions of the coach (i.e., What did you do to
help the person you coach build skills?) would allowfor a rich and detailed
understanding of what coaches do (and can do) to help the individuals they
coach achieve their developmental goals. According to the coaches in our
study, the most important competency of a coach is to listen. Effective
listening skills may be a prerequisite, but surely there is more to effective
coaching that simply listening.
An applied study, such as the one we describe, would allow us to
more clearly understand the behaviors that are associated with effective
coaching. Such a study would also reveal differences, if they exist, in
behaviors that coaches think are effective and those viewed as effective
by the individuals they coach. An intensive study of the coaching process
would also shed light on the difference processes used in electronic and
face-to-face coaching, in ongoing development and coaching focused on a
specic task or project, and between coaching as an external intervention
and supervisory coaching. One role that psychologist coaches, especially
those trained in industrial-organizational psychology, may be well suited
for is to train supervisors howto provide ongoing, developmental coaching
for their employees. Finally, because little is known about how executive
coaching ts into the overall process of developing executives, additional
research focused on when and how organizations select coaching as the
preferred intervention is needed.
Conclusion
We embarked on this research with the notion of linking coach train-
ing and background to coaching practices. One clear implication of our
394 PERSONNEL PSYCHOLOGY
results is that the long standing debate about who makes the best coach
(psychologists or nonpsychologists) may be of limited value. Our results
suggest that relying on educational background alone to predict a coachs
philosophy, process, or behavior is ill advised because it provides lim-
ited information about a coachs practices. Nonetheless, our results do
suggest that psychologist coaches (consistent with their training) tend to
use multiple methods of assessment and evaluation, which may provide
them with a richer picture of a clients needs and more rigorous outcome
evaluation. If organizations expect their executive coaches to evaluate and
diagnose problems, they may be well served by psychologists who are
trained in and more likely to use multiple assessments. It is important
to note, however, that our data show that these differences, even when
statistically signicant, tend to be small.
Overall, results of our study suggest that energy being devoted to the
question of whether or not psychologists make better executive coaches
should be redirected to these questions: What are the knowledge, skills,
and abilities coaches need to help individuals gain insight and motiva-
tion?; and What coach behaviors are the best predictors of long-term
behavior change in the individuals they coach? Psychologists may or may
not make better executive coaches; but, psychologists (and psychologist
coaches) are clearly well trained to answer questions such as these.
REFERENCES
American Management Association. (2008). Coaching: A global study of success-
ful practices. Retrieved March 2, 2009 from http://www.amanet.org/editorial/
webcast/2008/coaching.htm#blank.
Berglas S. (2002). The very real dangers of executive coaching. Harvard Business Review,
80, 8792.
Brotman LE, Liberi WP, Wasylyshyn KM. (1998). Executive coaching: The need for
standards of competence. Consulting Psychology Journal: Practice and Research,
50, 4046.
Brunning H. (2006). The six domains of executive coaching. In Brunning H (Ed.), Execu-
tive coaching: Systems-psychodynamic perspective (pp. 131151). London: Karnac
Books.
Corporate therapy. (2003, November 15). Economist, 369, 61.
Dean ML, Meyer AA. (2002). Executive coaching: In search of a model. Journal of
Leadership Education, 1, 115
Diedrich RC. (1996). An iterative approach to executive coaching. Consulting Psychology
Journal: Practice and Research, 48, 6166.
Executive Coaching Forum. (2004). The executive coaching handbook: Principles and
guidelines for a successful coaching partnership (3rd ed.). Self-published. Available
at www.theexecutivecoachingforum.com
Feldman DC, Lankau MJ. (2005). Executive coaching: A review and agenda for future
research. Journal of Management, 31, 829848.
Filipczak B. (1998). The executive coach: Helper or healer? Training Magazine, 35, 3036.
JOYCE E. BONO ET AL. 395
Foxhall K. (2002). More psychologists are attracted to the executive coaching eld. Monitor
on Psychology, 33, 5053.
Fritsch J, Powers C. (2006). Similarities and differences in organizational coaching pro-
grams between the U.S. government and Fortune 500 companies. In Bennett JL,
Campone F (Eds.), Proceedings of the Fourth International Coach Federation
Coaching Research Symposium (pp. 4154). Lexington, KY: ICF.
Garman AN, Whiton DL, Zlatoper KW. (2000). Media perceptions of executive coaching
and the formal preparation of coaches. Consulting Psychology Journal: Research
and Practice, 52, 201205.
Grant AM. (2001, July). Towards a psychology of coaching. Paper presented at the Fourth
Annual Oxford School of Coaching and Mentoring Conference, Heythrop Park,
Oxford, UK.
Grant AM. (2006). Workplace and executive coaching: A bibliography from the schol-
arly business literature. In Stober DR, Grant AM (Eds.), Evidence based coaching
handbook (pp. 367387). Hoboken, NJ: Wiley.
Hall DT, Otazo KL, Hollenbeck GP. (1999). Behind closed doors: What really happens in
executive coaching. Organizational Dynamics, 27, 3953.
Hart V, Blattner J, Leipsic S. (2007). Coaching versus therapy: A perspective. In Kilburg
RR, Diedrich RC (Eds.), The wisdom of coaching: Essential papers in consulting
psychology for a world of change (pp. 267274). Washington, DC: APA.
International Coaching Federation. (1998). Analysis of 1998 survey of coaching clients by
the International Coach Federation. Retrieved on July 24, 2007. Available at http://
www.coachfederation.org/ICF/For+Current+Members/Member+Resources/
Research/Research+Repository/Client+Survey+Results/
International Coaching Federation. (2007a). ICF coaching study executive sum-
mary. Retrieved on July 24, 2007. Available at http://www.coachfederation.org/
ICF/For+Coaching+Clients/What+is+ICF/Media+Room/
International Coaching Federation. (2007b). ICF membership tops 11,000. Retrieved on
July 24, 2007. Available at http://www.coachfederation.org/ICF/For+Coaching+
Clients/What+is+ICF/Media+Room/
International Coaching Federation. (2007c). Frequently asked questions about coach-
ing. Retrieved on July 24, 2007. Available at http://www.coachfederation.org/
ICF/For+Coaching+Clients/What+is+a+Coach/FAQs
Johnson LK. (2007). Getting more fromexecutive coaching. Harvard Management Update,
12, 36.
Joo BK. (2005). Executive coaching: A conceptual framework from an integrative re-
view of practice and research. Human Resource Development Review, 4, 462
488.
Judge WQ, Cowell J. (1997). The brave new world of executive coaching. Business Hori-
zons, 40, 7177.
Kampa S, White RP. (2002). The effectiveness of executive coaching: What we know
and what we still need to know. In Lowman RL (Ed.), Handbook of organizational
consulting psychology (pp. 139158). San Francisco: Jossey-Bass.
Kampa-Kokesch S, Anderson MZ. (2001). Executive coaching: A comprehensive review
of the literature. Consulting Psychology Journal: Practice and Research, 53, 205
228.
Kiel F, Rimmer E, Williams K, Doyle M. (1996). Coaching at the top. Consulting Psychol-
ogy Journal: Practice and Research, 48, 6777.
Kilburg RR. (1996). Towards a conceptual understanding and denition of execu-
tive coaching. Consulting Psychology Journal: Practice and Research, 48, 134
144.
396 PERSONNEL PSYCHOLOGY
Kilburg RR. (2004a). Trudging toward Dodoville: Conceptual approaches and case studies
in executive coaching. Consulting Psychology Journal: Practice and Research, 56,
203213.
Kilburg RR. (2004b). When shadows fall: Using psychodynamic approaches in executive
coaching. Consulting Psychology Journal: Practice and Research, 56, 246268.
Levinson H. (1996). Executive coaching. Consulting Psychology Journal: Practice and
Research, 48, 115123.
Lowman RL. (2005). Executive coaching: The road to Dodoville needs paving with more
than good assumptions. Consulting Psychology Journal: Practice and Research, 57,
9096.
McCauley CD, Hezlett SA. (2002). Individual development in the workplace. In Anderson
N, Ones D, Sinangil HK, Viswesvaran C (Eds.), Handbook of industrial, work and
organizational psychology, Vol. 1: Personnel psychology (pp. 313335). Thousand
Oaks, CA: Sage.
McGovern J, Lindemann M, Vergara M, Murphy S, Barker L, Warrenfeltz R. (2001).
Maximizing the impact of executive coaching: Behavioral change, organizational
outcomes, and return on investment. The Manchester Review, 6, 19.
Peterson DB. (1993a, April). Measuring change: A psychometric approach to evaluating
individual coaching outcomes. Presented at the Eighth Annual Conference of the
Society for Industrial and Organizational Psychology, San Francisco.
Peterson DB. (1993b). Skill learning and behavior change in an individually tailored
management coaching and training program. Unpublished dissertation, University
of Minnesota.
Peterson DB. (1996). Executive coaching at work: The art of one-on-one change. Consulting
Psychology Journal: Practice and Research, 48, 7886.
Peterson DB. (2002). Management development: Coaching and mentoring programs. In
Kraiger K (Ed.), Creating, implementing, and managing effective training and de-
velopment (pp. 160192). San Francisco: Jossey Bass.
Peterson DB. (2006). People are complex and the world is messy: A behavior-based
approach to executive coaching. In Stober DR, Grant AM (Eds.), Evidence-based
coaching handbook: Putting best practices to work for your clients (pp. 5176).
Hoboken, NJ: Wiley.
Peterson DB, Hicks MD. (1999, February). The art and practice of executive coaching. Pre-
sented at the annual conference of the Society of Consulting Psychology, Phoenix,
AZ.
Peterson DB, Kraiger K. (2004). Apractical guide to evaluating coaching: Translating state-
of-the-art techniques to the real world. In Edwards JE, Scott JC, Raju NS (Eds.),
The human resources programevaluation handbook (pp. 262282). Thousand Oaks,
CA: Sage.
Ryan AM, Sackett PR. (1987). A survey of individual assessment practices by I-O psy-
chologists. PERSONNEL PSYCHOLOGY, 40, 454488.
Saari LM, Johnson TR, McLaughlin SD, Zimmerle DM. (1988). A survey of management
training and education practices in U. S. companies. PERSONNEL PSYCHOLOGY,
41, 731743.
Saporito TJ. (1996). Business-linked executive development: Coaching senior executives.
Consulting Psychology Journal: Practice and Research, 48, 96103.
Seifert C, Yukl G, McDonald R. (2003). Effects of multisource feedback and a feedback
facilitator on the inuence behavior of managers towards subordinates. Journal of
Applied Psychology, 88, 561569.
Smither JW, London M, Flautt R, Vargas Y, Kucine I. (2003). Can working with an executive
coach improve multisource feedback ratings over time? Aquasi-experimental study.
PERSONNEL PSYCHOLOGY, 56, 2344.
JOYCE E. BONO ET AL. 397
Spychalski AC, Quinones MA, Gaugler BB, Pohley K. (2001). A survey of assessment
practices in organizations in the United States. PERSONNEL PSYCHOLOGY, 50,
7190.
Thatch L, Heinselman T. (1999, March). Executive coaching dened. Training and Devel-
opment, 53, 3539.
Tobias LL. (1996). Coaching executives. Consulting Psychology Journal: Practice and
Research, 48, 8795.
Valerio AM, Lee RJ. (2006). Executive coaching: A guide for the HR professional. San
Francisco: Pfeiffer.
Wasylyshyn KM. (2003). Executive coaching: An outcome study. Consulting Psychology
Journal: Practice and Research, 55, 94106.
Witherspoon R, White RP. (1996). Executive coaching: A continuum of roles. Consulting
Psychology Journal: Practice and Research, 48, 124133.
398 PERSONNEL PSYCHOLOGY
A
P
P
E
N
D
I
X
T
A
B
L
E
A
1
C
o
m
p
a
r
i
s
o
n
o
f
E
f
f
e
c
t
S
i
z
e
s
f
o
r
D
e
s
c
r
i
p
t
i
v
e
I
n
f
o
r
m
a
t
i
o
n
f
o
r
P
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
C
o
a
c
h
d
e
m
o
g
r
a
p
h
i
c
s
.
3
9
.
3
6
.
3
3
.
2
8
.
4
8
.
4
7
.
3
4
.
2
5
A
g
e
.
1
1
.
1
7
.
6
1
.
6
9
.
4
9
.
0
9
.
6
0
E
d
u
c
a
t
i
o
n
1
.
2
5
.
9
0
.
0
1
.
8
6
.
7
7
.
6
7
.
0
1
R
a
c
e
.
1
5
.
3
2
.
2
2
.
4
1
.
0
9
.
1
5
.
0
6
S
e
x
.
1
7
.
3
4
.
3
8
.
4
3
.
7
6
.
8
6
.
0
9
M
a
n
a
g
e
m
e
n
t
e
x
p
e
r
i
e
n
c
e
.
0
8
.
2
3
.
0
3
.
1
3
.
2
0
.
1
5
.
3
5
Y
e
a
r
s
c
o
a
c
h
e
d
.
5
8
.
0
4
.
4
6
.
3
5
.
4
9
.
0
9
.
3
5
P
r
a
c
t
i
c
e
i
n
f
o
r
m
a
t
i
o
n
.
6
2
.
4
3
.
3
1
.
5
0
.
6
1
.
2
4
.
5
7
.
3
3
H
o
u
r
l
y
f
e
e
s
.
2
7
.
1
7
.
1
5
.
3
2
.
0
8
.
4
3
.
3
6
%
i
n
c
o
m
e
f
r
o
m
c
o
a
c
h
i
n
g
.
5
6
.
8
1
.
9
3
.
5
6
.
0
4
.
3
0
.
2
3
L
i
a
b
i
l
i
t
y
i
n
s
u
r
a
n
c
e
.
3
7
.
0
2
.
6
6
.
2
7
.
7
4
1
.
0
4
.
2
5
L
i
c
e
n
s
e
d
p
s
y
c
h
o
l
o
g
i
s
t
1
.
2
8
.
4
1
.
7
6
.
1
3
.
3
3
.
9
1
.
5
3
C
e
r
t
i
e
d
c
o
a
c
h
.
9
1
.
4
4
.
5
2
.
6
8
.
0
7
.
1
0
.
1
7
%
c
o
a
c
h
i
n
g
i
n
U
S
.
4
3
.
1
2
.
0
9
.
6
8
.
2
0
.
7
1
.
4
9
P
a
r
t
i
c
i
p
a
n
t
s
j
o
b
r
o
l
e
s
.
2
3
.
4
2
.
2
4
.
7
2
.
3
1
.
5
1
.
3
6
.
2
6
C
E
O
/
p
r
e
s
i
d
e
n
t
.
0
2
.
3
3
1
.
0
4
.
5
0
.
7
5
.
5
3
.
1
7
V
P
/
d
i
r
e
c
t
o
r
.
1
1
.
0
1
.
4
9
.
0
8
.
5
7
.
4
8
.
0
8
M
i
d
-
l
e
v
e
l
m
a
n
a
g
e
r
.
2
5
.
1
0
.
2
7
.
1
3
.
5
3
.
1
9
.
2
8
JOYCE E. BONO ET AL. 399
T
A
B
L
E
A
1
(
c
o
n
t
i
n
u
e
d
)
E
n
t
r
y
-
l
e
v
e
l
o
r
s
u
p
e
r
v
i
s
o
r
.
1
6
.
1
5
.
3
8
.
1
7
.
2
6
.
2
5
.
0
2
E
n
t
r
e
p
r
e
n
e
u
r
.
6
3
.
6
1
1
.
1
2
.
6
5
.
5
0
.
4
3
.
0
5
S
o
u
r
c
e
o
f
p
a
r
t
i
c
i
p
a
n
t
r
e
f
e
r
r
a
l
.
4
4
.
4
1
.
2
6
.
3
8
.
3
7
.
4
4
.
7
2
.
2
6
P
a
r
t
i
c
i
p
a
n
t
c
o
n
t
a
c
t
s
c
o
a
c
h
d
i
r
e
c
t
l
y
.
4
8
.
2
2
.
1
1
.
6
5
.
3
5
.
8
2
.
4
3
P
a
r
t
i
c
i
p
a
n
t
r
e
f
e
r
r
e
d
b
y
m
a
n
a
g
e
r
.
3
3
.
0
7
.
5
4
.
0
0
.
8
0
.
6
5
.
0
7
P
a
r
t
i
c
i
p
a
n
t
r
e
f
e
r
r
e
d
b
y
H
R
.
3
9
.
3
1
.
1
9
.
7
1
.
5
5
1
.
0
6
.
3
7
C
o
a
c
h
c
o
n
t
a
c
t
s
p
a
r
t
i
c
i
p
a
n
t
d
i
r
e
c
t
l
y
.
5
6
.
4
6
.
5
9
.
1
2
.
1
0
.
4
2
.
2
9
A
v
e
r
a
g
e
d
v
a
l
u
e
.
4
3
.
3
9
.
2
8
.
4
7
.
3
8
.
4
8
.
4
8
.
2
5
N
o
t
e
.
N
=
1
7
2
p
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
2
5
6
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
p
s
y
c
h
o
l
o
g
i
s
t
(
P
/
S
o
c
)
.
=
p
s
y
c
h
o
l
o
g
i
s
t
.
V
a
l
u
e
s
a
r
e
s
t
a
n
d
a
r
d
i
z
e
d
e
f
f
e
c
t
s
i
z
e
s
(
d
v
a
l
u
e
s
)
.
A
v
e
r
a
g
e
d
v
a
l
u
e
s
=
a
v
e
r
a
g
e
o
f
a
b
s
o
l
u
t
e
d
v
a
l
u
e
s
,
i
n
d
i
c
a
t
e
d
i
n
b
o
l
d
.
T
h
e
c
o
m
p
a
r
i
s
o
n
s
a
r
e
c
o
d
e
d
s
o
t
h
a
t
t
h
e
t
o
p
g
r
o
u
p
(
e
.
g
.
,
I
-
O
)
i
s
c
o
m
p
a
r
e
d
t
o
t
h
e
g
r
o
u
p
b
e
l
o
w
(
e
.
g
.
,
C
o
u
n
)
;
i
n
t
h
e
c
o
l
u
m
n
c
o
m
p
a
r
i
n
g
I
-
O
v
e
r
s
u
s
C
o
u
n
,
f
o
r
e
x
a
m
p
l
e
,
a
p
o
s
i
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
t
o
p
g
r
o
u
p
(
I
-
O
)
a
n
d
a
n
e
g
a
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
b
o
t
t
o
m
g
r
o
u
p
(
C
o
u
n
)
.
400 PERSONNEL PSYCHOLOGY
T
A
B
L
E
A
2
C
o
m
p
a
r
i
s
o
n
o
f
E
f
f
e
c
t
S
i
z
e
s
f
o
r
C
o
a
c
h
i
n
g
M
e
t
h
o
d
s
f
o
r
P
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
M
e
d
i
u
m
.
1
7
.
1
7
.
1
7
.
1
9
.
0
8
.
2
7
.
1
4
.
1
7
T
e
l
e
p
h
o
n
e
.
2
8
.
2
6
.
0
3
.
0
9
.
2
8
.
1
1
.
1
6
F
a
c
e
t
o
f
a
c
e
.
4
0
.
3
3
.
2
4
.
0
5
.
5
0
.
2
5
.
2
3
E
-
m
a
i
l
.
0
4
.
0
9
.
4
0
.
0
5
.
2
8
.
3
3
.
0
4
W
e
b
s
i
t
e
/
c
h
a
t
.
1
8
.
0
5
.
4
1
.
3
3
.
2
7
.
0
7
.
2
0
V
i
d
e
o
c
o
n
f
e
r
e
n
c
e
.
1
0
.
1
5
.
0
8
.
0
1
.
0
7
.
0
7
.
1
1
T
r
a
d
i
t
i
o
n
a
l
m
a
i
l
.
0
1
.
2
1
.
0
4
.
0
2
.
2
2
.
0
2
.
2
5
T
y
p
i
c
a
l
n
u
m
b
e
r
o
f
s
e
s
s
i
o
n
s
.
3
1
.
3
2
.
2
2
.
4
7
.
1
8
.
2
8
.
5
3
.
2
2
5
o
r
f
e
w
e
r
.
4
2
.
0
8
.
2
2
.
0
1
.
1
6
.
2
5
.
0
9
6
1
0
.
0
1
.
1
3
.
2
1
.
4
3
.
3
7
.
7
4
.
2
9
1
1
2
0
.
3
1
.
2
9
.
7
7
.
0
8
.
5
1
.
8
4
.
3
4
2
1
3
0
.
4
9
.
3
8
.
6
1
.
2
0
.
1
9
.
3
8
.
1
7
S
c
i
e
n
t
i
c
/
p
h
i
l
o
s
o
p
h
i
c
a
l
a
p
p
r
o
a
c
h
.
1
7
.
2
3
.
1
9
.
2
1
.
2
5
.
2
1
.
2
3
.
2
9
B
e
h
a
v
i
o
r
m
o
d
i
c
a
t
i
o
n
.
3
1
.
2
1
.
3
7
.
1
7
.
6
2
.
1
8
.
3
7
C
o
g
n
i
t
i
v
e
b
e
h
a
v
i
o
r
a
l
.
1
6
.
0
3
.
0
8
.
4
3
.
1
1
.
3
8
.
4
5
P
r
o
c
e
s
s
/
f
a
c
i
l
i
t
a
t
i
o
n
o
r
i
e
n
t
e
d
.
0
1
.
0
5
.
3
4
.
2
1
.
2
9
.
1
3
.
1
4
G
o
a
l
s
e
t
t
i
n
g
.
0
3
.
3
7
.
3
3
.
3
1
.
0
6
.
0
0
.
0
5
N
e
u
r
o
l
i
n
g
u
i
s
t
i
c
p
r
o
g
r
a
m
m
i
n
g
.
4
4
.
0
9
.
0
0
.
3
6
.
1
0
.
4
2
.
3
4
P
s
y
c
h
o
a
n
a
l
y
t
i
c
/
d
y
n
a
m
i
c
.
2
2
.
1
8
.
0
2
.
0
3
.
2
3
.
0
5
.
1
8
S
k
i
l
l
t
r
a
i
n
i
n
g
.
0
3
.
3
6
.
2
6
.
1
8
.
1
0
.
4
3
.
5
1
A
v
e
r
a
g
e
D
v
a
l
u
e
.
2
0
.
2
3
.
1
9
.
2
6
.
1
7
.
2
5
.
2
7
.
2
3
N
o
t
e
.
N
=
1
7
2
p
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
2
5
6
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
-
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
p
s
y
c
h
o
l
o
g
i
s
t
(
P
/
S
o
c
)
.
=
p
s
y
c
h
o
l
o
g
i
s
t
.
V
a
l
u
e
s
a
r
e
s
t
a
n
d
a
r
d
i
z
e
d
e
f
f
e
c
t
s
i
z
e
s
(
d
v
a
l
u
e
s
)
.
A
v
e
r
a
g
e
d
v
a
l
u
e
s
=
a
v
e
r
a
g
e
o
f
a
b
s
o
l
u
t
e
d
v
a
l
u
e
s
,
i
n
d
i
c
a
t
e
d
i
n
b
o
l
d
.
T
h
e
c
o
m
p
a
r
i
s
o
n
s
a
r
e
c
o
d
e
d
s
o
t
h
a
t
t
h
e
t
o
p
g
r
o
u
p
(
e
.
g
.
,
I
-
O
)
i
s
c
o
m
p
a
r
e
d
t
o
t
h
e
g
r
o
u
p
b
e
l
o
w
(
e
.
g
.
,
C
o
u
n
)
;
i
n
t
h
e
c
o
l
u
m
n
c
o
m
p
a
r
i
n
g
I
-
O
v
e
r
s
u
s
C
o
u
n
,
f
o
r
e
x
a
m
p
l
e
,
a
p
o
s
i
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
t
o
p
g
r
o
u
p
(
I
-
O
)
a
n
d
a
n
e
g
a
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
b
o
t
t
o
m
g
r
o
u
p
(
C
o
u
n
)
.
JOYCE E. BONO ET AL. 401
T
A
B
L
E
A
3
C
o
m
p
a
r
i
s
o
n
o
f
E
f
f
e
c
t
S
i
z
e
s
f
o
r
T
o
o
l
s
,
A
c
t
i
v
i
t
i
e
s
,
a
n
d
T
o
p
i
c
s
f
o
r
P
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
N
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
A
s
s
e
s
s
m
e
n
t
t
o
o
l
s
.
2
7
.
2
7
.
2
1
.
2
0
.
3
1
.
2
6
.
4
2
.
2
0
I
n
t
e
r
v
i
e
w
w
i
t
h
c
l
i
e
n
t
.
2
0
.
2
5
.
2
6
.
5
1
.
0
1
.
6
4
.
3
8
I
n
t
e
r
v
i
e
w
w
i
t
h
s
u
p
e
r
v
i
s
o
r
.
3
3
.
0
9
.
2
9
.
4
0
.
4
0
.
7
6
.
3
0
I
n
t
e
r
v
i
e
w
w
i
t
h
p
e
e
r
s
.
3
5
.
0
5
.
4
0
.
3
3
.
5
1
.
8
4
.
2
8
I
n
t
e
r
v
i
e
w
w
i
t
h
f
a
m
i
l
y
.
1
0
.
2
7
.
2
2
.
0
6
.
0
7
.
1
5
.
1
9
A
b
i
l
i
t
y
o
r
a
p
t
i
t
u
d
e
t
e
s
t
.
3
0
.
3
3
.
1
3
.
4
1
.
2
3
.
3
2
.
1
0
I
n
t
e
r
e
s
t
i
n
v
e
n
t
o
r
y
.
3
5
.
1
9
.
0
9
.
2
1
.
1
0
.
1
1
.
0
1
P
e
r
s
o
n
a
l
i
t
y
i
n
v
e
n
t
o
r
y
.
0
8
.
5
0
.
0
9
.
2
1
.
5
8
.
2
9
.
2
6
M
u
l
t
i
s
o
u
r
c
e
b
e
h
a
v
i
o
r
r
a
t
i
n
g
s
.
5
4
.
3
1
.
0
8
.
3
2
.
2
5
.
2
5
.
0
0
R
o
l
e
p
l
a
y
s
.
0
5
.
0
6
.
0
6
.
0
1
.
1
2
.
0
4
.
0
7
A
c
c
e
s
s
t
o
p
e
r
f
o
r
m
a
n
c
e
d
a
t
a
.
4
1
.
0
7
.
2
7
.
3
6
.
3
5
.
7
2
.
2
8
A
c
t
i
v
i
t
i
e
s
.
1
4
.
3
8
.
3
4
.
4
8
.
2
0
.
2
4
.
5
5
.
4
4
B
u
i
l
d
r
a
p
p
o
r
t
.
2
7
.
2
9
.
3
8
.
2
6
.
1
3
.
6
8
.
6
0
I
n
c
r
e
a
s
e
m
o
t
i
v
a
t
i
o
n
.
1
9
.
3
9
.
3
1
.
0
3
.
1
0
.
3
2
.
3
8
D
e
v
e
l
o
p
i
n
s
i
g
h
t
.
0
0
.
3
6
.
0
8
.
0
5
.
2
6
.
1
1
.
4
7
T
e
a
c
h
a
n
e
w
s
k
i
l
l
.
0
5
.
3
8
.
7
0
.
4
5
.
3
0
1
.
1
2
.
7
5
A
s
s
i
s
t
w
i
t
h
s
k
i
l
l
a
p
p
l
i
c
a
t
i
o
n
.
2
1
.
1
6
.
7
3
.
2
4
.
5
9
1
.
0
6
.
3
4
H
o
l
d
c
o
a
c
h
i
n
g
p
a
r
t
i
c
i
p
a
n
t
a
c
c
o
u
n
t
a
b
l
e
.
0
5
.
4
9
.
4
5
.
2
5
.
0
4
.
2
2
.
2
7
S
e
t
b
e
h
a
v
i
o
r
c
h
a
n
g
e
g
o
a
l
s
.
2
2
.
2
1
.
4
9
.
2
2
.
3
1
.
8
0
.
4
2
T
o
p
i
c
a
d
d
r
e
s
s
e
d
i
n
c
o
a
c
h
i
n
g
.
2
3
.
2
6
.
4
5
.
2
3
.
2
1
.
1
8
.
2
7
.
2
3
I
n
t
e
r
p
e
r
s
o
n
a
l
s
k
i
l
l
s
.
1
7
.
0
6
.
1
3
.
1
0
.
1
8
.
2
3
.
0
3
c
o
n
t
i
n
u
e
d
402 PERSONNEL PSYCHOLOGY
T
A
B
L
E
A
3
(
C
o
n
t
i
n
u
e
d
)
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
S
t
r
e
s
s
m
a
n
a
g
e
m
e
n
t
.
4
4
.
3
0
.
3
5
.
3
6
.
0
5
.
0
1
.
0
7
S
t
r
a
t
e
g
i
c
t
h
i
n
k
i
n
g
.
0
2
.
0
7
.
3
1
.
0
8
.
4
3
.
2
6
.
1
7
T
i
m
e
m
a
n
a
g
e
m
e
n
t
.
5
3
.
2
0
.
0
5
.
2
8
.
2
5
.
3
4
.
0
7
C
o
n
i
c
t
m
a
n
a
g
e
m
e
n
t
.
0
4
.
1
5
.
1
7
.
3
8
.
0
1
.
2
3
.
2
2
S
t
a
f
n
g
.
0
2
.
3
8
.
3
2
.
5
2
.
0
6
.
2
1
.
1
5
M
a
n
a
g
e
m
e
n
t
s
t
y
l
e
.
2
8
.
2
0
.
1
9
.
0
1
.
0
2
.
2
8
.
2
4
L
e
a
d
e
r
s
h
i
p
.
0
8
.
3
6
.
2
9
.
0
6
.
0
9
.
2
8
.
3
8
C
o
m
m
u
n
i
c
a
t
i
o
n
.
3
6
.
2
9
.
4
1
.
1
6
.
1
1
.
2
6
.
1
3
A
d
a
p
t
a
b
i
l
i
t
y
/
v
e
r
s
a
t
i
l
i
t
y
.
2
3
.
2
7
.
2
4
.
1
1
.
0
4
.
3
6
.
3
6
M
o
t
i
v
a
t
i
o
n
.
4
2
.
3
5
.
0
8
.
1
6
.
4
9
.
2
7
.
1
9
D
e
l
e
g
a
t
i
o
n
.
0
1
.
4
1
.
2
5
.
2
9
.
1
8
.
5
8
.
6
7
P
l
a
n
n
i
n
g
.
2
3
.
4
4
.
0
8
.
0
7
.
4
6
.
0
0
.
3
7
S
a
l
e
s
/
n
a
n
c
i
a
l
p
e
r
f
o
r
m
a
n
c
e
.
3
0
.
3
1
.
2
9
.
1
0
.
0
3
.
4
3
.
4
1
M
e
n
t
o
r
i
n
g
.
2
7
.
4
6
.
1
1
.
4
9
.
3
7
.
4
0
.
0
3
A
v
e
r
a
g
e
d
v
a
l
u
e
.
2
2
.
2
8
.
2
7
.
2
7
.
2
4
.
2
2
.
3
9
.
2
7
N
o
t
e
.
N
=
1
7
2
p
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
2
5
6
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
-
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
p
s
y
c
h
o
l
o
g
i
s
t
(
P
/
S
o
c
)
.
=
p
s
y
c
h
o
l
o
g
i
s
t
.
V
a
l
u
e
s
a
r
e
s
t
a
n
d
a
r
d
i
z
e
d
e
f
f
e
c
t
s
i
z
e
s
(
d
v
a
l
u
e
s
)
.
A
v
e
r
a
g
e
d
v
a
l
u
e
s
=
a
v
e
r
a
g
e
o
f
a
b
s
o
l
u
t
e
d
v
a
l
u
e
s
,
i
n
d
i
c
a
t
e
d
i
n
b
o
l
d
.
T
h
e
c
o
m
p
a
r
i
s
o
n
s
a
r
e
c
o
d
e
d
s
o
t
h
a
t
t
h
e
t
o
p
g
r
o
u
p
(
e
.
g
.
,
I
-
O
)
i
s
c
o
m
p
a
r
e
d
t
o
t
h
e
g
r
o
u
p
b
e
l
o
w
(
e
.
g
.
,
C
o
u
n
)
;
i
n
t
h
e
c
o
l
u
m
n
c
o
m
p
a
r
i
n
g
I
-
O
v
e
r
s
u
s
C
o
u
n
,
f
o
r
e
x
a
m
p
l
e
,
a
p
o
s
i
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
t
o
p
g
r
o
u
p
(
I
-
O
)
a
n
d
a
n
e
g
a
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
b
o
t
t
o
m
g
r
o
u
p
(
C
o
u
n
)
.
JOYCE E. BONO ET AL. 403
T
A
B
L
E
A
4
C
o
m
p
a
r
i
s
o
n
o
f
E
f
f
e
c
t
S
i
z
e
s
f
o
r
C
o
a
c
h
i
n
g
O
u
t
c
o
m
e
s
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
C
l
i
e
n
t
r
e
p
o
r
t
s
.
3
3
.
3
1
.
3
5
.
4
5
.
5
4
.
0
7
.
1
9
.
2
3
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
p
r
o
c
e
s
s
.
3
5
.
2
6
.
3
2
.
4
5
.
0
5
.
1
8
.
2
1
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
o
u
t
c
o
m
e
s
.
2
1
.
2
0
.
2
0
.
4
8
.
0
1
.
4
5
.
3
6
A
t
t
a
i
n
m
e
n
t
o
f
c
o
a
c
h
i
n
g
g
o
a
l
s
.
1
2
.
3
3
.
4
6
.
5
4
.
1
1
.
1
3
.
1
9
I
n
c
r
e
a
s
e
d
c
o
n
d
e
n
c
e
.
5
3
.
5
2
.
6
1
.
6
4
.
0
9
.
0
3
.
1
1
I
n
c
r
e
a
s
e
d
s
e
l
f
-
u
n
d
e
r
s
t
a
n
d
i
n
g
.
5
0
.
4
2
.
5
2
.
3
9
.
1
1
.
1
4
.
0
2
B
o
s
s
r
e
p
o
r
t
s
.
0
8
.
3
4
.
1
3
.
5
6
.
1
1
.
3
9
.
6
6
.
1
9
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
p
r
o
c
e
s
s
.
0
2
.
2
2
.
7
4
.
0
8
.
5
7
.
7
5
.
1
4
S
a
t
i
s
f
a
c
t
i
o
n
w
i
t
h
o
u
t
c
o
m
e
s
.
1
3
.
0
6
.
4
6
.
1
0
.
4
5
.
7
4
.
1
6
A
t
t
a
i
n
m
e
n
t
o
f
w
r
i
t
t
e
n
g
o
a
l
s
.
0
9
.
0
7
.
3
9
.
0
8
.
3
6
.
6
3
.
1
5
A
t
t
a
i
n
m
e
n
t
o
f
i
m
p
l
i
c
i
t
g
o
a
l
s
.
0
2
.
1
0
.
4
3
.
1
6
.
3
5
.
7
2
.
2
6
B
e
h
a
v
i
o
r
c
h
a
n
g
e
.
1
6
.
1
1
.
4
6
.
1
5
.
4
0
.
8
7
.
2
8
L
e
a
r
n
i
n
g
o
r
s
k
i
l
l
d
e
v
e
l
o
p
m
e
n
t
.
0
2
.
2
0
.
4
6
.
0
7
.
2
6
.
4
6
.
1
3
O
t
h
e
r
s
r
e
p
o
r
t
s
(
p
e
e
r
,
H
R
)
.
2
0
.
3
0
.
2
1
.
5
2
.
0
8
.
1
7
.
5
3
.
3
1
B
e
h
a
v
i
o
r
c
h
a
n
g
e
.
2
1
.
1
0
.
3
7
.
1
0
.
2
8
.
5
5
.
2
0
L
e
a
r
n
i
n
g
o
r
s
k
i
l
l
d
e
v
e
l
o
p
m
e
n
t
.
1
8
.
3
3
.
4
0
.
0
5
.
0
5
.
5
0
.
4
0
O
b
j
e
c
t
i
v
e
r
e
p
o
r
t
s
.
0
7
.
2
0
.
1
8
.
2
3
.
1
6
.
1
9
.
1
9
.
2
3
B
u
s
i
n
e
s
s
o
u
t
c
o
m
e
s
(
$
,
s
a
l
e
s
)
.
0
9
.
1
0
.
0
9
.
1
9
.
0
2
.
1
1
.
0
9
P
r
o
m
o
t
i
o
n
.
0
0
.
0
2
.
4
3
.
0
8
.
4
6
.
3
5
.
1
0
c
o
n
t
i
n
u
e
d
404 PERSONNEL PSYCHOLOGY
T
A
B
L
E
A
4
(
C
o
n
t
i
n
u
e
d
)
V
a
r
i
a
b
l
e
v
s
.
n
o
n
A
v
g
.
v
s
I
-
O
v
s
.
C
o
u
n
I
-
O
v
s
.
C
l
i
n
I
-
O
v
s
.
P
/
S
o
c
C
l
i
n
v
s
.
C
o
u
n
P
/
S
o
c
v
s
.
C
l
i
n
P
/
S
o
c
v
s
.
C
o
u
n
R
e
d
u
c
e
d
c
o
m
p
l
a
i
n
t
s
.
0
5
.
1
5
.
1
5
.
2
0
.
3
2
.
4
0
.
0
4
R
O
I
b
a
s
e
d
o
n
u
t
i
l
i
t
y
a
n
a
l
y
s
i
s
.
0
3
.
3
6
.
2
5
.
1
3
.
0
9
.
1
2
.
2
3
E
m
p
l
o
y
e
e
a
t
t
i
t
u
d
e
c
h
a
n
g
e
(
s
u
r
v
e
y
)
.
1
6
.
2
7
.
2
1
.
2
0
.
0
8
.
0
0
.
0
8
C
o
a
c
h
e
s
a
s
s
e
s
s
m
e
n
t
o
f
.
1
8
.
1
5
.
1
1
.
1
9
.
1
8
.
1
6
.
0
7
.
1
7
E
f
c
a
c
y
o
f
c
o
a
c
h
i
n
g
p
r
o
c
e
s
s
.
1
8
.
0
6
.
1
5
.
1
3
.
0
8
.
0
2
.
0
6
E
f
c
a
c
y
o
f
c
o
a
c
h
i
n
g
o
u
t
c
o
m
e
s
.
1
2
.
0
2
.
2
1
.
2
2
.
1
8
.
0
2
.
1
9
A
t
t
a
i
n
m
e
n
t
o
f
w
r
i
t
t
e
n
g
o
a
l
s
.
0
9
.
1
3
.
2
0
.
1
1
.
0
7
.
0
9
.
0
2
A
t
t
a
i
n
m
e
n
t
o
f
i
m
p
l
i
c
i
t
g
o
a
l
s
.
1
4
.
2
4
.
1
2
.
2
7
.
3
3
.
1
5
.
4
5
I
n
c
r
e
a
s
e
d
s
e
l
f
-
u
n
d
e
r
s
t
a
n
d
i
n
g
.
3
5
.
1
0
.
2
5
.
1
9
.
1
5
.
0
6
.
0
9
A
v
e
r
a
g
e
d
v
a
l
u
e
.
1
6
.
2
3
.
1
9
.
2
7
.
2
3
.
2
1
.
3
1
.
1
8
N
o
t
e
.
N
=
1
7
2
p
s
y
c
h
o
l
o
g
i
s
t
s
a
n
d
2
5
6
n
o
n
p
s
y
c
h
o
l
o
g
i
s
t
s
;
N
=
3
9
C
o
u
n
s
e
l
i
n
g
,
N
=
3
0
C
l
i
n
i
c
a
l
,
N
=
8
3
I
n
d
u
s
t
r
i
a
l
-
o
r
g
a
n
i
z
a
t
i
o
n
a
l
(
I
-
O
)
,
a
n
d
N
=
2
0
P
e
r
s
o
n
a
l
i
t
y
a
n
d
s
o
c
i
a
l
p
s
y
c
h
o
l
o
g
i
s
t
(
P
/
S
o
c
)
.
=
p
s
y
c
h
o
l
o
g
i
s
t
.
V
a
l
u
e
s
a
r
e
s
t
a
n
d
a
r
d
i
z
e
d
e
f
f
e
c
t
s
i
z
e
s
(
d
v
a
l
u
e
s
)
.
A
v
e
r
a
g
e
d
v
a
l
u
e
s
=
a
v
e
r
a
g
e
o
f
a
b
s
o
l
u
t
e
d
v
a
l
u
e
s
,
i
n
d
i
c
a
t
e
d
i
n
b
o
l
d
.
T
h
e
c
o
m
p
a
r
i
s
o
n
s
a
r
e
c
o
d
e
d
s
o
t
h
a
t
t
h
e
t
o
p
g
r
o
u
p
(
e
.
g
.
,
I
-
O
)
i
s
c
o
m
p
a
r
e
d
t
o
t
h
e
g
r
o
u
p
b
e
l
o
w
(
e
.
g
.
,
C
o
u
n
)
;
i
n
t
h
e
c
o
l
u
m
n
c
o
m
p
a
r
i
n
g
I
-
O
v
e
r
s
u
s
C
o
u
n
,
f
o
r
e
x
a
m
p
l
e
,
a
p
o
s
i
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
t
o
p
g
r
o
u
p
(
I
-
O
)
a
n
d
a
n
e
g
a
t
i
v
e
v
a
l
u
e
i
n
d
i
c
a
t
e
s
a
h
i
g
h
e
r
m
e
a
n
f
o
r
t
h
e
b
o
t
t
o
m
g
r
o
u
p
(
C
o
u
n
)
.