ERI Users Manual 2
ERI Users Manual 2
For The
Employee Reliability Inventory
Gerald L. Borofsky, PhD
1.800.661.5158
www.psychometrics.com
Revision 6.0 - 11/93
Revision 6.5 CDN -10/2004
ERI® IS A TRADEMARK OF
PSYCHOMETRICS CANADA LTD.
NO MATERIAL DESCRIBING THE ERI® MAY BE PRODUCED
OR DISTRIBUTED WITHOUT THE WRITTEN PERMISSION OF
PSYCHOMETRICS CANADA LTD.
©
COPYRIGHT 2017
PSYCHOMETRICS CANADA LTD.
ALL RIGHTS RESERVED
1. INTRODUCTION 1
1.1 PRE-EMPLOYMENT SELECTION PROGRAMS 1
1.2 UNRELIABLE AND UNPRODUCTIVE BEHAVIOR 2
1.2.1 TYPES OF UNRELIABLE AND UNPRODUCTIVE BEHAVIOR 2
1.2.2 COMMON CAUSES OF UNRELIABLE BEHAVIOR 2
1.2.3 THE MULTIFACTORIAL NATURE OF UNRELIABLE
AND UNPRODUCTIVE BEHAVIOR 2
2. ERI® - EMPLOYEE RELIABILITY INVENTORY 4
2.1 DESCRIPTION 4
2.2 RECOMMENDED USE OF THE ERI® 4
3. PROCEDURES AND INSTRUCTIONS FOR THE USE,
ADMINISTRATION, AND SCORING OF THE ERI® 4
3.1 GENERAL INFORMATION REGARDING THE USE OF THE ERI® 4
3.2 LIMITATIONS TO THE USE OF THE ERI® 8
3.3 ERI® USER AUTHORIZATION 8
3.4 ADMINISTRATION OF THE ERI® 8
4. REPORTING AND INTERPRETING ERI® RESULTS 10
4.1 REPORTING ERI® RESULTS 10
4.2 SOME INTERPRETIVE GUIDELINES 10
5. MAKING USE OF ERI® RESULTS 13
5.1 SOME IMPORTANT PRINCIPLES OF ERI® USE 13
5.2 AN IMPORTANT NOTE REGARDING SMALL
DIFFERENCES IN RESULTS 14
5.3 REVIEWING RESULTS FOR POSSIBLE PROBLEMS 14
5.4 "FAKING GOOD" AND ERI® RESULTS 15
5.5 USING THE ERI® AS A PRE-INTERVIEW QUESTIONNAIRE 16
5.5.1 SOME GENERAL GUIDELINES FOR ASKING
FOLLOW-UP QUESTIONS 16
5.6 TECHNICAL SUPPORT 17
6. CONSTRUCTION AND VALIDATION OF THE ERI® 17
6.1 ORIGINAL CONSTRUCTION OF THE ERI® 17
6.2 ORIGINAL VALIDATION OF THE ERI® 18
6.2.1 CONSTRUCT-RELATED VALIDITY AND THE ERI® 18
6.2.2 CONTENT-RELATED VALIDITY AND THE ERI® 18
6.2.3 CRITERION-RELATED VALIDITY AND THE ERI® 18
6.3 R SCALE 19
6.3.1 CRITERION GROUPS 19
6.3.2 VALIDATION 20
6.3.3 CROSS-VALIDATION 20
7. SUBSEQUENT DEVELOPMENT OF THE ERI® 21
7.1 A SCALE: CONSTRUCTION AND VALIDATION 21
7.1.1 CRITERION GROUPS 21
7.1.2 VALIDATION 22
7.1.3 CROSS-VALIDATION 22
7.2 C SCALE: CONSTRUCTION AND VALIDATION 23
7.2.1 CRITERION GROUPS 23
7.2.2 VALIDATION 23
7.2.3 CROSS-VALIDATION 24
7.3 E SCALE: CONSTRUCTION AND VALIDATION 24
7.3.1 CRITERION GROUPS 24
7.3.2 VALIDATION 25
7.3.3 CROSS-VALIDATION 25
7.4 F SCALE: CONSTRUCTION AND VALIDATION 26
7.4.1 CRITERION GROUPS 26
7.4.2 VALIDATION 26
7.4.3 CROSS-VALIDATION 26
7.5 H SCALE: CONSTRUCTION AND VALIDATION 27
7.5.1 CRITERION GROUPS 27
7.5.2 VALIDATION 27
7.5.3 CROSS-VALIDATION 28
7.6 Q SCALE: CONSTRUCTION AND VALIDATION 28
7.6.1 CRITERION GROUPS 28
7.6.2 VALIDATION 28
7.6.3 CROSS-VALIDATION 29
7.7 S SCALE: CONSTRUCTION AND VALIDATION 29
7.7.1 CRITERION GROUPS 30
7.7.2 VALIDATION 30
7.7.3 CROSS-VALIDATION 30
8. SOME PSYCHOMETRIC PROPERTIES OF THE ERI® 31
8.1 DESCRIPTIVE STATISTICS 31
8.2 Q UENCY DISTRIBUTIONS FOR ERI® SCALES
FREQ 32
8.3 INTERCORRELATION OF THE ERI® SCALES 33
8.4 TEST-RETEST RELIABILITY OF THE ERI® SCALES 33
9. FAIRNESS OF THE ERI® AND ADVERSE IMPACT 34
9.1 RACE 34
9.2 GENDER 36
9.3 AGE 36
9.4 SUMMARY 36
10. SELECTED REFERENCES 37
APPENDICES
APPENDIX: SAMPLE REPORT
R
1, 2
Gerald L. Borofsky, Ph.D.
1
• Psychologically-Based Assessment reasons, only remain on the job for a short
Methods (Questionnaires and Tests) period of time (e.g. being fired for violations of
company policy or drifting from job to job).
1.2 UNRELIABLE AND This type of behavior can seriously disrupt an
UNPRODUCTIVE BEHAVIOR
organization’s ongoing effectiveness. Such
1.2.1 TYPES OF UNRELIABLE turnover also results in significantly increased
AND UNPRODUCTIVE BEHAVIOR administrative and training costs associated
with the recruiting, hiring, and training of new
A 1983 study sponsored by the National Insti-
employees.
tute of Justice3 revealed that many organiza-
tions in this country are being negatively 1.2.2 COMMON CAUSES OF
affected by the presence of employees whose UNRELIABLE AND
overall performance on-the-job is characterized UNPRODUCTIVE BEHAVIOR
2
Pre-employment selection procedures may unproductive behavior should be sufficient to
indicate that an applicant appears acceptable accurately identify the “bad apples” in an
in terms of his or her training and experience, applicant pool.
and that his/her job performance appears
unlikely to be disrupted as a consequence of An alternative perspective can be called the
his/her pattern of alcohol or illegal drug use. multifactorial view of behavior. According to
On this basis, would it be reasonable for an this point of view, different individuals perform
employer to assume that the applicant is also unproductively or unreliably for different
likely to work cooperatively with others and to reasons. For example, one job applicant may
exercise good judgment on the job? Would it have personality traits which are well suited to
also be reasonable for an employer to assume the requirements of the job, but may be vulner-
that the applicant will make a long term com- able to performing unreliably on the job as a
mitment to the job? consequence of his/her pattern of illegal drug or
alcohol use. Another job applicant may be
Whether the various causes of unreliable and trustworthy but may be vulnerable to perform-
unproductive behavior are intercorrelated has ing unreliably on the job as a result of person-
implications for the design of pre-employment ality traits which conflict with the requirements
selection programs. If there are significant of the job.
interrelationships between the various causes,
then an employer might be able to assess job The multifactorial perspective accepts that
applicants for just one cause, on the assump- there may be some degree of intercorrelation
tion that he or she was concurrently assessing among the various causes of unreliable and
applicants for the other causes as well. On the unproductive behavior. However, unlike the
other hand, if these five causes are relatively “bad apple” viewpoint, the conclusion to be
uncorrelated, it would seem advisable to in- drawn from the multifactorial perspective is
clude procedures which assess applicants for that a comprehensive pre-employment selection
each job relevant cause. program should assess job applicants for all of
the job-relevant causes of unreliable behavior.
Conventional wisdom seems to subscribe to According to the multifactorial view, it is quite
what can be called the “bad apple” view of unlikely that assessing job applicants for just
behavior. According to this point of view, all one cause of unreliable behavior will ad-
unreliable and unproductive people are more or equately call attention to applicants who may
less similar to each other, in that they are all be likely to perform unreliably on the job due to
likely to manifest multiple causes of unreliable other causes.
behavior. For example, the “bad apple” per-
spective would predict that if a job applicant is Preliminary studies, including the correlation
likely to demonstrate maladaptive personality matrix for the scales of the Employee Reliability
traits on the job, he or she is also likely to have Inventory (ERI® ) shown in Section 8.3 of this
disrupted job performance as a consequence of Manual, seem to favor the validity of the multi-
his/her pattern of illegal drug or alcohol use, factorial perspective over the “bad apple” point
and is likely to perform on the job in an un- of view.6
trustworthy manner. For purposes of pre- 6 Evans, M.A., McGee, M.P., and Borofsky, G.L. Psychological
evaluation and illicit drug use in an industrial population.
employment assessment, the implication of the Proceedings. American Academy of Forensic Science. 1986.;
Borofsky, G.L., Friedman, J.,and Pignato, J. C., Interrelationships
“bad apple” perspective is that assessing appli- Among Various Causes Of Unreliable Behavior In The Work-
place, Research Bulletin, Number 400-9. Groton, MA: Human
cants for any single cause of unreliable or Reliability Institute, 1987
3
2. ERI® - EMPLOYEE RELIABILITY completed the employment application and
INVENTORY
before they are interviewed or references are
2.1 DESCRIPTION verified. When used in this manner, the ERI®
can serve as an objective method for assessing
The ERI® is a criterion-keyed, self-adminis- issues related to job performance, which can
tered, “True - False” type of behavior inventory. then be explored further during interviews and
It contains 81 statements, which are worded at reference verification. If an applicant’s score on
a sixth grade reading level. Results for each one or more scales suggests a possible problem
scale are presented in an easy to understand area, subsequent interviews and the verifica-
format designed to add flexibility to your tion process can be used to develop additional
selection process. Results provide an estimate information, which will clarify, confirm or call
of the likelihood that a job applicant will into question the ERI® results. Coordinated
perform, on the job, in a reliable and produc- use of the ERI® with focused inquiries during
tive manner. interviews and verification, should increase the
likelihood of identifying reliable and productive
The ERI® consists of seven (7) separate scales.
individuals prior to making a hiring decision.
Each scale assesses job applicants with respect
to a different dimension of reliable and produc- Because it was validated as a pre-employ-
tive behavior7. The seven (7) ERI® scales are ment questionnaire, the ERI® should not be
described on the following page. used to evaluate current employees or for
any purpose other than as an aid in the pre-
2.2 RECOMMENDED
USE OF THE ERI® employment selection process.
The ERI® was designed and developed to be The ERI® is not a medical examination, nor
used as one part of a company’s pre-employ- should it be administered in a medical setting.
ment selection program. The purpose of the It is not a psychological stress evaluator, is not
ERI® is to assist employers in their efforts to invasive, and does not measure physiological or
hire reliable and productive employees. It was psychological responses in the subject being
designed to be used where production devi- assessed.
ance, property deviance, and unplanned and
3. PROCEDURES AND INSTRUCTIONS
uncontrolled turnover are important job con- FOR THE USE, ADMINISTRATION
cerns. Accordingly, the ERI® should be used AND SCORING OF THE ERI®
where such behaviors are related to job perfor-
3.1 GENERAL INFORMATION
mance in the position for which the applicant is REGARDING THE USE OF
being considered. THE ERI®
The ERI® was designed to be used as a pre- 1. The ERI® user materials include docu-
interview questionnaire. For this reason, it is mentation, technical information,
recommended that the ERI® be administered to business information as well as various
job applicants immediately after they have printed materials, which are collectively
7 Each of the ERI® scales assesses job applicants with respect referred to as “ERI® documentation and
to a different behavioral dimension. The scales estimate the materials”.
likelihood that an applicant, if hired, would perform on the job in
a reliable and productive manner.
However, you should be aware that subsequent changes in a
person’s life and work environment (both positive and negative)
can affect his/her performance on the job. Supervisory knowl-
edge of employees and supervisory observation of on the job
behavior are commonly - used techniques for monitoring and
helping to enhance job performance, once an applicant is hired.
4
®
ERI SCALES
Courtesy
Assesses the likelihood that an applicant's interactions with
C customers/guests will be characterized by a high level of
courtesy and commitment to service.
Emotional Maturity
Assesses the likelihood that an applicant's work performance
will be characterized by mature behavior, and that it will not
E be disrupted due to the presence of maladaptive personality
traits such as irresponsibility, poor judgement, difficulty in
working cooperatively with others, poor frustration tolerance or
poor impulse control.
It is important to emphasize that this scale does not assess,
nor should it be used to assess, for the presence of a mental or
psychological impairment or disorder, or an applicant's
general physical or psychological health.
Conscientiousness
Trustworthiness
H Assesses the likelihood that a candidate will perform in a
trusworthy manner and will not engage in various forms of
property deviant behavior.
5
2. ERI® documentation and materials 5. Only ERI® scale scores should be used.
should be used solely for pre-employ- Answers to the individual statements
ment purposes. They should not be contained in the ERI® should never be
used to assess existing employees or for used as part of the selection process.
any other purpose.
6. At no time should ERI® results be
3. In order for the ERI® to be effective as a
discussed with applicants, regardless of
pre-interview questionnaire, it is neces-
the selection outcome. For reasons of
sary to insure that you, your employees
security and confidentiality, ERI®
(or representatives), and job applicants,
results should never be discussed with
fully comply with all of the procedures
® unauthorized employees or representa-
and instructions contained in the ERI
tives.
documentation and materials, includ-
ing, but not limited to those contained 7. A job applicant’s failure or refusal to
in this User’s Manual. completely follow the instructions given
to him/her should not be the basis for
ERI® documentation and materials making any inferences regarding that
should not be reproduced or copied, in individual’s future job performance.
whole or in part, except as necessary for
use by you, as authorized in this 8. You and your authorized employees or
representatives should be aware that
Manual.
access to ERI® results which are part of
You and your authorized employees or an employee’s personnel, medical or
representatives should not mark, alter other records, may be governed by
or deface ERI® documentation and specific laws in your state. For this
materials other than in accordance with reason, only authorized individuals
the Procedures and Instructions con- should have access to ERI® results.
tained in this Manual.
9. Psychometrics Canada has developed
4. The ERI® should be used, administered certain trade secrets, confidential and
and scored only by your authorized proprietary information in the
employees or representatives who have development and use of the ERI®
read and are thoroughly familiar with documentation and materi-als,
the procedures and instructions con- including but not limited to, scoring and
tained in this Manual, and in other ERI® results, information proce-dures,
® systems, techniques, forms, methods
ERI documentation and materials.
and the like which are unique to
Psychometrics Canada and its business
and are not of general public knowledge.
6
All such ERI® documentation and
12. Psychometrics Canada reserves the right to
materials furnished to users should be
revoke or cancel, without advance notice, a user’s
considered confidential. Because of the
license to use the ERI® documentation and
nature of Psychometrics Canada's business materials if the user or the user’s employees or
and the nature of the ERI®, disclosure or representatives fail to comply with all of the
dis-semination of the ERI® documentation Procedures and Instructions contained in the ERI®
and materials could damage the effec- documentation and materials, including, but not
limited to those contained in the ERI® User’s
tiveness of the ERI® as a pre-employ-ment
Manual, the ERI® Guide For Computer Scoring, as
questionnaire and/or compromise the
well as any subsequent revisions or updates sent to
competitive position of Psychometrics you by Psychometrics Canada.
Canada in the marketplace.
7
3.2 LIMITATIONS TO THE USE OF
THE ERI ® Computer Scoring, as well as any subsequent
1. The ERI® was developed and validated revisions or updates, sent to you by
to be used as a pre-employment assess- Psychometrics Canada.
ment tool. It is to be used for the
In order to document the above requirements, it
assessment of new job applicants.
Under no circumstances should theERI® is necessary that Psychometrics Canada have a
used for any purpose other than as an (Computer Scoring or Template Scoring version)
on file for all companies using the ERI®. A copy
aid in the pre-employment selection
of the appropriate version of this form is sent to
process.
you with your order. If for any reason you are
2. The ERI® is not designed to reveal, nor unable to locate this form, please make a copy
should it be used for the purpose of of the sample form included as Appendix E of
revealing, the existence, nature, or this Manual, and use this copy to complete and
severity of a disability, as defined under send to Psychometrics Canada.
the Canadian Human Rights Act.3.
3.4 ADMINISTRATION OF THE ERI ®
The decision to hire or not hire a specific
applicant should not be based solely on
the applicant’s ERI® scores. Hiring
THE ERI ® CAN BE COMPLETED THROUGH YOUR
decisions should be based on a review of
CAREERID SITE.
ALL information collected during the
conduct of the total selection process
.
8
®
PREPARING THE APPLICANT TO APPLICANT’S COMPLETION OF THE ERI
TAKE THE ERI ®
If applicants have questions about answering a
1. Be sure that the ERI® is administered in particular statement, instruct them to use the
a quiet and well-lit location, which is as guidelines contained in the test instructions,
free from distractions as possible. as the basis for coming up with their answer.
Please be sure that the administration If an applicant states that he/she is unable
of the ERI® is conducted in a profes- to answer a particular statement because it
sional manner and that, among other does not apply to him/er (e.g., statement 60,
things, the applicant is encouraged to because he/she never goes into bars), the
adopt a serious and thoughtful ap- applicant should be told to answer the statement
proach to answering all statements. as being “False”.
Research has shown that use of the You may not tell the applicant how to answer a
ERI® does not result in discrimination on statement. However, if the applicant does not
the basis of race, gender, or age (Please understand the meaning of certain words or
refer to Section 9 of this Manual for expressions, you may explain what the word or
detailed information). Nonetheless, expression means.
please be sure to assess each individual
applicant to determine if cultural, ethnic, INSTRUCT APPLICANTS THAT ALL 81
or language factors are likely to interfere STATEMENTS MUST BE ANSWERED AND
with his/her ability to understand the THAT THEY SHOULD GIVE ONLY ONE AN-
ERI® instructions and statements. SWER FOR EACH STATEMENT.
Needless to say, a failure to accurately
understand the instructions and state-
ments, due to cultural, ethnic, or educa-
tional causes, can significantly affect the
accuracy and usefulness of the ERI®. In
this regard, please note that in addition
®
to English, the ERI is available in
Spanish and French translations.
9
®
4. REP0RTING AND INTERPRETING ERI 1. The applicant’s score on each scale is
RESULTS shown as a horizontal line extending
® from left to right. Shorter lines indicate
4.1 REP0RTING ERI RESULTS
a higher likelihood of unreliable behavior.
®
For purposes of communicating ERI results, Longer lines indicate a higher likelihood
scores are reported in terms of a system of four of reliable behavior.
(4) arithmetically equal-sized zones (designated
1 through 4). Each of the four zones is further 2. For each scale, different applicants can
subdivided into two (2) arithmetically equal- be compared, based on the “zone” into
sized zones (A and B). Results for each of the which their results fall. Results in Zone
®
ERI scales are reported as falling into one of 1 indicate there is a higher likelihood
the eight (8) zones, as shown in the diagram the applicant will behave in a reliable
below. manner. Results in Zone 4 indicate
there is a higher likelihood the appli-
cant will behave in an unreliable
manner. Results in Zone 3A indicate
there is a higher likelihood of reliable
behavior than results in Zone 3B.
RELIABILITY
Appendices C and D of this Manual contains You can also use this system of zones to get an
samples of how this system of zones appears approximate idea of how “low” or “high” the
on the written report of results which is sent to applicant’s score is on each scale, relative to
Template Scoring users, at the end of each day. the range of possible scores that can be ob-
A similar, but less graphically elaborate repre- tained on that scale.
sentation of the eight zones appears on your
®
computer screen, each time you score an ERI 1. The table on the back side of these
using the in-house computer scoring option. forms can also be used to help you
approximate where an applicant’s
4.2 SOME INTERPRETIVE GUIDELINES
10
The table shows the approximate regions of the country, represents all 10
percentage of job applicants who fall Standard Industrial Classification (SIC)
into each zone. The table also shows Code Divisions, 54 Major SIC Groups,
the cumulative percentage of job appli- and a wide range of job categories. In
cants who fall into that zone plus the looking at this table, one can see that
zones to the left of that zone. applicants’ results are distributed
continuously along each of the behav-
The table is based on a group of over ioral - psychological dimensions mea-
60,000 job applicants who completed sured by the ERI .
®
®
the ERI as part of their pre-employ-
ment processing. This normative group
of job applicants is drawn from all
NOTES:
The upper number in parentheses represents the percentage of job applicants in the normative sample who fall into that
particular zone.
The lower number with no parentheses represents the percentage of job applicants in the normative sample who fall into
that zone, plus the zones to the left of that zone - i.e., they represent the cumulative percentage.
For example on the F scale 2.8% of job applicants in the normative sample fall into zone 3A, and 90.2% of job applicants in
the normative sample fall into zone 3A or one of the lower zones (i.e., zones 1A, 1B, 2A, and 2B). Put slightly differently,
90.2% of job applicants in the normative sample get a score in zone 3A or a better score. Only 9.8% (100.0% - 90.2%) get a
poorer score.
11
The table shown below, like the one on the contrast to the previous table, however, here
previous page, shows the distribution of scores the cells indicate the approximate percentile
® ®
on each of the seven ERI scales, for the same distributions for each of the seven ERI scales.
sample of over 60,000 job applicants. In
NOTES:
The number in each cell represents the approximate percentage of job applicants in the normative sample who obtained
scores on that scale which were "poorer" than the job applicant's.
As an illustration of how to use this table, please note that in the normative sample, the number 10 appears in zone 3A for
the F scale. This indicates that scores in this zone are at approximately the 10th percentile (i.e., approximately 10% of the
job applicants in the normative sample obtained scores on the F scale that were "poorer" than zone 3A, or put slightly
differently, approximately 10% of the normative sample obtained F scale scores in zones 3B, 4A, or 4B).
12
® ®
5. MAKING USE OF ERI RESULTS 3. The seven ERI scales estimate the
likelihood that an applicant, if hired,
5.1 SOME IMPORTANT PRINCIPLES
® would perform on the job in a reliable
OF ERI USE
and productive manner. However, you
®
When making use of an applicant’s ERI should be aware that subsequent
®
results, please remember that the ERI is a changes in a person’s life and work
pre-employment questionnaire which is de- environment (both positive and nega-
signed to help employers systematically identify tive) can affect his/her performance on
reliable and productive individuals prior to the job. Supervisory knowledge of
making a hiring decision. The questionnaire employees and supervisory observation
assesses factors related to job performance of on the job behavior are commonly -
which can then be explored further during used techniques for monitoring and
interviews and reference verification. Please helping to enhance job performance,
adhere to each of the following principles when once an applicant is hired.
®
using the ERI .
4. Because it is a pre-employment ques-
1. In order to make effective and accurate tionnaire, it is recommended that the
® ®
use of an applicant’s ERI results, it is ERI be administered to job applicants
necessary that you be thoroughly immediately after they have completed
®
familiar with what each ERI scale the application for employment and
assesses, the limitations to the use of before they are interviewed or references
®
the ERI , and the manner in which the are verified. When utilized in this
®
ERI was validated. These are covered manner, the ERI® can serve as an
in Sections 2 through 9 of this Manual. objective method for assessing issues
related to job performance, which can
2. The ERI® was developed and validated then be explored further during inter-
as a pre-employment assessment tool. views and reference verification.
For that reason, it is to be used only for
the assessment of new job applicants.
Under no circumstances should the
ERI® be administered to current em-
ployees or individuals other than actual
job applicants, nor should it be used for
any purpose other than as an aid in the
pre-employment selection process.
13
5. Under no circumstances should the 2. An applicant who is able to read and
decision to hire or not hire an applicant understand the ERI® statements may
®
be based solely on his/her ERI results. nonetheless, choose to not read the
Hiring decisions should be based on a statements carefully, or to not read the
review of ALL information collected by statements at all, before answering.
you during the applicant evaluation Under these circumstances, as well, the
process. applicant has functionally guessed
when answering the statements.
5.2 AN IMPORTANT NOTE REGARDING
SMALL DIFFERENCES IN RESULTS
Under either of these circumstances, it is
highly likely that the applicant’s results will
Because of the variability inherent in any type
® have a characteristic form to them. Typically,
of scores, small differences in ERI results
should never be used as the basis for making there will be two or more scales which have
scores in Zone 4. Routinely examining each
decisions about applicants or for comparing
applicant’s results for this pattern will provide
applicants.
you with an additional check as to the validity
5.3 REVIEWING RESULTS FOR POSSIBLE of the results. 13
PROBLEMS
If you discover that an applicant’s results have
The failure of an applicant to carefully read and
two or more scores in zone 4, it is necessary to
understand each of the 81 statements can
speak with the applicant, in order to determine
significantly affect the accuracy and usefulness
the specific cause of these scores.
of the ERI®. Invalid results may be produced
under two different sets of circumstances. If, upon inquiry, the applicant acknowledges a
difficulty in reading comprehension, you
1. Although statements are worded at a
should review the questionnaire with the
sixth grade reading level, cultural,
applicant, in order to determine the specific
ethnic, language, or educational factors
statements where this difficulty was encoun-
could theoretically contribute to reading
tered. As noted earlier, you may not tell the
comprehension difficulties for some
applicant how to answer a statement, however,
applicants. In spite of having assessed
if the applicant does not understand the
each individual applicant to determine
meaning of certain words or expressions, you
his/her ability to understand the ERI®
may explain what the word or expression
instructions and statements (as noted
means.
in Section 3.4.2), it is possible that an
applicant may have encountered read- If the applicant states that he/she was able to
ing comprehension difficulties, without understand all of the 81 statements, then you
the administrator being aware of this should urge the applicant to review his/her
fact. Under such circumstances the answers, to insure that each response is based
applicant has had to guess when an- on a careful reading and consideration of the
swering those statements which he/she statement.
did not understand.
®
Once this has been done, the ERI should then
be rescored. Our experience has been that most
®
ERI
SCALE
15
®
5.5 USING THE ERI 5.5.1 SOME GENERAL GUIDELINES
AS A PRE-INTERVIEW FOR ASKING FOLLOW-UP
QUESTIONNAIRE QUESTIONS
As noted earlier, use of the ERI® is an objective It should be understood that the sample ques-
method for identifying issues related to job tions being referred to are only intended as
performance which may require further explo- examples of the types of questions that could
ration during interviews and reference verifica- be asked. You should ensure that the particu-
®
tion. Use of the ERI can help you to make the lar wording you choose for your questions does
most effective use of your time during inter- not violate any applicable statutory or regula-
views and reference verification by helping you tory restrictions, including the provisions of the
to selectively focus your questions in those Americans With Disabilities Act (ADA).
specific areas of reliable and productive behav-
ior which are important in the particular job In asking follow-up questions you also should
setting for which the applicant is being consid- keep the following guidelines in mind:
®
ered. Coordinated use of the ERI, with fo-
• Questions should not be accusatory.
cused inquiries during interviews and reference
verification, should greatly increase the likeli- • Questions should be limited to content
hood of your identifying reliable and productive areas which are relevant and necessary
individuals prior to making a hiring decision
. for the performance of the specific job for
which the applicant is applying.
If an applicant’s score on one or more of the
®
ERI scales suggests a possible problem area, • There should be a direct relationship
the applicant can be questioned in greater between the information being sought
detail than usual about their past record of on-
and the specific requirements of the job
the-job performance, in the specific area(s) of
for which the applicant is applying. For
behavior where a question has been raised by
®
example, you should not ask questions
the ERI results. In similar fashion, questions
dealing with religious beliefs, or affilia-
asked of past employers can focus in greater tions, racial matters, sexual behavior,
detail than usual on the applicant’s job perfor-
political beliefs and affiliations, or
mance in the specific area(s) of behavior where
beliefs or opinions regarding unions or
a question has been raised by the results.
labor organizations.
16
5.6 TECHNICAL SUPPORT
If you have questions about any aspect of ERI In the case of the initial version of the ERI®, the
administration, scoring, interpretation, use, or relevant criterion behaviors were determined to
if you would like to discuss the interpretation be:
®
of a specific applicant’s ERI results, with a
®
member of our staff, please call ERI Technical 1. Impaired on-the-job performanceas a
Support at the numbers listed below. consequence of the person’s pattern of
alcohol or illegal drug use.
15
Bureau of National Affairs, Inc., Uniform Guidelines on Employee
Selection Procedures. (Washington, D.C.: BNA Education Systems,
1979), pp.34
17
This initial form of the ERI ® was administered structs. For this reason, the construct-related
to individuals in each of the three criterion approach to validation was not considered to
groups described above. Using Discriminant be a preferred method for validating the ERI ®.
Function Analysis, with the stepwise minimiza-
tion of residuals method, contained in Statisti- It should be noted however, that factor analy-
cal Package For The Social Sciences (SPSS ),
X 16 sis of each of the seven (7) ERI® scales reveals
answers were analyzed to determine which of the presence of an underlying structure to
the over 500 statements were most effective in each scale.18 For each scale, this underlying
differentiating subjects whose behavior was structure is discernible in the form of psycho-
reliable and productive from those whose logical constructs.
behavior was unproductive or unreliable. By
6.2.2 CONTENT-RELATED VALIDITY
this procedure, the number of items in the AND THE ERI®
ERI® was reduced to 81.
Content-related Validity refers to the degree
6.2 ORIGINAL VALIDATION OF THE to which the content of the individual items in
ERI®
a questionnaire or test are representative of
The Uniform Guidelines on Employee Selection what the questionnaire is purporting to assess.
Procedures and accepted scientific standards 17 In the case of the ERI ®, the issue is whether
require that questionnaires such as the ERI® the content of the individual items in the ERI ®
demonstrate what is known as validity. That is representative of, or related to, the predic-
is, there must be scientifically sound evidence tion of reliable and productive behavior. Con-
that the questionnaire actually measures what tent-related validity is usually most relevant
it claims to measure. Approaches to validation during the initial development of a test or
typically fall into one of three categories: questionnaire.
1) Construct-Related Validity; 2) Content-
Typically, judgments of content-related validity
Related Validity; and 3) Criterion-Related
are made on the basis of expert judgments as
Validity.
to what is the appropriate content for predict-
6.2.1 CONSTRUCT-RELATED VALIDITY ing the specific behavior being assessed. Dur-
AND THE ERI® ing the initial development of the ERI®, an
initial pool of over 500 statements was created,
Construct-Related Validity refers primarily to
which, it was believed, were related to the
the assessment of a particular concept or
specific aspects of reliable and productive
construct. Examples of psychological con-
behavior that were being studied.
structs are: need for achievement, affiliative
drive, self esteem, locus of control, and time 6.2.3 CRITERION-RELATED VALIDITY
urgency. As noted earlier, the ERI® does not AND THE ERI®
use the measurement of such constructs in
Criterion-related Validity refers to the degree
assessing job applicants. The ERI® directly
to which a questionnaire or test is able to
assesses the likelihood of specific behaviors,
accurately assess individuals with respect to a
rather than indirectly inferring their likelihood
specific criterion behavior such as reliable or
from the assessment of psychological con-
productive behavior. More specifically, the
ERI® could be said to have demonstrated
16 SPSS. (Norman H. Nie, ed.) SPSSX User’s Guide. Chicago: 1983
18 Borofsky, G. L. (1992) A preliminary investigation into the
17 American Psychological Association, Standards For Educational And structure of reliable and productive workplace behavior: Factor
analysis of the Employee Reliability Inventory. Boston, MA:
Psychological Testing, (Washington, D.C.: Author, 1985). Bay State Psychological Associates.
18
criterion-related validity if it could be shown to This criterion group of subjects was
be empirically accurate in differentiating administered the ERI® at the outset of
reliable and productive individuals from those their admission to a private hospital.
who are not. All subjects in this group were patients
on one of the alcohol/substance treat-
The most common method of demonstrating
ment units. These individuals had been
criterion-related validity is through the use of a
hospitalized as a result of their being
variety of comparison or criterion groups, each
unable to perform effectively on the job,
of which manifests one or more of the specific
as a consequence of their pattern of
behaviors of interest.
alcohol or illegal drug use.
19
group were administered the ERI ® as curred by chance. This far exceeds the level of
one part of the pre-employment selec- statistical significance (one in twenty) recom-
tion process used by a restaurant mended in Section 14B(5) of the Uniform
chain. In all cases, the absence of a Guidelines.
history of production deviant behavior
was confirmed by the subjects’ answers Where the group membership of each indi-
to questions during the conduct of the vidual (reliable or unreliable) was “blindly”
company’s regular application interview. classified, based on the individuals’ R scale
In addition, the subjects in this group scores, the ERI ® correctly classified group
had been rated by their respective membership in 94% of the cases.
restaurant managers as being among
This result indicates that the R scale was
the top 50% of the restaurant’s employ-
effective in differentiating reliable and produc-
ees, in terms of their actual perfor-
tive individuals from those who are unreliable.
mance on the job.
6.3.3 CROSS-VALIDATION
6.3.2 VALIDATION
To ascertain whether or not there is an “over-
Individuals in criterion groups (1) and (2) statement” of a procedure’s validity, Section
above, were pooled together and operationally 14B(7) of the Uniform Guidelines recommends
defined as unreliable, while individuals in the use of a cross-validation methodology.
criterion group (3) above, were operationally
defined as being reliable. Cross-validation involves conducting a second
study using different individuals. The purpose
Sample sizes for this validation study were as is to determine if the discriminant function
follows: derived in the validation study continues to
differentiate the criterion groups from each
Total Sample Size: N = 117
other, when new groups of subjects are as-
Reliable Subjects: N = 38
sessed.
Unreliable Subjects: N = 79
For the cross-validation of the R scale, the
Discriminant Function Analysis, with the subjects in each criterion group were selected
stepwise minimization of residuals method in the manner described earlier. The specific
X
contained in SPSS , was utilized in this analy- subjects in this study, however, were different
sis. individuals from those participating in the
original validation study.
For the discriminant function derived in this
study, the canonical correlation coefficient was Sample sizes for the cross-validation study
0.9677, the Wilks’ Lambda value was 0.0636, were as follows:
and the Chi Square value was 181.845, with 38
Total Sample Size: N = 77
degrees of freedom. This is statistically signifi-
Reliable Subjects: N = 38
cant at the p < 0.00001 level of significance.
Unreliable Subjects: N = 39
20
In conformance with standard approaches to be reliable, in that his/her performance will not
cross-validation, the discriminant function be disrupted by behaviors such as inattentive-
weights derived during the original validation ness, unauthorized absence/lateness, failing to
of the R scale were used to score each ERI ® in follow through on assignments, or other inap-
this study. propriate work behaviors. It is not designed to
assess the extent of prior or current alcohol or
Where the group membership of each indi- illegal drug use. Similarly, it is not designed to
vidual (reliable or unreliable) was “blindly” reveal, nor should it be used for the purpose of
classified, based on the individuals’ R scale revealing, the existence, nature, or severity of a
scores, the ERI ® correctly classified group disability.
membership in 90% of the cases.
7.1.1 CRITERION GROUPS
This result indicates that even when the R
scale was subjected to cross-validation, it was For both the validation and cross-validation of
found to be effective in differentiating reliable the A scale, the following criterion groups were
individuals from those who are unreliable. used:
7.1 A SCALE: CONSTRUCTION AND Each member of this criterion group was
VALIDATION a job applicant who possessed a current
security clearance, enabling him/her to
The A scale was designed to assess the likeli-
have access to information classified Top
hood that an applicant’s work performance will
21
Secret. In order to gain this level of Where the group membership of each individual
security clearance, each individual was (reliable or unreliable) was “blindly” classified,
subjected to, and successfully passed, a based on the individuals’ A scale scores, the
full field background investigation ERI® correctly classified group membership in
which included, among other things, 99% of the cases.
investigation of prior patterns of unreli-
This result indicates that theA scale was effec-
able / unproductive behavior. The
tive in differentiating reliable and productive
ERI® was administered as part of the
individuals from those whose on-the job perfor-
pre-employment processing of each
mance was impaired as a consequence of their
individual.
pattern of alcohol or illegal drug use.
Individuals in criterion group (1) above, were For the cross-validation of theA scale, the
operationally defined as being unreliable, while subjects in each criterion group were selected
individuals in criterion group (2) above, were in the manner described earlier. The specific
operationally defined as being reliable. subjects in this study, however, were different
individuals from those participating in the
Sample sizes for this validation study were as
original validation study of the A Scale.
follows:
Sample sizes for the cross-validation
Total Sample Size: N = 111
study were as follows:
Unreliable Subjects: N = 53
Reliable Subjects: N = 58 Total Sample Size: N = 44
Unreliable Subjects: N = 29
Discriminant Function Analysis, with the
Reliable Subjects: N = 15
stepwise minimization of residuals method
X
contained in SPSS , was utilized in this analy- In conformance with standard approaches to
sis. cross-validation, the discriminant function
weights derived during the original validation of
For the discriminant function derived in this
the A scale were used to score each ERI® in
study, the canonical correlation coefficient was
this study.
0.9397, the Wilks’ Lambda value was 0.1170,
and the Chi Square value was 189.851, with 27 Where the group membership of each indi-
degrees of freedom. This is statistically signifi- vidual (reliable or unreliable) was “blindly”
cant at the p < 0.00001 level of significance. classified, based on the individuals’ A scale
That is, this result has a probability of less scores, the ERI® correctly classified group
than one in one hundred thousand of having membership in 84% of the cases.
occurred by chance. This far exceeds the level
of statistical significance (one in twenty) recom- This result indicates that even when theA scale
mended in Section 14B(5) of theUniform Guide- was subjected to cross-validation, it was found
lines. to be effective in differentiating reliable and
productive individuals from those whose on-the
22
job performance was impaired as a conse- • Smiles
quence of their pattern of alcohol or illegal drug
• Consistently makes eye contact as part
use.
of their communication skills
7.2 C SCALE: CONSTRUCTION AND
VALIDATION For both the validation and cross-validation of
the C scale, the following criterion groups were
The C scale was designed to assess applicants used:
with respect to the likelihood that their interac-
tions with customers/guests will be character- 1. Individuals who were rated as being the
ized by a high level of courtesy and commit- best in each Department, in terms of
ment to service. meeting the above definition of courte-
7.2.1 CRITERION GROUPS ous behavior.
“Front of the house” employees (i.e., employees 2. Individuals who were rated as being the
having direct face to face contact with guests as poorest in each Department, in terms
part of their duties) in 32 different departments of meeting the above definition of
of an East Coast resort hotel were used to courteous behavior.
construct two criterion groups. Prior to being
7.2.2 VALIDATION
hired, individuals in each criterion group had
®
been administered the ERI as part of the pre- Individuals in criterion group (1) above, were
employment selection process. operationally defined as being more courteous
Each individual was rated by his/her supervi- in their behavior, while individuals in criterion
sor as to how courteous he/she was when group (2) above, were operationally defined as
interacting with guests. The eight point defini- being less courteous.
tion of courteous behavior, shown below, was
Sample sizes for the validation study were as
used for this purpose.
follows:
• Demonstrates courtesy, constant
politeness and a positive attitude Total Sample Size: N = 112
toward guests More Courteous Subjects: N = 81
Less Courteous Subjects: N = 31
• Presents a genuinely friendly outgoing
manner
Discriminant Function Analysis, with the
• Initiates communication with guests stepwise minimization of residuals method
X
through greetings and cordial conversa- contained in SPSS , was utilized in this analy-
tion sis.
• Remains courteous even during difficult For the discriminant function derived in this
confrontations with guests study, the canonical correlation coefficient was
0.8928 the Wilks’ Lambda value was 0.2030,
• Demonstrates an awareness of in-
and the Chi Square value was 147.50, with 35
house activities and knows the physical
degrees of freedom. This is statistically signifi-
location of public areas
cant at the p < .00001 level of significance.
• Provides service throughout the entire That is, this result has a probability of less
interaction with a guest
23
than one in one hundred thousand of having was subjected to cross-validation, it was found
occurred by chance. This far exceeds the level to be effective in differentiating individuals who
of statistical significance (one in twenty) rec- performed on the job in a courteous manner,
ommended in Section 14B(5) of the Uniform from those who did not.
Guidelines.
7.3 E SCALE: CONSTRUCTION AND
VALIDATION
Where the group membership of each indi-
vidual (more courteous or less courteous) was The E scale was designed to assess the likeli-
“blindly” classified, based on the individuals’ C
hood that an applicant’s work performance will
scale scores, the ERI ® correctly classified
be characterized by emotionally mature behav-
group membership in 98% of the cases.
ior, and that it will not be disrupted by the
presence of maladaptive personality character-
This result indicates that the C scale was
istics or traits such as irresponsibility, poor
effective in differentiating individuals who
judgment, difficulty in working cooperatively
performed on the job in a courteous manner,
with others, or poor impulse control.
from those who did not.
259
scores, the ERI ® correctly classified group Sample sizes for this validation study
membership in 84% of the cases. were as follows:
This result indicates that even when the Total Sample Size: N = 87
E scale was subjected to cross-validation, it Unreliable Subjects: N = 10
was found to be effective in differentiating Reliable Subjects: N = 77
reliable and productive individuals from those
who were unable to perform effectively due to Discriminant Function Analysis, with the
the presence of maladaptive personality traits. stepwise minimization of residuals method
X
contained in SPSS , was utilized in this analy-
7.4 F SCALE: CONSTRUCTION AND sis.
VALIDATION
26 60
Sample sizes for the cross-validation ter the ERI® immediately after there
study were as follows: was a finding of guilt made by the
presiding judge.
Total Sample Size: N = 102
Unreliable Subjects: N=9
2. Individuals with no history of having
Reliable Subjects: N = 93 been found guilty of theft offenses.
weights derived during the original validation of was a job applicant who possessed a
the F scale were used to score each ERI® in current security clearance, enabling
this study. him/her to have access to information
classified Top Secret. In order to gain
Where the group membership of each indi- this level of security clearance, each
vidual (reliable or unreliable) was “blindly” individual was subjected to, and suc-
classified, based on the individuals’ F scale cessfully passed, a full field background
scores, the ERI® correctly classified group investigation, which included, among
membership in 84% of the cases. other things, investigation of prior
patterns of unreliable/unproductive
This result indicates that even when the
behavior. The ERI® was administered
F scale was subjected to cross-validation, it
as part of the pre-employment process-
was found to be effective in differentiating
ing of each individual.
reliable and productive individuals from those
who were fired from their job within thirty (30)
7.5.2 VALIDATION
days of being hired.
Individuals in criterion group (1) above, were
7.5 H SCALE: CONSTRUCTION AND
VALIDATION operationally defined as being unreliable, while
individuals in criterion group (2) above, were
The H scale was designed to assess the likeli- operationally defined as being reliable.
hood that an applicant will perform in a trust-
worthy manner, and will not engage in various Sample sizes for this validation study
forms of property deviant behavior. were as follows:
This criterion group of subjects was For the discriminant function derived in this
administered the ERI® at a Municipal study, the canonical correlation coefficient was
Court. The procedure was to adminis- 0.9903, the Wilks’ Lambda value was 0.0194,
271
and the Chi Square value was 179.404, with (reliable or unreliable) was “blindly” classified,
31 degrees of freedom. This is statistically based on the individuals’H scale scores, the
significant at the p < 0.00001 level of signifi- ERI® correctly classified group membership in
cance. That is, this result has a probability of 90% of the cases.
less than one in one hundred thousand of
having occurred by chance. This far exceeds This result indicates that even when theH scale
the level of statistical significance (one in was subjected to cross-validation, it was found
twenty) recommended in Section 14B(5) of the to be effective in differentiating reliable and
Uniform Guidelines. productive individuals from those who were
operationally defined as unreliable, based on
Where the group membership of each indi- their documented record of property deviant
vidual (reliable or unreliable) was “blindly” behavior.
classified, based on the individuals’ H scale
7.6 Q SCALE: CONSTRUCTION AND
scores, the ERI® correctly classified group
VALIDATION
membership in 92% of the cases.
The Q scale was designed to assess individuals
This result indicates that the H scale was
with respect to a second component of un-
effective in differentiating reliable and produc-
planned and uncontrolled turnover. The Q
tive individuals from those who were operation-
scale assesses the likelihood that a job appli-
ally defined as unreliable, based on their
cant will not quit and will remain on the job for
documented record of property deviant behav- at least 30 days.
ior.
7.6.1 CRITERION GROUPS
7.5.3 CROSS-VALIDATION
For both the validation and cross-validation of
For the cross-validation of the H scale, the
the Q scale, the following criterion groups were
subjects in each criterion group were selected
used:
in the manner described earlier. The specific
subjects in this study, however, were different 1. Individuals who had quit their jobs
individuals from those participating in the within thirty (30) days of being hired.
original validation study of the H Scale.
2. Individuals who neither quit nor were
Sample sizes for the cross-validation study fired from their job within thirty (30)
were as follows: days of being hired; that is, they had
worked at their job for more than thirty
Total Sample Size: N = 29
(30) days.
Unreliable Subjects: N = 10
Reliable Subjects: N = 19 Prior to being hired, each individual was admin-
istered the ERI® as part of the pre-employment
In conformance with standard approaches to
selection process.
cross-validation, the discriminant function
weights derived during the original validation of 7.6.2 VALIDATION
the H scale were used to score each ERI® in this
Individuals in criterion group (1) above, were
study.
operationally defined as being unreliable, while
Where the group membership of each individual
28
individuals in criterion group (2) above, were subjects in this study, however, were different
operationally defined as being reliable. individuals from those participating in the
original validation study of the Q Scale.
Sample sizes for this validation study were as
follows: Sample sizes for the cross-validation study
were as follows:
Total Sample Size: N = 126
Unreliable Subjects: N = 22 Total Sample Size: N = 83
Reliable Subjects: N = 104 Unreliable Subjects: N = 17
Reliable Subjects: N = 66
Discriminant Function Analysis, with the
stepwise minimization of residuals method In conformance with standard approaches to
X
contained in SPSS , was utilized in this analy- cross-validation, the discriminant function
sis. weights derived during the original validation of
the Q scale were used to score each ERI ® in
For the discriminant function derived in this this study.
study, the canonical correlation coefficient was
0.6388, the Wilks’ Lambda value was 0.5919, Where the group membership of each indi-
and the Chi Square value was 61.358, with 14 vidual (reliable or unreliable) was “blindly”
degrees of freedom. This is statistically signifi- classified, based on the individuals’ Q scale
cant at the p < 0.00001 level of significance. scores, the ERI® correctly classified group
That is, this result has a probability of less membership in 76% of the cases.
than one in one hundred thousand of having
occurred by chance. This far exceeds the level This result indicates that even when the
of statistical significance (one in twenty) recom- Q scale was subjected to cross-validation, it
mended in Section 14B(5) of the Uniform Guide- was found to be effective in differentiating
lines. individuals who remained on the job for more
than 30 days, from those who quit their jobs
Where the group membership of each indi- within 30 days of being hired.
vidual (reliable or unreliable) was “blindly”
7.7 S SCALE: CONSTRUCTION AND
classified, based on the individuals’ Q scale
VALIDATION
scores, the ERI® correctly classified group
membership in 90% of the cases. The S scale was designed to assess individuals
with respect to one component of production
This result indicates that the Q scale was
deviance. The S scale assesses the likelihood
effective in differentiating individuals who
that a job applicant will perform on the job in a
remained on the job for more than 30 days, safe manner, and will not have a significant on-
from those who quit their jobs within 30 days of
the-job accident in the first four months of
being hired.
employment. 21
7.6.3 CROSS-VALIDATION
29
7.7.1 CRITERION GROUPS curred by chance. This far exceeds the level of
statistical significance (one in twenty) recom-
For both the validation and cross-validation of
mended in Section 14B(5) of the Uniform Guide-
the S scale, the following criterion groups were
lines.
used:
Where the group membership of each indi-
1. Individuals who had a significant on-
vidual (reliable or unreliable) was “blindly”
the-job accident in the first four
classified, based on the individuals’ S scale
months of employment.
scores, the ERI ® correctly classified group
membership in 100% of the cases.
2. Individuals who did not have a signifi-
cant on-the-job accident in the first four
This result indicates that the S scale was
months of employment.
effective in differentiating individuals who
performed on the job in a safe manner, from
Prior to being hired, each individual was ad-
those who had a significant on-the-job acci-
ministered the ERI® as part of the pre-employ-
dent in the first four months of employment.
ment selection process.
7.7.3 CROSS-VALIDATION
7.7.2 VALIDATION
30
85% of the cases. results on each scale are distributed continu-
ously along each of the behavioral-psychologi-
This result indicates that even when the S cal dimensions measured by the ERI .
®
RELIABILITY
A C E F H Q S
31
six-tenths of the way through zone 2A. The 8.2 FREQUENCY DISTRIBUTIONS
FOR ERI ® SCALES
median E scale value of 3.000 means that the
median falls in zone 2A.
The frequency distributions shown below are
reported in terms of discriminant scores. The
Likewise, the standard deviation of the A scale
frequency and percentile distributions for the
is 1.584. This means that the standard devia-
ERI® scales, using the eight zone system, are
tion for this scale is roughly 1.6 zones of the
reported in Section 4.2 of this Manual.
eight zone system.
A Scale C Scale
E Scale F Scale
H Scale Q Scale
S Scale
32
8.3 INTERCORRELATION OF THE
®
ERI SCALES 22,23
As dis cussed in Section 1.2.3 of this Manual, below appears to provide some support for the
the correlation matrix of ERI ® scales shown multifactorial view of behavior.
SCALE
A 1.00
C -0.05 1.00
A C E F H Q S
33
SAMPLE SIZE: N = 30
TEST - RETEST INTERVAL: 7 to 21 Days
A r = 0.89 p<.01
C r = 0.68 p<.01
E r = 0.77 p<.01
F r = 0.75 p<.01
H r = 0.73 p<.01
Q r = 0.85 p<.01
S r = 0.83 p<.01
35
9.2 GENDER TOTAL SAMPLE SIZE:N = 1350
UNDER 40 N = 1060
The relative selection rates and impact ratios
40 AND OLDER N = 290
have also been compared for females and males
using the above-described method. The results ®
Using this method, for each of the seven ERI
for the same sample described in the previous
scales, it has also been consistently found that
section are shown below.
the impact ratios conform to the requirements
of the “four-fifths rule of thumb” contained in
Total sample size: N = 1350
the Uniform Guidelines. On this basis, it has
Males N = 899
also been concluded that use of the ERI ® does
Females N = 451
not result in adverse impact with respect to age.
36
10. SELECTED REFERENCES
Borofsky, G. L., (1991) A preliminary investigation into the structure of reliable and productive
workplace behavior: factor analysis of the Employee Reliability Inventory. Boston, MA: Bay
State Psychological Associates.
Borofsky, G. L., (1992a) Assessing the likelihood of reliable workplace behavior: further contribu-
tions to the validation of the Employee Reliability Inventory. Psychological Reports, 70, 563-
592.
®
Borofsky, G. L. (1992b) Psychometric properties of the Employee Reliability Inventory (ERI ).
Boston, MA: Bay State Psychological Associates.
Borofsky, G. L. (1992c) Americans With Disabilities Act user’s manual addendum. Boston, MA:
Bay State Psychological Associates.
Borofsky, G. L. (1992d) Training Syllabus for the Employee Reliability Inventory . Boston, MA:
Bay State Psychological Associates.
Borofsky, G. L. (1992e) Training Guide for administering and scoring the Employee Reliability
Inventory. Boston, MA: Bay State Psychological Associates.
Borofsky, G. L. (1992f) Training Guide for interpreting and using the Employee Reliability Inven-
tory. Boston, MA: Bay State Psychological Associates.
Borofsky, G. L. (1994a) User’s manual for the Employee Reliability Inventory (Rev. 6.2). Boston,
MA: Bay State Psychological Associates.
Borofsky, G. L., (1994b) Use of the Employee Reliability Inventory as a pre-interview question-
naire. Boston, MA: Bay State Psychological Associates, .
Borofsky, G. L., (1996) Employee Reliability Inventory computer scoring system guide . (Rev. 6.2)
Boston, MA: Bay State Psychological Associates.
Borofsky, G. L., Alexander, J., Coleman, R., Reimers, C., Wackenheim, G., & McCormick, B.
(1995) Enhancing courteous job performance: The contribution of a pre-employment screen-
ing inventory. Psychological Reports, 77, 43-50.
Borofsky, G. L., Bielema, M., & Hoffman, J. (1993) Accidents, turnover, and the use of a pre-
employment screening inventory: further contributions to the validation of the Employee
Reliability Inventory. Psychological Reports, 73, 1067-1076.
Borofsky, G. L. & Garely, L. (1995) Assessing the effects of treatment for substance abuse: A
further contribution to the validation of the Employee Reliability Inventory. Psychological
Reports, 76, 1043-1049.
Borofsky, G. L., Green, J., Burzichelli, D., & Paludi, L. (1995) Predicting terminations for cause
and failure to complete successfully a 90-day probationary period of employment: Contribu-
tion of a pre-employment screening inventory. Psychological Reports, 77, 1031-1040.
Borofsky, G. L. & Klein, H.J. (1998) The use of a pre-employment screening system as part of a
comprehensive asset protection program: examining the incremental effects on inventory
shrinkage. Security Journal, 10, 23-29.
Borofsky, G. L., Klein, H.J., & Davis, W. (1993) Pre-employment screening for unreliable work
behaviors: an opportunity to work cooperatively with human resource managers. Security
Journal, 4 (4), 185-192.
37
Borofsky, G. L. & Smith, M. (1993) Reductions in turnover, accidents and absenteeism: the
contribution of a pre-employment screening inventory. Journal of Clinical Psychology, 49 (1),
109-116.
Borofsky, G. L. & Wagner, J. (1993) Terminations for cause and job tenure: the contributions of
a pre-employment screening inventory. Psychological Reports, 72, 591-599.
Borofsky, G. L., Wagner, J., & Turner, S. (1995) Sustained reductions in turnover and accidents
associated with the ongoing use of a pre-employment screening inventory: Results of a three-
year longitudinal study. Psychological Reports, 77, 195-204.
Borofsky, G. L. & Watson, R. (1994) Prediction of Early Voluntary Turnover and Job Performance:
The contribution of a pre-employment screening inventory. Psychological Reports, 74, 819-
826.
38
APPENDICES
EMPLOYEE RELIABILITY INVENTORY
Applicant Name: Donald Sample
ID: ERITwos
Company: Natcon
Date Scored: 2 Mar 2012
ERI Number: 1053449
Results
Freedom from Disrupted Job Performance (A)
Courtesy (C)
Conscientiousness (F)
Trustworthiness (H)
Safety (S)
Freedom from Disrupted Applicant's activities outside of work will not disrupt his/her performance and productivity through behaviors such as
Job Performance (A) inattentiveness, unauthorized absence/lateness, failing to follow through on assignments, or other inappropriate work
behaviors.
Courtesy (C) The applicant's interactions with customers/guests will be characterized by a high level of courtesy and commitment to
service.
Emotional Maturity (E) The applicant's performance and productivity will not be disrupted due to the presence of maladaptive personality
traits, such as irresponsibility, difficulty in working cooperatively with others, poor judgment, or poor impulse control,
etc.
Conscientiousness (F) The applicant will perform on the job in a productive and conscientious manner, and will not be fired in the first 30
days of employment.
Trustworthiness (H) The applicant will perform on the job in a trustworthy manner and will not engage in various forms of untrustworthy
behaviour.
Long Term Job The applicant will show a long term commitment to the job and will not quit within the first 30 days of employment.
Commitment (Q)
Safety (S) The applicant will perform on the job in a safe manner, and will not have a significant on-the-job accident in the first 4
months of employment.
Further interpretive information:
Under no circumstances should the decision to hire or not hire an applicant be based solely on his/her ERI® results. Hiring
decisions should be based on a review of ALL information collected by you during the applicant evaluation process.
Because of the variability inherent in any type of scores, small differences in results should never be the basis for making
decisions about applicants or for comparing applicants.
The following table can be used to help you approximate where an applicant's results fit, relative to scores obtained by other job applicants.
This table shows the approximate percentage of job applicants who obtain poorer scores on that particular scale. The table is based on a
group of job applicants (N=60,670) who completed the ERI® as part of their pre-employment processing. This normative group represents all
10 Standard Industrial Classification (SIC) Code Divisions, 54 Major SIC Groups, and a wide range of job categories.
NOTES:
The number in each cell represents the approximate percentage of job applicants in the normative sample who obtained scores on that scale
which were poorer than the job applicant's.
As an illustration of how to use this table, please note that in the normative sample, the number 10 appears in zone 3A for the "F" scale. This
indicates that scores in this zone are at approximately the 10th percentile (approximately 10% of the job applicants in the normative sample
obtained scores on the F scale that were poorer than zone 3A, or put slightly differently, approximately 10% of the normative sample
obtained F scale scores in zones 3B, 4A or 4B).
For Help: If you have questions regarding the administration, scoring, or interpretation of the ERI® please call Psychometrics Canada:
1-800-661-5158.
Employee Reliability Inventory (ERI®). Copyright 2017, Psychometrics Canada Ltd. All Rights reserved.