Training and Development Notes
Training and Development Notes
Key Terms:
- Ethics: The determination of right and wrong; the standards of appropriate conduct or behaviour
for members of a profession: what those members may or may not do.
- Human Resource Information Systems (HRIS): Computer-based systems that track employee
data, the needs of HR, and the requirements and competencies needed for different positions,
among other functions.
- Professional standards: Professional standards provide guidance on how HR professionals
should behave in certain situations including the use of employment tests.
- Recruitment: The generation of an applicant pool for a position or job in order to provide the
required number of candidates for a subsequent selection or promotion program.
- Selection: The choice of job candidates from a previously generated applicant pool in a way that
will meet management goals and objectives as well as current legal requirements.
- Top management: An organization’s commitment to recruit, retain, and develop the most
talented and superior employees.
Opening Vignette: “Batfleck” – What You Should Know About Making Bad Hires
- The U.S. Department of Labor estimates that the average cost of a bad hire can be 30% of
individual’s first-year potential earnings
- A real-life example: Ben Affleck being hired as batman was viewed as a very disappointing hire
by the public, and as such the movie tanked at the box office. While Affleck has “Hollywood star
power” this doesn’t counter-balance his inability to play a good superhero.
- The purpose of this example is to show that settling on a candidate who may meet one of your
requirements but is sub-par with others is not a wise move and instead companies should hold
out for someone who is a well-rounded fit.
Why Recruitment and Selection Matters
- By following “best practices” outlined in this book, you will be able to reduce bad decisions in
recruitment and selection, and be able to find and hire people who will contribute to the overall
success of your organization and its products or services.
- Best practices are valid, reliable, and legally defensible
o must comply with relevant legislation; inability to defend R&S practices before a tribunal
may result in serious financial consequences for the organization
o Supported by empirical evidence that have been accumulated through accepted scientific
procedures
o Involve ethical treatment of job applicants throughout (R&S) process
o Result from HR professionals following accepted standards and principles of the
professional association
o Best practice perfect practice, but must show that it is fair and does not discriminate
against protected groups
o Using best practices in R&S adds value to an org
Ployhart, Van Iddekinge, and MacKenzie: using employment tests of cognitive
ability and personality led to inc. in human capital
- HR is a very broad field (see figure 1.2, p.4); emphasis on R&S, which is not the only component
of HR, however, it is important bc it helps an organization meet its goals and objectives by
producing competent, committed, and effective personnel.
- Figure 1.2 (p. 5) outlines the functions of talent management – which in essence gives a line
manager a responsibility in R&S, retention, and development of superior employees w/ less
involvement in HR
o In some org, all employees are involved in talent management, in others it is only top
employees
o Part of talent management is developing an employee’s career, and knowing when a
suitable position becomes vacant in the organization for them to be promoted to; in order
to track this larger org, use Human Resources Information Systems (HRIS).
- Recruitment is done to meet management goals and objectives for the org and must meet current
legal requirements (HR, employment equity, labour law, and other legislation)
- Selection can involve: hiring at entry level positions from applicants external to the organization,
promotion or lateral transfer of people within the organization, and movement of current
employees into training and development programs.
- Effective R&S can differentiate between an org’s success and failure
- Skill
o Differences in skills among candidates translate into performance differences on the job
& have economic consequences for an org
o Hiring ppl w right skills or highest level of skills leads to + economic outcomes
o Hiring ppl w wrong skills can lead to disaster for both the person & the org
o Effective R&S identify job applicants w appropriate level KSAOs needed for successful
performance in a job or an org
- Empirical studies effective R&S gain a competitive advantage in the marketplace
- Best practices in R&S:
o Reduce employee turnover and increase productivity (one-standard-deviation increase in
the use of sophisticated HR practices decreased turnover by 7% and increased sales by
$27,000 per EE per year
o Are responsible for up to 15% of a firm’s relative profit
o Correlated w an org’s LT profitability and productivity ratios
o Help to establish EE trust
o Improve the knowledge, skills, and abilities of an org’s current and future EEs, increase
their motivation, and help to retain high-quality EEs while encouraging poor performers to
leave
- Study by Work Foundation and the Institute for Employment studies – businesses with good HR
practices enjoyed higher profit margins and productivity than those without. Org’s that increased
investment in HR by 10% would generate gross profits by (about) $2800 in 2014 CAD per EE.
o Progressive HR practices = greater org commit & motivate EE’s to exhibit proper role
behaviour, results in lower compensation costs, higher quality work, higher productivity,
reduces dysfunctional behaviour, lower ops costs, greater profitability.
- See recruitment and selection notebook 1.1 (p.6/7) – “roadmap of the book”
Social/Economic Factors Affecting Recruitment and Selection
- Global Competition
o Foreign trade has always been vital to the Canadian economy, and there has been a
continual increase in globalization since 1970
o The KOF Swiss Economic Institute produces an annual globalization index of all
countries in the world.
Canada is ranked 12th most globalized
Index based on economic, social and political globalization
Economic: measures (1) actual trade and investment volume, and (2) the
extent to which countries apply trade and capital movement restrictions
to protect their own economies.
Social: extent of the dissemination of info and ideas
Political: degree of political cooperation btw countries
o Increased globalization has changed the level of competition as new players enter
international markets and trade barriers between countries are softened.
E.g., large U.S. owned discount chains [Costco, Walmart] are serious threats the
survival of smaller Canadian owned retailers (must increase efficiencies and
lower their operating costs).
Can compete by using more effective HR practices which allow them to be more
efficient and find more productive EEs
- Rapid Advances in Technology and the Internet
o Employers now expect new EEs to be computer literate
o Employers are also using tech more in terms of R&S, incl. through the internet
- Redefining Jobs
o With ever changing jobs employers may need to change their recruitment processes to
look at a broader range of skills or competencies that are of value to the org and work
across many jobs rather than value for one specific job
o Those are the components the candidate sees, but much more goes on:
Questions about is the employer understands the requirements, ensuring it is
free from discrimination, is the info being provided valid and reliable?
o Every employer who makes a hiring decision following a hiring process
But in many cases hiring is informal and not as structured
o Important Difference between Toronto Police hiring process and others:
Is whether the job duties and position requirements have been determined
through some systematic investigation (job analysis) or was it a guess
The employer’s decision to hire someone might be effected by their
experience, gut feeling, or intuition – their “idea” of who might be a good
employee
o The employer is making a guess
o Often this guess is effected by bias and not KSAOs
o There was little or no tracking of the decision that was made
o Hiring decisions must be defensible – they must meet the legal requirements and
professional standards for reliability and validity
HR tends to lack behind science – most decisions are based on intuition and not
empirical evidence
In a study, it showed that preference towards intuition meant you were
experiential thinkers who made everyday decisions off of feelings –they
also were less experienced, worked for small companies and had less
professional certificates
Science Based Selection Practice Based Selection
Type of Process Analytical Intuitive
They do not affect the accuracy of measurements but they effect the
meaning/interpretation (lead to the wrong conclusion)
Interpreting Reliability Coefficients
o Classical Measurement Model: assumes that any observed score X is a combination of a
true score and an error score
True Score – average score that an individual would earn on an infinite
number of administrations of the same test or parallel versions of the
same test
Error Score – the hypothetical difference between an observed score and
a true score
Assumptions:
The characteristic being measured is stable, and the only reason an
observed score changes is due to random error
o Error scores are independent of the characteristics being
measured
o Errors are attributable to the measurement process not the
individual
o Magnitude of error scores is unrelated to the magnitude of the
characteristic being measured
True scores and error scores combine in a simple additive manner to
produce an observed score (X = T + e)
o Variance – if a test is not very reliable there will be a larger variance
Reliability is a ratio of the true score variance to the observed score variance
o Reliability Coefficient – (aka. Correlation coefficient) the degree that observed made on
the same characteristic correlate with one another
Ranges from -1 and 1 (1 = most reliable)
The square of the reliability coefficient represents the proportion of variance in
the observed scores that attributed to true differences on the measured
characteristic
>0.90 = excellent, 0.80-0.89 = good, 0.70-0.79 = adequate, <0.70 = may have
limited applicability
Degree of reliability for employment decisions should be sufficiently high
(at least .80)
Tests should not be accepted or rejected solely on the reliability
coefficient
Measurement Error
o Measurement Error – the hypothetical difference between an observed score and a true
score; comprises both random error and systematic error
o Reduces the influence of any set of measures/results of a test
o Error must be considered when making employment decisions
o Standard Error of Measurement – is a statistical index that summarizes information
related to measurement error – estimated from observed scores obtained over a group of
individuals
Reflects how a score would vary on average over repeated observations under
identical conditions
Factors Affecting Reliability
o 3 Categories of Factors that Introduce Error
1. Temporary Individual Characteristics
Factors such as health, motivation, fatigue, and emotional state introduce
temporary, unsystematic errors into the measurement process
2. Lack of Standardization
Changing conditions under which measurements are made
i.e. Sam was interviewed in a more formal setting with less time to
answer the questions, Sarah was interviewed in a comfortable setting
3. Chance
Factors unique to a specific procedure
i.e. the questions that were picked for Sam were easier than the ones
picked for Sarah so Sam’s score was higher
Methods of Estimating Reliability
o Overview
Problem: we can never know the true score variance because true scores are
abstract constructs (but we can estimate what it is likely to be)
Assumption for All Reliability Techniques– consistent variability across the
measurements represents true score variability, while inconsistency across the
measurements reflects random error
To measure reliability – we have to estimate the degree of variability in a set of
scores that is caused by measurement error
Alternative Forms:
BUT, candidates might recall what they said the first time, or thought of
better answers (reduce reliability)
To prevent this, applicants are asked alternate questions during the
second interview
High correlation = reliability
Internal Consistency:
BUT, it is quite costly and time consuming to have applicants come back
twice
Rather than select a particular pair of items, the correlations between all
possible pairs are calculated and then averaged
The average measures internal consistency (whether all the questions
are measuring the same thing)
I.e. Cronbach’s Alpha Coefficient
Split Half Reliability:
o All items are first divided into two arbitrary groups and then the
persons average scores in the two groups is used as the
reliability estimate
Inter-Rater Reliability:
How well does one interviewers subjective rating correlate to another
o Correlation between judgements
Aka classification consistency
Choosing and Index of Reliability
10
o The above methods are all special cases of a general type of index called the
generalizability coefficient
o Specific occasions would dictate which of the methods is chose – HR professional must
make judgements to decide
o Need for accuracy increases with the seriousness of the consequences for the employee
Validity
Overview
o Validity – the degree to which accumulated evidence and theory support specific
interpretations of test scores in the context of the test proposed use
The legitimacy/correctness of the inferences that are drawn from a set of
measurements
o Need to demonstrate that a set of measurements lead to valid inferences about the
characteristics or constructs under study (hard with psychological things)
Construct Underrepresentation – the measures may not represent important
aspects of the construct
Construct-Irrelevant Variance – the measures may be influenced by aspects of
the process that are unrelated to the construct
Validation Strategies
o Validity is a unitary concept content, construct and criterion related validity are different
but interrelated strategies used to assess the accuracy of inferences
Content Validity Evidence
Checks that test items correspond to what is supposed to be covered in
the test
Assessed through the judgement of experts in the subject area
Face Validity – degree to which test users or other non-experts believe
that the test measures the content area (appearance)
Construct Validity Evidence
Demonstrates a relationship between some theory and another set of
variables (i.e. if you are testing a foreign language, then those skills
should show improvement after much instruction)
Degree to which a rest assesses and underlying theoretical construct it is
supposed to measure
Assessed through multiple sources of evidence showing that it measures
what it purports to measure and now other constructs
Criterion-Related Validity
The relationship between a predictor (test score) and an outcome
measure
Assessed by obtaining the correlation between the predictor and
outcome scores
Two types:
o Concurrent: two tests administered at the same time to two
groups
o Predictive: refers to how well the test predicts some future
behavior, regardless of whatever else it may test
o Content and construct validity – are both validation strategies that provide evidence
based on test content, Criterion validity – provides evidence based on relationships to
different variables
o Important document that HR specialists rely on – The “Principles for the Validation and
Use of Personnel Selection Procedures”
o Example – Cognitive Ability for a Widget Maker
Determined that cognitive ability was related to job performance
These are abstract constructs that need to be operationally defined
They can use commercially available tests for cognitive ability
They chose the Wonderlic Personnel Test (WPT)
o It is often used in employment situations
11
They validate this test against other tests and decide it is a good measure based
on Construct Validation
If they wanted to make their own measure they would have to establish validity
through research
They would have experts come and assess if the items on the test are relevant
and define cognitive ability, this would-be Content Validation
They would also need to find a valid and reliable measure of job performance
It can be difficult to identify the tasks that define successful job
performance
Whatever is used to measure job performance should represent important work
behaviors, outcomes, or relevant organizational expectations about the
employee’s performance, this is Construct Validation
We have to establish the relationship between criterion and predictor empirically,
which is Criterion Validation
i.e. establishing a correlation between the WPT and job performance
One issue with this is an applicant would have to be hired to analyze
their job performance
o Two Criterion-Related Validation Strategies (to get around the issue that you cannot
measure one’s job performance before they are hired)
1. Predictive Validation – strategies in which evidence is obtained about a
correlation between predictor and scores that are obtained before and applicant
is hired and criterion scores that are obtained at a later time, usually after an
applicant is employed
aka hire everyone who applies for a job and then calculate correlation
Big issues with this: Huge cost, Legal and Ethical issues
Alternative:
o They collect the cognitive ability information but the hiring
decision is based solely on resumes/interviews/references
o After they are hired they collect job performance data
o If the correlation is high then the cognitive ability test may be
used in the future
Issue:
o This information would only be based on applicants that were
hired and might not represent a total pool of applicants
2. Concurrent Validation – strategies in which evidence is obtained about a
correlation between predictor and criteria scores from information that is
collected at approximately the same time from a specific group of workers
test current employees on both measures and see what the correlation is
Issue: the group of workers is likely older, more experiences and
successful than those applying
o Unsuccessful employees were likely not in the study because
they were not still employed
o So, should a pool of successful people be compared against a
group that is likely to be both successful and unsuccessful on the
job
Issue: a group of employed people might approach the situation
differently that job applicants
o Validating coefficients based on concurrent evidence will likely
underestimate the true validity of using the predictor
Criterion-related validity strategies are the most frequently used
o Goal:
We want to predict the job performance at the construct level from the cognitive
ability scores obtained in the measurement level
We want to make inferences about the job applicants potential job performance
from pre-employment measures
12
13
o Measurement Bias: occurs in a set of measurements when items on a test may elicit a
variety of responses other than what was intended (some items have different meanings
to different subgroups)
i.e. the Bennett Mechanical Comprehension Test
Fairness
o The principle that every test taker should be assessed in an equitable manner
o An issue of fairness cannot be determined statistically or empirically – it involves
perceptions
o “Fairness is a social rather than psychometric concept. Its definition depends on what
one considers to be fair. Fairness has no single meaning, and, therefore, no single
statistical or psychometric definition.”
o Three Meanings of Fairness
1. Fairness as equitable treatment in the testing process
2. Fairness as lack of bias
3. Fairness in selection and prediction
o Fairness is more complex than bias – it requires compromise between conflicting
interests
o Does an organization have an obligation to make the enterprise as profitable as possible
on behalf of its owners or should it meet the objectives of society by providing equal
employment opportunities for members of different population groups?
o Ethical View: perceived fairness may negatively affect unsuccessful candidates
o Legal View: perception of unfairness may lead to unsuccessful applicants to pursue
discrimination charges against the employer
o NEED balance between scientifically sound practices and fairness****
14
15
Spells out the division of power between the federal and provincial governments
+ rights and freedoms
Stakeholders: All citizens
o 2. Human Rights Law – prohibits discrimination in employment and provision of goods
and services (establishes tribunals, and commissions to deal with complaints)
Origin: international conventions set out by the UN + domestic pressure to
eliminate discrimination
Stakeholders: Restrictive – only has force on the protected groups
o 3. Employment Equity Legislation – administrative mechanisms in response to federal
legislation (covers nearly 2 million Canadians)
They are intended to promote the entry and retention of people from designated
groups (women, visible minorities, disabled and Aboriginals)
Origin: affirmative action programs in the US + domestic pressure for diversity
Stakeholders: Restrictive - no force beyond protected groups
o 4. Labour law, employment standards and related legislation – grant employment rights
to both employers and employees, and impose responsibilities and obligations
Labour Laws Origin: response to labour union activities to improve worker
conditions
Provide mechanisms for collective bargaining (“fair fight”)
Stakeholders: unionized workers, and managers of unionized workplaces
Employment Standards Origin: BNA Act + reflect societal norms regardless of
unionization
Includes: statutory school leaving age, min age, min wage,
vacation/leave, holidays with pay, termination of employment
Other Related Legislation: includes – regulation of federal government workers,
results from unique conditions
Stakeholder: the members of those specific sectors
Mechanisms to resolve procedural or contractual disagreements
between specific stakeholders (whereas human rights law and equity are
about discrimination)
These all have varied historical roots and address the different needs of stakeholders in society
The distinction between antidiscrimination legislation and procedural/contractual enforcement
legislation can blur in practice (i.e. equal pay for equal work is covered by different legislation
depending on jurisdiction)
Constitutional Law
The Constitution of Canada is made up of a series of Acts that began with the BNA of 1867 and
end with the Constitution Act of 1982
o Sections 1-34 are the Canadian Charter of Rights and Freedoms
o As a whole, it is the supreme law of Canada (stated in 52(1))
o All laws in Canada that are a dispute between a private person and a branch of
government (legislative, executive, and administrative)
o Has precedence over all other legal means
o Section often cited in employment law is section 15 – lays out the principles of equal
rights
(1) resembles the human rights legislation
(2) makes it clear that programs (such as employment equity) are to overcome
discrimination and are not in themselves discriminatory
o Does not directly affect every day R&S, only becomes an issue when things are
challenged in court/human rights tribunal
o Has a pervasive, indirect impact on employment practices by setting limits and conditions
on what federal/provincial/municipal can do legally to alter employment practices
o Interpretation of constitutional law has an indirect, but substantial influence on all aspects
of the practice of HR – due to the development of an organization’s HR policy about the
conduct of an employment interview
Human Rights Legislation
16
o Every province, and the federal government has human rights legislation that prohibits
discrimination in employment and the provision of goods and services
o HR professionals must determine what legislation applies to them
o Organizations are governed by the laws of the political division in which they are
chartered/incorporated
If you operate in more than one province, you must register in each jurisdiction
and follow all regulations
o Federal legislation (Canadian Human Rights Act) applies to:
Federal government departments, Crown corporations and agencies,
Transportation, Broadcasting, Financial service sectors (banks), Canada post,
Companies that voluntarily register under the Canadian Business Corporations
Act
Section 8 of Canadian Human Rights Act – refers to a prohibited ground of
discrimination
Under this act the following are prohibited: race, national/ethnic origin,
colour, religion, age, sex (including pregnancy/childbirth), marital status,
family status, mental/physical disability, present/past drug or alcohol
abuse, pardoned conviction, sexual orientation
o Discrimination – in employment, any refusal to employ or to continue to employ any
person, or to adversely affect any current employee, on the basis of that individual’s
membership in a protected group
Only 6 prohibited grounds that all jurisdictions agree on – race/colour, religion or
creed, age, sex, marital status, physical/mental handicap or disability
o All Jurisdictions: Enforced through human rights tribunals/commissions
o Canadian Human Rights Commission (CHRC) federal:
empowered to investigate complaints, develop and deliver public information
programs, undertake or sponsor research programs, liaise with other human
rights commissions, and review federal legislation for conformity with the
Canadian Human Rights Act
o Victims have the responsibility of filing a complaint with the human rights commission that
has jurisdiction over the employer
CHRC 2013 – 1735 complaints (55% about disabilities, 17% about sex)
Each complaint triggers a formal investigation
Employment Equity
Employment Equity – the elimination of discriminatory practices that prevent the entry or retention
of members from designated groups in the workplace, and the elimination of unequal treatment in
the workplace related to membership in a designated group
o Federally regulated industries - all employers with 100+ employees to set up and operate
employment equity programs
o The Federal Contractors Program = ANY org with 100+ ppl and doing 1mil+ in business
WITH the federal government commit to employment equity programs
o Provincial employment equity is mostly limited to public sector (except Quebec)
Concerned with equity in recruiting, hiring, compensation and training
Organizations can voluntarily adopt employment equity programs in absence of legislation
Purpose of employment equity legislation:
o Address past systemic discrimination in employment systems that have disadvantaged
members of designated groups
The Federal Employment Equity Act of 1986 requires employers covered by the Act to implement
equity by:
o Identifying and eliminating barriers to persons of designated groups
o Making reasonable accommodation to increase representation of these groups to reflect
the groups representation in the work force, or segments of the work force
The revised Employment Equity Act of 1996
o extended coverage to all private employers that fall under federal regulation and almost
all employees of the federal government
17
18
o Regulate: statutory school leaving age, min age, min wage, vacation/leave, holidays with
pay, termination of employment, standard hours of work, sexual harassment
o Common Law (developed through judicial proceedings) – may apply to individual
contracts
Rarely involved in selection, but can be involved in termination (deselection)
Related Legislation
o Governments have specialized legislation and employment standards for their own public
service employees
Public Service Employment Act – designates the Public Service Commission of
Canada as the central staffing agency for the federal government
Gives candidates the right to request investigation into whether their
qualifications were not assessed properly
Public Service Commission resolves complaints through mediation or
through direct intervention
o Candidates can lodge appeals against their personnel selection
decisions (page 79 has an example)
The Parliamentary Employment and Staff Relations Act – provides mechanism
for collective bargaining between the federal government and unions
Administered by the Public Service Staff Relations Board (PSSRB) –
hear complaints and arbitrate collective bargaining disputes
Promotions for these people affect R&S
Part II: Key Legal Concepts in Recruitment and Selection
Direct Discrimination
Occurs when an employer adopts a practice or rule that, on its face, discriminates on a prohibited
ground
If it occurs the burden is on the employer to show the rule is valid in application to all members of
the affected group
o i.e. if they didn’t want to hire a female for a job they would have to prove why all females
are incapable of doing that job
Almost impossible to justify
No statement in advertising a job may be made that directly discriminates against someone (i.e.
seeking single males)
Interviews are a possible opportunity for direct discrimination so the CHRC provides practical and
detailed advice on how to avoid it (subject, avoid asking, preferred, comments) – page 84-86
o You can ask about Canadian military service where employment preference is given to
veterans by law (but avoid asking about service in other countries)
o Disability is relevant to the job only if it:
Threatens the safety or property of others, prevents the applicant from safe and
adequate job performance even when accommodation is made
o Avoid asking whether an applicant has been convicted, arrested or if they have a criminal
record – but if bonding is a job requirement you can ask if applicant is eligible
Much less frequent in Canada than it once was
o Media is conscious of running job ad’s that are discriminatory because they can be held
accountable
o Often occurs still in occupations where gender-based stereotyping is common
Adverse Effect Discrimination
Refers to a situation where an employer, in good faith, adopts a policy or practice that has an
unintended, negative impact on members of a protected group
Is discrimination unless it can be proved that the selection practice was necessary to assure the
efficient and economical performance of the job without endangering employees or the general
public
Example: Getting a list of potential candidates of from current shop-floor employees when the
current pool is all white males, the likelihood the candidates put forward by them are white males
is high (i.e. eliminating females and minorities)
o The HR manager might have thought it was a sound procedure but it had adverse effects
19
20
21
Individualized rather than standardized testing MUST be used to accommodate individuals with
disabilities
o A person with disability must be assessed in terms of that persons own unique abilities;
the persons disability must not be viewed through any prejudice/bias/stigma or
misunderstanding on the part of the employer about the disability
o MUST be considered individually within a particular context, and some risk is acceptable
Sufficient Risk
As part of a BFOR defense, an employer may argue that an occupational requirement that
discriminates against a protected group is reasonably necessary to ensure that work will be
performed successfully and in a manner, that will not pose harm or danger to employees or the
public
After the Grismer decision each case will be judged on its own unique merits with respect to the
degree of risk imposed by the disability
o Also determined that sufficient risk alone could not justify a discriminatory standard
o Risk can be considered under an assessment of undue hardship but now as a
justification for a discriminatory action
Aim is not to lower safety standards but to find options that meet safety standards and respect
human rights
Direct discrimination with relation to sufficient risk occurs regularly for persons with physical and
mental disabilities
o i.e. not hiring people with HIV/AIDS at hospitals
but for this to be okay it needs to be a proven BFOR
Sufficient risk criterion = well above minimal or nominal risk
o i.e. severe vision impairment of an airline piolet vs a person with muscular dystrophy who
might fall
Legal Concepts Applied to Recruitment and Selection
Two Human Rights Decisions (illustrate the above principles) – in both the complainant won
o 1. Action travail des femmes v. Canadian National (1984)
complaint lodged with the CHRC
disproportionately excluded women from nontraditional jobs and the employment
practices in question were not BFORs
they were told to start hiring more women and stop using the Bennett test that
discriminated against woman
o 2. Andrews v. Treasury Board and Department of Transport (1994)
complaint filed with the CHRC
Canadian Human Rights tribunal criticized the use of a practical hearing test
They decided it was a discriminatory test and granted monetary compensation to
the complainant
The test was not proven to be an adequate BFOR because there were many
issues with it (it wasn’t validated)
Andrew’s hearing impairment did not pose sufficient risk
The differences between the two cases show that there is an increasing amount of focus on the
four legal concepts we have discussed (reasonable accommodation, individual accommodation,
reasonable alternative, and sufficient risk)
Part III: Some Practical Guidelines in Nondiscriminatory Recruitment and Selection
Key Practical Considerations in Nondiscriminatory Recruitment
The scope of practices that must be considered are more manageable if the success or failure of
recruitment is traced back to two main causes
o 1. The effectiveness or ineffectiveness of the organization in contacting and
communicating with target group members
o 2. The positive or negative perceptions that target group members hold about the
organization
Getting the word out about a job is not enough, job seekers must have a positive perception of
the organization as well as of their chances of getting the job before they will apply
o Perception is formed in at least two ways:
22
1. At the time the organization makes the initial contact through its outreach
recruiting
aka determined and persistent effort to make potential job applicants,
including designated group members, aware of available positions
2. Through the knowledge gained about the organization via third parties
o RBC does a good job at recruiting and helping prepare persons with disabilities and
Aboriginals
o IBM helps university students with disabilities who are pursuing computer science,
software engineering, and info technology
Page 102-103 has a bunch of lists about good recruiting practices
23
24
- You can use Job Analysis (JA) to help get necessary info – JA procedures can be elaborated, but
you can find answers by asking yourself a series of questions:
o What do you want new hire to accomplish daily/weekly/monthly/yearly?
o What tasks and responsibilities will be part of their jobs (use of equipment, supervising
others, will their day be routine or different daily?)
o What KSAOs should they have to perform successfully?
o What do SMEs think about the task, requirements, and KSAOS
o Will there be any differences between the job now and in the future?
25
o JA data is often collected from the most knowledgeable people about a job and the way it
is performed
o The people who are most knowledgeable are often the current job incumbents and their
immediate supervisors
o Choosing a SME closer to the job = better resultant info
o However, Dierdoff and Wilson – trained professional job analysts may provide more
accurate info than job incumbents when using self-reporting and surveys because they
will be more objective in their assessments
o To ensure defensibility of JA results, SMEs should be representative of target population
for a job (age, sex, ethnic background, seniority in position)
Info from diverse group will provide data that is more reliable, valid and accurate
o E.g., Meiorin – lack of job info from female firefighters, therefore not able to defend JA
from being challenged in court because of poor procedures
26
- Figure 4.2 Gives a synopsis of descriptions and labels used in the NOC which follow main
headings including: aptitudes; interests; data/information, people, things; physical activities;
environmental conditions; employment requirements
- Alternative sources to the NOC have until recently included:
o The Canadian Classification Dictionary of Occupations (CCDO)
Designed in 1971 by Employment and Immigration Canada, widely used by HR
professionals
Abandoned in 1992 bc it no longer reflected contemporary labour market
o The Dictionary of Occupational Tittles (DOT)
Now replaced by the O*NET system (Occupational Information Network) an
electronic database created by the US Department of Labour
Figure 4.3(p.122) shows basic content of Onet which is broken down in
to 6 main headings: worker characteristics; worker requirements;
experience requirements; occupation-specific information; workforce
characteristics; occupational requirements
- In addition to occupational databases it is important to give attention to determining the best ways
to gather job information. Some techniques are better than others.
- Analysis typically involves a series of steps (often beginning with interviews or observations).
- Ideally JA uses multiple strategies to arrive at a comprehensive and accurate description of the
job in question. Not always possible due to funding constraints
Work and Worker-Oriented Job Analysis
- One of the most common JA cauterizing techniques as either work oriented or worker oriented.
JA falling in to these two categories are legally defensible
- Work-oriented – focus on work outcomes and describing tasks to accomplish those outcomes
o Frequency of occurrence, amount of time spent on them, importance of the job outcome,
difficulty inherent to executing them
- Worker-oriented – general aspects of the job, describing perceptual, interpersonal, sensory,
cognitive and physical activities.
Survey of Work-Oriented Job Analysis Methods
- Structured Job Analysis Interviews
o Interviews are the most commonly used technique for gathering job facts and
establishing the task and behaviours that define a job
o Structured interview method is designed so that all interviewees are asked the same job-
related question; very reliable and fair
o Written, structured interviews are a fair and cost-effective alternative to the traditional oral
structured interviews
o Guidelines for conducting interviews are summarized in recruitment and selection
notebook 4.1 (p.124)
Announce the JA well ahead of the interview date
Participation in interviews should be voluntary, and incumbents should be
interviewed only with the permission of their supervisors
Interviews should be conducted in a private location free from the trappings of
status
Open the interview by establishing rapport with the employee and explaining the
purpose of the interview
Ask open-ended questions, using language that is easy to understand, and allow
ample time for the employee’s responses
Guide the session without being authoritative or overbearing
Explain to the employees that records of the interview will identify them only by
confidential codes
o Should record interviewee’s responses during the interview by writing them down or tape-
recording the interview
o R&S Notebook 4.2 (p.125-126) provides protocol for a structured job analysis interview;
this is an excellent example of a guide but should be edited to fit the specific job in mind
27
o Want to interview an accurate sample of the job incumbents (only interviewing females or
males for e.g., would skew info received). Supervisors should always be included in pool
of interviewees
o Disadvantages: can be expensive, time consuming, impractical (if you have to take lots of
people away from their jobs; workers may distort their job descriptions if they believe the
results will impact their pay
o Benefits can out weight their relative costs
- Direct Observation
o The JA watches employees as they carry out their job activities (sometimes called job
shadowing)
o Martinko believes that direct observation is the most effective way to determine what
effective job incumbents do
o Most useful when JA involves easily observable activities
o Before performing observation analyst should have learned about the job by studying
existing docs and determining the nature of the job
o Observations can be recorded as a narrative or under a customized checklist or
worksheet (see figure 4.4/4.5 for examples p. 127/128)
o Should observe multiple workers
o Observation times should be stratified so that all shifts are covered and conditions are
observed
o Tech aids are available such as audio and video recording. This can allow for the
augmentation of notes in future as you can record either verbal or non verbal
components of the observation session depending on what you use
o Observers must be aware that regardless of the technique they use, their presence will
change the behaviour of the employee e.g., Hawthorne experiment
o In addition to direct observation, job analyst may ask incumbents to monitor their own
work, such as keeping a diary.
Less time consuming, less expensive
Easier to use when conditions of work do not easily facilitate direct observation
by another person (dangerous or sensitive work)
Provide info that is otherwise unobservable cognitive and intellectual processes
Shortcomings: may not recall all their activities, additional duty to be completed in
addition to the workload, some amount of training may be required for people to
provide reliable and valid self-generated data
- Analyzing Structured Interview and Direct Observation Data
o After collecting the data, analysts use the resulting notes and tally sheets to identify
critical task statements which are used to describe the critical components of the job
through a standard format.
o Each task statement should include:
Action verb-describes the actions performed
Object of the verb – person, data, or things affected by the action
Rationale or observable work product – the intended outcome or product of the
action
Materials, tools, procedures, or equipment used to carry out the action
The directions or guidelines under which the action is taken.
o READ TASK STATEMENT EXAMPLE P.130 for a better understanding
- Rating Task Statements and KSAOs
o Not all tasks are equal – some may be performed often but have little importance, and
have little skill required where as others happen rarely but are very important and require
a high level of skill
o Important for SME to rate tasks with respect to frequency, importance and difficulty which
will help analysts to fully understand what goes on the the job
o KSAOs must also be rated by SMEs with respect to at least its importance in performing
specific task and its proficiency (required at entry of job? Sets entry level standard)
28
29
30
System for identifying which and to what degree an array of empirically derived
ability constructs are critical to perform a specific job effectively
Identified 52 human ability categories such as oral comprehension.
In the F-JAS booklet, abilities are grouped in to 4 clusters: cognitive,
psychomotor, physical, and sensory/perception.
10 raters familiar with the job assess the job with BARS system between (high 7
to low 1). The avg of 10 raters scores is obtained to provide statistically
significant value for the degree of expertise that job requires of that ability.
Figure 4.9 example p. 141, 4.10 p. 142, 4.11 p. 143
More recently Fleishman and his colleagues extended their work to a second
booklet which provides 21 job related social and interpersonal abilities.
- Other Job Analysis Methods
o There are many others, which are outlines in the R&S Notebook 4.3 and include
Common-metric questionnaire
Working Profiling System (WSP)
Threshold Traits Analysis System
Cognitive Task Analysis
Best Practice in Choosing Job Analysis Methods
- Advantages and disadvantage of the various methods discussed are outlined in R&S notebook
4.4 p. 145/146 good to read them over to review previous notes
- According to Levine and his colleagues there are 11 criteria for selecting the best JA method
o Operational status
o Availability
o Occupational versatility
o Standardization
o User acceptability
o Training requirements
o Sample size
o Reliability
o Cost
o Quality of outcome
o Time to completion
- Methods that gathered specific task data did so with greater accuracy than methods that
assessed generalized work activity
- Professional job analyst are more accurate assessors than job incumbents who complete self-
reports or surveys
- SMEs make the most reliable estimates when using importance and frequency scales rather than
other types of measurements
- The value of JA comes from how the info from the analysis will be used – practitioners must take
the intended use into consideration when choosing a method
- Different JA methods offer different degrees of accuracy, validity and reliability
o Read over p. 147-149 because it’s kind of confusing and I couldn’t properly summarize it
because I didn’t understand it too well
- R&S Notebook 4.6 (p.148) Assessing the legal defensibility of JA
o JA must be performed according to a set of formal procedures; common knowledge
stereotypes are not accepted as a defence
o JA must be well documented – information in analyst’s head is not enough
o JA should collect data from several up-to-date sources (several methods)
o The sample of ppl interviewed should be enough to accurately capture the job info and
should also represent the diversity of job incumbents to insure validity
31
o Job analysts should be properly trained in the different techniques to ensure they collect
objective info
o JA should determine the most important and critical aspects of the job, these key
attributes are that of which selection and evaluation for the job should be based
- There is no guarantee that any method will be accepted by the courts, however by doing formal
JA it will likely be more defensible
- Using a variety of sources is a form of triangulation which will produce the best information for
matching people to jobs
- R&S Notebook 4.7 (p. 149-150) guidelines for conducting a JA
o Determine the purpose
o Determine the resources
o Review available documentation/information
o Determine the JA method
o Identify SME and incumbents
o Conduct the JA
o Confirm the task and KSAO statements
o Compile the task and KSAO statements
o Establish cut off criteria
o Develop a task x KSAO matrix
o Select employment selection method(s)
o Document the JA
32
- Competency based selection systems take view that employees must be capable of moving
between jobs and carrying out the associated tasks for different positions.
- Identify both job and organizational level KSAOs
Competency Framework or “Architecture”
- Currently, orgs that use competency models mostly develop a 3-tiiered competency framework
- Identify competencies tha apply to all jobs in the org (core competencies), apply to groups of
similar jobs (functional competencies), and those that apply to a single cass of jobs (job-specific
competencies)
Competency Categories
- Core competencies
o Support org mission, vision and values
o Org KSAOS required for org success
o Apply to all members of the org
- Functional competencies
o Shared by different positions within a common job group
- Job Specific competencies
o Apply to a specific position
o In addition to core and functional competencies
- Figure 4.12 p.154
Competency Dictionaries
- Lists all competencies that are required by an org to achieve its mandate; include core functional
and job specific
- Part of developing a competency framework is developing a competency dictionary
- In some cases HR starts with a generic list of competencies that has not been tailored and then
adapt, this shortcut saves time and money but may not be as valid as initially identifying
competencies specific to the org
- Competency dictionaries include info on the proficiency level needed to be successful at each
position; all may require a certain competency, but may require at different levels
- Figure 4.14 p. 155 discusses competency levels of risk management
o Levels of competencies are cumulative
- Orgs assess each employee or potential employee w respect to the required proficiency levels
and then use these for selection, development, training, and promotional purposes.
- Proficiency scales like in 4.13 are included in the competency dictionary and show real and
observable differences from one level to another
- It is nor a tool for assessment but a series of behaviours that are expected at specific levels of
competency
Competency Profiles
- Set of core, functional and job specific competencies related to a function, job or employee
expressed in terms of expected level
- Job specific profile adds the proficiency levels required for a specific position, core is for all
members, and functional for the job groups
- Figure 4.14 p. 156 example of a competency profile
- Employee profile represents proficiency levels demonstrated by the employee, and matching
those levels against the different competency profiles will reveal a suitable holding for that person
- An org that uses competency models must have the capability to identify the required
competencies and then to assess accurately the competency level of each employee with respect
to the competency
Legal Defensibility of Competency Models
- Courts will use precedents for judging
- HR systems must be supported by empirical evidence that there is a link between selection
measures and the essential duties of a job
- More rigorous competency methodologies that incorporate JA procedures are more likely to
withstand legal scrutiny
- R&S Notebook 4.8 (p.158) steps in developing a competency-based management framework
33
34
35