E-Recruitment: A Study Into Applicant Perceptions of An Online Application System
E-Recruitment: A Study Into Applicant Perceptions of An Online Application System
E-Recruitment: A Study Into Applicant Perceptions of An Online Application System
recruitment portals from home at any time of day, and perceptions of corporate career websites and online
the range of interactive online information possibilities all application systems are strongly related to organizational
provide a highly appealing experience for potential attraction, behavior, decisions to drop out, and attitudes
applicants. The Internet therefore makes it far easier toward employers and organizations (Anderson, Lievens,
and quicker for candidates to search and apply for job Van Dam, & Ryan, 2004; Cober et al., 2004; Lievens
positions, to compare organizations online, and to do so & Harris, 2003; Ryan, Horvath, & Kriska, 2005; Sinar,
in real-time with responses being returned almost Reynolds, & Paquet, 2003; Williamson, Lepak, & King,
immediately when they subsequently decide to apply 2003). In spite of their practical importance, online
online. Candidates are thus able to search through application systems are still a fairly new area for the
thousands of job postings and apply for various jobs by conduct of applied research. However, judging from the
simply sending a resume via the Internet. Furthermore, extant literature it is apparent that five types of variables in
and importantly, global access to much more information particular have been found to influence applicant reac-
on organizations from multiple (independent) sources is tions: (I) perceived efficiency and (II) user-friendliness, (III)
now at candidates’ disposal. These technological innova- information provision, (IV) fairness perceptions, and (V)
tions have generated an enormous shift in the field of Internet selection image. We briefly review each in turn.
recruitment and have drastically transformed recruit-
ment activities at a pace that research into this quickly
1.2.1. Perceived efficiency and user-friendliness
evolving arena has struggled to keep up with (Anderson,
Several studies in different disciplines (consumer and
2003; Lievens & Harris, 2003). As Cappelli (2001, p. 139)
human–computer interaction literature) have shown
stated ‘The labor market . . . has at last become a true
that peripheral cues of online systems (e.g., online
market: wide open, uncontrolled by individual compa-
system usability and system speed) have a significant
nies, and unconstrained by geography.’
effect on user attitudes and intentions (Cober et al.,
The evolving labor market may have become more
2003). Furthermore, it has been argued within the
competitive than ever. Recruiters are increasingly chal-
applicant reaction literature that factors without direct
lenged to acquire and retain talent as labor markets are
relevance to the organization or the job are still crucial
changing due to globalization, technological innovation,
determinants of organizational attraction (Rynes, Bretz,
and social trends. As a result, personnel selection and
& Gerhart, 1991; Turban, 2001). From a theoretical
recruitment practices are increasingly characterized by
approach this effect could be explained as signaling
marketing approaches (Cappelli, 2001; Lievens, Van Dam,
(Cober et al., 2003), or an attribution bias, where job
& Anderson, 2002; Liljander, Riel, & Pura, 2002). Orga-
seekers draw inferences on cues that are most readily
nizational attraction has become vital and job seekers on
available. In addition, some researchers have found that
the Internet are more and more treated like consumers
job seekers have a heightened attention toward system
(Cober, Brown, Keeping, & Levy, 2004). It seems that a
usability and time-related cues of online recruitment
successful online recruitment system has become a
and selection tools (Cober et al., 2003; Lievens et al.,
necessity for organizations who wish to be competitive.
2002). Following this line of reasoning, one could argue
While the implementation of Internet-based recruit-
that perceived efficiency and user-friendliness are influ-
ment practices and application systems have been widely
ential features that affect the applicant’s perception.
embraced by organizations, many outstanding issues with
This argument has also been supported in empirical
regard to Internet-based application systems have re-
studies that found significant relations of user-friendli-
mained unanswered. Researchers have, for instance, only
ness and efficiency (i.e., perceptions of system speed)
recently started to investigate applicant preferences, reac-
with job seekers’ perceptions of online procedures
tions, and potential adverse impacts on certain groups
(Cober et al., 2003; Liljander et al., 2002; Sinar et al.,
(e.g., minority groups) of Internet-based application pro-
2003; Thompson, Braddy, & Wuensch, 2008). There-
cedures (Anderson, 2003; Cober, Brown, Levy, Cober, &
fore, we would expect that perceived user-friendliness
Keeping, 2003; Lievens & Harris, 2003). Other issues, such
and efficiency will affect applicant satisfaction with
as the source of the applicant (internal vs external),
online application procedures.
country of origin, and the influence of key demographic
variables such as computer familiarity, age, and previous
experiences with online recruitment procedures, are 1.2.2. Information provision
equally important but notably under-researched questions. Several studies have indicated that job seekers actively
seek organizational and job-related information (Cober
et al., 2003). In addition, information provision has been
indicated as an important factor in employment-related
1.2. Applicant reactions to new technology contexts as it is part of the applicant’s values and
A growing body of recent research provides theoretical expectations (Derous, Born, & De Witte, 2004). It
and empirical support for the assumption that candidates’ is therefore likely that the amount of information that is
provided to the applicant by the online system con- 1.3. Differences in perceptions among applicants
tributes to the applicant’s experience.
The second goal of the study was to explore whether
group differences in applicant perceptions exist. Most
1.2.3. Fairness perceptions
studies have revealed that applicants generally hold a
Furthermore, it has been suggested that information
positive attitude toward the use of Internet for recruit-
provision drives fairness heuristics (Bell, Ryan, & Wiech-
ment and selection purposes (Mead, 2001; Richman-
mann, 2004; Ployhart & Harold, 2004; Truxillo, Bauer,
Campion, & Paronto, 2002). Harris, Lievens, and Van Hirsch, Olson-Buchanan, & Drasgow, 2000; Salgado &
Hoye (2004) argued that information presented early in Moscoso, 2003; Weiss & Barbeite, 2001; Zusman &
the selection procedure will affect perceived fairness. Landis, 2002). However, some studies indicate that
Although the application procedure in this study did not group differences exist among applicant pools that
involve an assessment test, it did involve a screening may cause them to evaluate and process cues in
situation where job applicants were selected based on different ways. Inequality of skills, computer experi-
the information they had submitted through the online ence, Internet efficacy, and openness to experience are
application system. According to the organizational some examples of variables that are likely to influence
justice literature, fairness perceptions can affect applicant applicant perceptions and reactions to online systems
reactions at this early stage of the selection process. It (Anderson, 2003; Bartram, 2000; Wiechmann & Ryan,
can be influenced by various aspects such as information 2003; Williamson et al., 2003). Sinar et al. (2003, p. 150)
provision on selection criteria before selection (Lievens, hypothesized, for example, that it is ‘unlikely that all
De Corte, & Brysse, 2003), perceived job relatedness, candidates attend to the same characteristics of Inter-
and interpersonal treatment (Gilliland, 1993; Truxillo net-based systems or that these characteristics influ-
et al., 2002; Van Vianen, Taris, Scholten, & Schinkel, ence all candidates in similar ways.’ Similarly, Lievens and
2004). Because fairness perceptions have been linked to Harris (2003) hypothesized that more experienced job
various outcome variables, including satisfaction with seekers would use peripheral processing less frequently
application processes and recommendation intentions than first-time job seekers. In line with these arguments
(Bauer, Maertz, Dolen, & Campion, 1998; Bell et al., Murphy and Tam (2004) discussed a Bayesian perspec-
2004; Gilliland, 1994), it was expected that these percep- tive suggesting that applicants with more experience
tions affect the applicant’s overall satisfaction with the will be less easily swayed by experiences in the job
online procedure. search process than inexperienced applicants as they
have more information about the context.
1.2.4. Internet selection image Differences in applicant reactions might also exist
A fifth variable that might affect the applicant’s satisfac- due to age and gender differences, which have been
tion with the Internet as an application medium is studied more widely. However, studies have produced
Internet selection image. This is a construct initially quite contradictory findings. Some studies have identi-
described by Sinar et al. (2003) and reflects a candi- fied gender and age differences in perceived user-
date’s image of companies that use the Internet friendliness, reticence about disclosure of personal
for applicant selection purposes. Sinar et al. (2003, p. information on the Internet, and efficacy (Czaja &
155) regarded this construct within a cross-organiza- Sharit, 1998; Schumacher & Morahan-Martin, 2001;
tional sample as an outcome variable that pertains Sinar & Reynolds, 2001; Weiss & Barbeite, 2001). These
to ‘the effects of online selection system properties differences in attitudes toward the use of computers
on the image of companies using such techniques.’ In and the Internet point to a so-called digital-divide or e-
the present study, this construct will be treated as a loadedness (Sharf, 2000), the effects of which might
predictor variable. We posit that applicant attitudes generalize to Internet-based application procedures and
toward the use of Internet for selection purposes might online test performance (Lievens & Harris, 2003). Yet,
affect their perceptions of online application systems there are also studies that contradict these findings or
and their satisfaction with Internet-based systems. at least show mixed results with regard to age and
Following this line of argument, we would expect that gender differences in perceptions of computer-based
perceived user-friendliness, perceived efficiency (i.e. per- procedures (Cober et al., 2003; Heimrath & Goulding,
ceived system speed), fairness perceptions, information 2001; Potosky & Bobko, 2004; Sinar et al., 2003). These
provision, and Internet selection image will affect the ambiguous findings indicate a need for further research
applicant’s overall process satisfaction with the online in order to gain a better understanding of possible
application system. The list of these predictors is not group differences among applicant reactions.
meant to be exhaustive but intended to cover and As a consequence of technological innovations, inter-
explore the main aspects of online application systems nal applicants are more and more often urged to apply
that are likely to have an impact on applicant satisfaction through application systems that are similar to those
with Internet-based application systems. used for external applicants (Cappelli, 2001). Especially
organizations with many employees have started to use not available due to privacy issues, the composition of
online application systems for their internal applicants the sample indicated a wide variety of applicants in
in order to benefit from the many advantages that terms of age, education level, job type, and employment
information technology has to offer. However, to the status. Candidates applied for various vacancies at the
best of our knowledge, no research has been conducted organization ranging from traineeships to senior man-
on potential differences in perceptions of Internet-based agement positions. Vacancies were available in different
application systems between external (entry-level) and departments, such as corporate banking, asset manage-
internal (promotion) applicants. Yet, it is conceivable that ment, logistics, information technology, human resources,
internal applicants have different expectations and are sales, and administration. The sample consisted of both
influenced by different aspects and values than external internal (N ¼ 441) and external (N ¼ 919) applicants who
applicants. One of the obvious differences is the basic had applied online through a Dutch, Belgian, or British
discrepancy in contextual information and the presence career site of the organization. Participants applied for a
of an enduring commitment to the organization. Internal position in the Netherlands (57.8%), Belgium (39.6%), or
applicants are undoubtedly more knowledgeable about the United Kingdom (2.6%) over a 2-month period during
the culture, structure, values, working conditions, and which the website was ‘live’ and applicant reaction mea-
perhaps the application procedures of the organization. sures were integrated into the design of the website.
Internal applicants may therefore hold different expecta- Participation was completely anonymous and on a volun-
tions and different frames of reference. This is likely to tary basis. The average age of respondents was 33
result in different information processing, attributions, (SD ¼ 9.6) years and 58% of the sample was male. Of
and interpretations with regard to the application process the respondents, 10.9% belonged to an ethnic minority
and treatment (Chan & Schmitt, 2004; Fiske & Taylor, group. Participants had completed a high school degree
1991; Ryan & Ployhart, 2000). (22.3%), a professional or academic bachelor (43.3 %), or
a master’s degree or higher (34.4%). Most of the
applicants were employed (68.4%), while 18.5% were
1.4. Present study: aims and objectives unemployed and 13.0% were in training or education.
More than 80% of respondents had previously used the
In summary, the goal of this study was to quantify and
Internet to search or apply for a job.
identify determinants of applicant satisfaction with an
The sample derived from applicants who applied for a
online application system. The aim was to identify the
job position in the United Kingdom was eliminated
relative importance of variables that affect the applicant’s
from any further analysis due to its restrictively small
satisfaction and to construct a model that includes charac-
sample size (N ¼ 35). This resulted in a total sample of
teristics related to the online application system (namely,
1325 applicants.
perceived efficiency, user-friendliness, information provi-
sion, fairness perceptions, and Internet selection image)
while simultaneously accounting for characteristics of the
applicant (age, gender, ethnic minority status, prior ex- 2.2. Procedure
perience with online applications, Internet familiarity, The researchers did not have access to the actual
country, and applicant source). First, we examined appli- application data due to stringent privacy regulations.
cant perceptions of the online application system while Rather, data on the measures were collected using an
controlling for characteristics of the applicant. Second, we online questionnaire that was administered subsequent
explored whether different applicant subgroups evaluate to the online application procedure. In order to delin-
and process cues in different ways. eate the boundary conditions for the generalization of
the findings of this study we will first describe the data
that were collected as part of the application procedure
2. Method followed by a description of the research questionnaire.
for remarks or suggestions and respondents were measure of information provision, a two-item measure
thanked for their participation. for efficiency and a two-item measure for Internet
selection image.
Means, standard deviations, Cronbach’s a’s and cor-
relations among the variables are presented in Table 1.
3. Analyses and results
All Cronbach’s a values were over .70 showing sufficient
reliability for all scales. Before further analyses, vari-
3.1 Confirmatory factor analysis (CFA)
ables were examined for multicollinearity (e.g., verifying
A CFA was performed to test for the construct validity that an independent variable is not a linear function of
of the measures (efficiency, user-friendliness, informa- other independent variables). In accordance with Ta-
tion provision, process fairness, and Internet selection bachnick and Fidell (2006), correlations between inde-
image). All 18 items were used as indicators. The five- pendent variables were below .70, thus showing no
factor CFA model fit was: w2 (125) ¼ 1264.12, po.01, evident problem with collinearity. In addition, results
root mean square error of approximation showed no multicollinearity according to the criteria
(RMSEA) ¼ .09, comparative fit index (CFI) ¼ .88. Clo- suggested by Belsley, Kuh, and Welsch (1980) as the
ser examination revealed two items on information conditioning index was not 430 for any given dimen-
provision with factor loadings o.50. These items were sion coupled with variance proportions 4.50 for at
removed which resulted in a five-item measure for least two different variables. All predictor variables
information provision. Furthermore, one item for effi- (perceived efficiency, Internet selection image, user-
ciency and one item for Internet selection image were friendliness, process fairness, and information provi-
removed due to cross loadings. The five-factor CFA sion) were significantly correlated with overall process
model was tested with 14 indicators and resulted in a satisfaction (po.01).
satisfactory model fit: w2 (67) ¼ 58,893, po.01,
RMSEA ¼ .08, CFI ¼ .93. Factor loadings ranged from
.64 to.87 (user-friendliness), from .81 to .84 (efficiency),
from .57 to .80 (information provision), from .67 to .84
3.2. Heuristic model
(process fairness), and from .80 to .87 (Internet selec- A hierarchical regression analysis was conducted to
tion image). Inter-factor correlations were between .23 investigate whether characteristics related to the online
(efficiency, information provision) and .64 (Internet application system (i.e., efficiency, user-friendliness, in-
selection image, process fairness). The w2 comparison formation provision, process fairness, and Internet
revealed that the 14-item model fits the data signifi- selection image) affect overall process satisfaction
cantly better than the 18-item model: w2 (58) ¼ 675.19, (Table 2). Prior experience, Internet familiarity, appli-
po.01. CFAs were also performed for both countries cant source, and country were entered as control
separately and revealed an acceptable fit for both variables in the first step, because these variables had
countries. The detailed CFA results are available upon a non-zero correlation with the criterion and had
request from the first author. For further analyses we significant correlations with one or more of the
therefore used the 14-item model, that is, the five-item predictor variables (LeBreton, Hargis, Griepentrog,
Table 1. Means, standard deviations, reliabilities, and correlations (sample size ranges from 1141 to 1325, with a median of 1300)
M SD 1 2 3a 4 5 6 7 8 9 10 11 12 13
Oswald, & Ployhart, 2007). Age, gender, and minority model. That is, efficiency consistently ranks as the most
status were omitted because there was no significant important predictor followed by user-friendliness.
correlation with the criterion. According to LeBreton Next, we conducted analyses to examine (1) mean
et al. (2007), researchers should omit such variables differences between applicant subgroups and (2)
from regression analyses ‘because the lack of a signifi- whether the grouping variable moderated the relation-
cant bivariate relationship is indicative of a specification ships between the website characteristics and overall
error’ (LeBreton et al., 2007, p. 477). All predictors process satisfaction. Among the variables of interest
with the exception of information provision had a were age, gender, ethnic minority status, prior experi-
significant effect on overall process satisfaction ence, Internet familiarity, country, and applicant source.
(po.01). This model accounted for 61% of the variance Because age, gender, and ethnic minority status did
beyond the control variables. not correlate significantly with the predictor variables
In addition to the regression analysis, relative weights and overall process satisfaction, we chose only to
were computed to make assertions regarding the relative pursue these analyses for prior experience, Internet
importance of the predictors of overall process satisfac- familiarity, country, and applicant source. Prior experi-
tion (Johnson, 2000; LeBreton et al., 2007; Thompson et ence and Internet familiarity were highly negatively
al., 2008). Relative weights (e), which sum up to the skewed thereby violating the assumption of normal
model R2, were computed on the basis of a syntax distribution. Therefore, these variables were dichoto-
obtained from J. W. Johnson (personal communication, mized. For prior experience this resulted in a group
July 14, 2006). These statistics permit the evaluation of of applicants indicating that they had applied for a
the relative weight of each predictor in a more balanced job online less than five times (N ¼ 700) and a group
and thorough manner by considering both the unique of applicants who had applied for a job online five or
contribution of each variable by itself and in combination more times (N ¼ 618). For Internet familiarity this
with the other variables (Johnson, 2000; LeBreton et al., resulted in a group of applicants highly familiar with
2007). Rescaled relative weights reflect the percentage of the use of Internet (N ¼ 851), i.e., a rating of seven, and
predicted criterion variance (e Pct.) attributed to each a group of applicants rating themselves less familiar with
predictor (Table 2). This analysis suggests that efficiency the use of Internet (N ¼ 454), i.e., rating themselves less
(e Pct. ¼ 31%) was the most important predictor of than seven. Below we first present the one-way ana-
applicant satisfaction, followed by user-friendliness (e lyses of variance to test whether there were mean
Pct. ¼ 25%), process fairness (e Pct. ¼ 18%), and Internet differences in applicant perceptions across the groups.
selection image (e Pct. ¼ 18%). As a further exploration Means and standard deviations per subgroup are
relative weights were also computed for subgroups that reported in Table 3.
differentiated between (1) applicants with high or low
levels of prior experience, (2) applicants with high or low
levels of Internet familiarity, (3) internal vs external 3.2.1. Prior experience
applicants, and (4) Dutch vs Belgian applicants. The way Analysis of variance showed no significant effects for
in which the sample was split for each of these variables is prior experience on either the predictors or the out-
described in greater detail below. The analyses (available come variable. Because of these non-significant differ-
upon request from the first author) revealed similar ences, it was decided not to further explore the effects
patterns of predictor importance as the full sample of this variable.
Table 2. Summary of hierarchical regression analysis for variables predicting process satisfaction (N ¼ 1324), and raw relative
weights (e RW) and rescaled relative weights as percentages (e Pct.) of R2 (R2 ¼ .73)
Variable Step 1 Step 2 Relative weights
B SE B b B SE B b e RW e Pct.
Table 3. Descriptive statistics for prior experience. Applicant source. Internet familiarity and country
Prior experiencea Applicant source Internet familiaritya Country
Overall process 5.34 (1.28) 5.46 (1.26) 5.07 (1.23) 5.56 (1.26) 5.00 (1.19) 5.61 (1.26) 5.16 (1.30) 5.75 (1.14)
satisfaction
Efficiency 5.22 (1.47) 5.29 (1.55) 5.05 (1.49) 5.36 (1.50) 4.90 (1.38) 5.44 (1.54) 4.95 (1.58) 5.70 (1.27)
Internet selection image 5.03 (1.37) 5.18 (1.37) 4.81 (1.30) 5.25 (1.38) 4.75 (1.22) 5.29 (1.41) 4.94 (1.35) 5.35 (1.36)
User-friendliness 5.18 (1.15) 5.20 (1.26) 4.75 (1.30) 5.41 (1.17) 4.87 (1.20) 5.36 (1.25) 4.98 (1.30) 5.49 (1.11)
Process fairness 5.01 (1.21) 4.98 (1.27) 4.68 (1.25) 5.14 (1.21) 4.66 (1.18) 5.16 (1.24) 4.90 (1.26) 5.13 (1.20)
Information provision 4.50 (1.04) 4.43 (1.15) 4.21 (1.08) 4.61 (1.08) 4.32 (1.07) 4.55 (1.10) 4.43 (1.08) 4.54 (1.12)
N 700 618 441 884 454 851 786 539
Note: Owing to missing values N varied approximately seven cases across the dimensions. aPrior experience and Internet familiarity were
dichotomized because these variables were highly negatively skewed.
3.2.2. Internet familiarity with applicants low on Internet familiarity, for internal
Analysis of variance showed significant effects for applicants compared with external applicants, and for
Internet familiarity on predictor and outcome variables. applicants who applied for a job in the Netherlands as
Respondents high on Internet familiarity were more opposed to Belgium.
positive on perceived efficiency F(1, 1300) ¼ 38.54,
po.001, Internet selection image F(1, 1299) ¼ 48.17,
po.001, user-friendliness F(1, 1296) ¼ 46.40, po.001, 3.2.5. Moderator analyses
process fairness F(1, 1299) ¼ 49.48, po.001, informa- Secondly, it was investigated whether prior experience,
tion provision F(1, 1289) ¼ 12.89, po.001, and overall Internet familiarity, applicant source, and country mod-
process satisfaction F(1, 1299) ¼ 72.64, po.001 com- erated the relationships between characteristics related
pared with respondents who rated themselves rela- to the online application system (efficiency, Internet
tively low on Internet familiarity. selection image, user-friendliness, process fairness, and
information provision) and process satisfaction. None
3.2.3. Internal vs external applicants of these relationships were found to be moderated by
Analysis of variance showed significant effects for internal prior experience, Internet familiarity, applicant source,
vs external applicants on predictor and outcome vari- and country in a regression model with the other
ables. External applicants were more positive than inter- predictors entered as covariates. These moderator
nal applicants on perceived efficiency F(1, 1306) ¼ 12.46, analyses (which are available upon request from the
po.001, Internet selection image F(1, 1305) ¼ 31.16, first author) were carried out using an SPSS macro that
po.001, user-friendliness F(1, 1303) ¼ 84.89, po.001, was obtained from Newsom (2003).
process fairness F(1, 1305) ¼ 41.89, po.001, information
provision F(1, 1296) ¼ 38.32, po.001 and overall process
satisfaction F(1, 1305) ¼ 43.58, po.001. 4. Discussion
3.2.4. Between-country differences Results reported in the present paper address a notably
Analysis of variance showed cross-country differences under-researched but practically important aspect of E-
between the Netherlands and Belgium on all predictor recruitment procedures within organizations. While
and outcome variables except for information provision more traditional forms of paper-based recruitment have
F(1, 1296) ¼ 3.04, p ¼ .08. Results show that respondents received considerable research attention over the years
who applied for a job position in Belgium were more (e.g., Lievens & Thornton, 2005), these findings thus add
positive compared with respondents who applied for a to the limited body of research in selection psychology to
job position in the Netherlands on perceived efficiency date. To summarize the key results, it was found that:
F(1, 1306) ¼ 81.94, po.001, Internet selection image
F(1, 1305) ¼ 28.05, po.001, user-friendliness F(1, 1303) ¼ (1) Applicants reported generally favorable reactions to
54.57, po.001, process fairness F(1, 1305) ¼ 10.92, the web-based procedure used by the organization.
p ¼ .001, and overall process satisfaction F(1, 1305) ¼ (2) Ranging from most to least important, efficiency,
71.14, po.001. user-friendliness, process fairness, and Internet
In sum, results showed small to moderate differences selection image were identified as determinants of
for applicants high on Internet familiarity compared applicant satisfaction.
(3) Candidates who were external (as opposed to Relative weights analyses indicated that perceived
internal), who applied for a job in Belgium (as efficiency is the most important predictor of applicant
opposed to the Netherlands), or who were highly satisfaction with the online application, followed by
(as opposed to less) familiar with the use of Internet perceptions of user-friendliness. The importance of
were more positive about the online application efficiency and user-friendliness is corroborated by
system and its characteristics. Yet, similar patterns Cober et al. (2003) who, using a sample of under-
of relative predictor importance emerged across all graduate students, found that perceived navigational
subgroups and no moderator effects were found. usability uniquely contributed to organizational attrac-
tion and recommendation intentions. Many other
We consider each key result below. Limitations of authors have stressed the considerable time-savings
the study will then be discussed and suggestions for inherent to the use of Internet for recruitment pur-
future research are covered in conclusion. poses (e.g., Cappelli, 2001; Cober et al., 2004; Lievens &
Harris, 2003). The importance of efficiency makes
sense when considered in light of the salience of
efficiency expectations in using the Internet in general.
4.1. General perception of the online application That is, people might be quick to get frustrated when
process
websites are inefficient or unfriendly to navigate,
Although the generally positive reactions of job appli- thereby subsequently affecting the overall satisfaction.
cants about the Internet recruitment site evaluated in These results suggest that it is worthwhile for organiza-
the present study is perhaps not a surprising finding, it is tions to consider the efficiency and user-friendliness of
nevertheless relevant and encouraging. The application their online application system from an applicant’s point
process is often the first impression job seekers gain of view. Applicant perceptions and organizational at-
about an organization and its HR policies. These traction may be rather easily influenced at this early
impressions can strongly affect the applicant’s decisions stage of the selection process by means of efficiency
and affect the very basis of the psychological contract and user-friendliness improvements. This suggestion is
between employer and employee (Hausknecht et al., also in line with signaling theory and findings of
2004; Murphy & Tam, 2004). It is therefore crucial that Thompson et al. (2008), showing that ‘superficial’
organizations carefully consider their recruitment and features can in fact have influential effects upon appli-
selection practices. Results of the current study suggest cant perceptions.
that applicants, who apply to an organization via an In light of myriad assertions in the organizational
Internet recruitment platform, are likely to proceed justice literature that underline the importance of fair-
with rather positive reactions. ness perceptions, a surprising finding of the current
investigations is that apparently, perceived characteris-
tics of the website (i.e., efficiency and user-friendliness)
matter more than fairness perceptions in determining
4.2. Determinants of applicant satisfaction and
overall process satisfaction. Indeed, in the early phases
relative importance of this study we anticipated that perceived fairness
From the full model regression analysis, which con- would have a more pronounced effect upon overall
trolled for applicant characteristics (prior experience applicant satisfaction. Certainly, the organizational jus-
with online applications, Internet familiarity, applicant tice framework has frequently been applied to under-
source, and country) it was found that efficiency, user- stand applicant reactions in personnel selection
friendliness, process fairness and Internet selection procedures (e.g., Chan & Schmitt, 2004) and this has
image are significant predictors of applicant satisfaction. resulted in empirical findings in support of these
These results corroborate the expectations which assumptions. The relatively minor impact of fairness
were voiced in the introduction, with the exception perceptions (when compared with that of efficiency and
of information provision, which did not emerge as a user-friendliness) implies that fairness perceptions are
significant predictor. Because information provision was not a critically important determinant of applicant
the only predictor that pertained to an idiosyncratic satisfaction at this stage of the selection procedure.
element of the website, namely the specific vacancy Another conceivable explanation is that fairness per-
announcement, it could well be that respondent’s ceptions will only really matter when justice expecta-
scores on this variable varied as a function of the tions have been violated, pointing to a threshold effect
vacancy rather than the online application process. (Gilliland & Chan, 2001; Truxillo, Steiner, & Gilliland,
Future research should examine the relationship be- 2004). In addition, one could argue that applicants who
tween information provision and overall satisfaction did experience justice violations did not complete or
with online application procedures while controlling withdrew their application and were therefore not
for the specific vacancy announcement. captured in the present study.
4.3. Differences between applicants: latter group reporting less favorable perceptions.
demographics Although internal applicant reactions were still gener-
ally positive it would be interesting to know why
With regard to the demographic variables (namely gender,
satisfaction with web-based recruitment decreases sig-
age, and minority status) no significant differences were
nificantly when implemented for internal purposes.
found in the way applicants perceive and evaluate the
One could argue that differences are due to the
online application process, except for the small correla-
influence of expectations and knowledge about the
tion between ethnic minority status and user-friendliness.
job or application procedures (Ployhart & Harold,
Findings thereby indicate no evident issues for applicant
2004). Internal applicants may have become used to
attraction with regard to gender, age, or ethnic minority
certain standards and hold expectations that generalize
status when using online application procedures.
to multiple facets of the organization. It is also con-
Applicants who applied for a job in Belgium held
ceivable that internal applicants would expect a more
slightly more positive perceptions of the online applica-
personal and informal treatment due to their member-
tion procedure when compared with applicants who
ship of the organization. Differences between internal
applied for a job in the Netherlands. Given the lower
and external applicants could have important ramifica-
prevalence of the use of Internet in Belgium (Federale
tions for both research and practice. We therefore
Overheidsdienst Economie and Eurostat, 2008), the
consider it important that researchers broaden their
Belgian applicants in this study may have perceived the
scope to include internal applicant reactions.
online application system as more unique and modern.
In sum, perceived efficiency and user-friendliness
Although mean level differences were found between
were the two most important determinants of applicant
the two countries, there were no moderating effects of
satisfaction with the online application procedure,
country on the relationship between the perceived
irrespective of applicant characteristics. Where mean
website characteristics and applicant satisfaction.
differences were found, these did not seem to alter the
effects of perceived website characteristics on applicant
satisfaction. Similar patterns of predictor importance
4.4. Differences between applicants: Internet and no moderator effects were found, indicating that
familiarity satisfaction with the online procedure was affected in a
Findings of the current study showed that applicants hold similar way by the same website characteristics, irre-
different perceptions of the online system depending on spective of applicant characteristics (i.e., Internet famil-
their familiarity with the use of Internet. Applicants who iarity, country, and applicant source).
rated themselves as highly familiar with the use of
Internet reported significantly more positive perceptions
and higher levels of satisfaction with the online application 4.6. Study limitations and strengths
process in comparison with applicants who rated them-
selves as less familiar with the use of Internet. This First, although respondents were assured that their
outcome implies that the use of online recruitment responses were treated confidentially and anonymously
systems by organizations could lead to higher organiza- by the external research team, it remains questionable
tional attraction among job applicants who are highly if results were affected by socially desirable response
familiar with the Internet compared with candidates who tendencies. However, this is unavoidable in the context
are less familiar. A similar trend was found by Sinar et al. of a real-life website for organizational recruitment, and
(2003) where candidate’s with higher levels of Internet of course any social desirability would be present in all
experience reported a more positive image of companies sub-groups of applicants. A second potential limitation
that use the Internet to conduct their selection process. is that, due to the research design, it was not possible
For organizations facing a high selection ratio, it may thus to capture reactions from applicants who opted to
be prudent to consider having an alternative offline withdraw from the application procedure. Thus, with-
recruitment procedure in place, so as not to further drawal during the process of completing the web-based
restrict their candidate pool by excluding applicants on application could possibly have restricted our sample to
the basis of a potentially irrelevant individual difference those applicants who decided to complete the entire
variable (i.e., Internet familiarity). procedure. Third, due to space and time constraints, all
constructs were assessed by a limited number of items,
although all were drawn from previously validated
scales (Sinar et al., 2003; Steiner & Gilliland, 1996) and
4.5. Differences between applicants: applicant both CFA and reliability analyses supported the con-
source struct validity and reliability of the scales. Moreover, as
Discrepancies among applicant perceptions were also mentioned earlier, the current study was performed in
found for external and internal applicants, with the a real-life recruitment situation where we had a unique
opportunity to be able to evaluate the impact of formed in order to begin to understand how character-
country of origin, internal versus external source of istics of web-based systems are perceived by job
application, and a host of other demographic variables candidates. The study indicates that online recruitment
during the 2-month period that this study remained live and selection procedures were less positively perceived
on the organization’s European recruitment website. by some applicant subgroups than others, indicating
Given that the organization concerned was a financial that the success of online application systems cannot be
services multinational recruiting for a range of entry- generalized to all target groups. HR strategies on the
level job functions, we would argue that our findings Internet might therefore unintentionally lead to differ-
may also be generalizable to other organizations. ences in applicant reactions, satisfaction, and organiza-
Fourth, this study is limited in the sense that no hard tional attraction.
criteria (such as applicant follow-up, hiring decisions, To conclude, the generally positive applicant reac-
job offer acceptances) were collected. Such data could tions, the worldwide reach of the Internet, and sig-
further improve our understanding of applicant reac- nificant savings related to web-based recruitment and
tions to online recruitment procedures. For example assessment procedures, would all suggest that recruit-
and as was argued earlier, it may well be the case that ment and selection on the Internet has great potential.
applicants lower on Internet familiarity may be less well Additional research will be needed to examine why
served by online recruitment procedures, and would some applicants hold more positive perceptions than
therefore be less inclined to follow up on their applica- others, what the impact is upon organizational attrac-
tions. Future research into applicant reactions to online tion, and how organizations can best address these
recruitment procedures should endeavor to include issues to retain their attractiveness as a potential
hard criteria in addition to the perceptions that were employer in an increasingly global and electronically
studied in the current investigation. Such data would based recruitment marketplace.
offer the additional benefit of verifying sample repre-
sentativeness. Unfortunately, it is to be expected that
access to actual selection data will continue to be
arduous due to their highly sensitive nature. References
Fifth, the content and process of online recruitment
Anderson, N. (2003) Applicant and Recruiter Reactions to
procedures may be expected to vary from organization
New Technology in Selection: A critical review and agenda
to organization and in some cases even from depart-
for future research. International Journal of Selection and
ment to department within organizations. Unfortu- Assessment, 11, (2/3), 121–136.
nately, as of yet there does not seem to exist an Anderson, N., Lievens, F., Van Dam, K. and Ryan, A.M. (2004)
objective and accurate method to ‘categorize’ or Future Perspectives on Employee Selection: Key directions
compare recruitment and selection websites in terms for future research and practice. Applied Psychology: An
of quality. In fact, this specific corporate recruitment International Review, 53, (4), 487–501.
site has been subjected to various non-scientific inspec- Bartram, D. (2000) Internet Recruitment and Selection:
tions (in the Netherlands) and conclusions were very Kissing frogs to find princes. International Journal of Selection
equivocal. The website was ranked as the best and and Assessment, 8, (4), 261–274.
worst recruitment site, depending on the research Bauer, T.N., Maertz, C.P., Dolen, M.R. and Campion, M.A.
(1998) Longitudinal Assessment of Applicant Reactions to
institute. While it is unclear by what criteria the
Employment Testing and Test Outcome Feedback. Journal of
website was judged in these inspections, it illustrates
Applied Psychology, 83, (6), 892–903.
the difficulties and lack of consensus in describing a Bauer, T.N., Truxillo, D.M., Tucker, J.S., Weathers, V., Berto-
website’s quality and thereby the generalizability of the lino, M., Erdogan, B. et al. (2006) Selection in the Informa-
current findings to other websites. Given the consistent tion Age: The impact of privacy concerns and computer
findings across various characteristics of applicants in experience on applicant reactions. Journal of Management,
the current study, perhaps the five characteristics 32, (5), 601–621.
related to the online application system could be Bell, B.S., Ryan, A.M. and Wiechmann, D. (2004) Justice
included in the development of a taxonomy of user Expectations and Applicant Perceptions. International Journal
perceptions of recruitment and selection systems so as of Selection and Assessment, 12, (1/2), 24–38.
to facilitate comparison of findings in this domain. Belsley, D.A., Kuh, E. and Welsch, R.E. (1980) Regression
Diagnostics: Identifying influential data and sources of collinear-
ity. New York: Wiley.
Cappelli, P. (2001) Making the Most of On-Line Recruiting.
5. Conclusion Harvard Business Review, 79, (3), 139–146.
Chan, D. and Schmitt, N. (2004) An Agenda for Future
The current study examined the mechanisms of atti- Research on Applicant Reactions to Selection Procedures:
tude formation among applicants who applied for a job A construct-oriented approach. International Journal of
position through the Internet. This study was per- Selection and Assessment, 12, (1/2), 9–23.
Cober, R.T., Brown, D.J., Blumental, A.J., Doverspike, D. and Lievens, F., De Corte, W. and Brysse, K. (2003) Applicant
Levy, P. (2000) The Quest for the Qualified Job Surfer: It’s Perceptions of Selection Procedures: The role of selection
time the public sector catches the wave. Public Personnel information, belief in tests, and comparative anxiety.
Management, 29, (4), 479–496. International Journal of Selection and Assessment, 11, (1),
Cober, R.T., Brown, D.J., Keeping, L.M. and Levy, P. (2004) 67–77.
Recruitment on the Net: How do organizational web site Lievens, F. and Harris, M.M. (2003) Research on Internet
characteristics influence applicant attraction. Journal of Recruiting and Testing: Current status and future direc-
Management, 30, (5), 623–646. tions. In: Cooper, C.L. and Robertson, I.T. (eds), Interna-
Cober, R.T., Brown, D.J., Levy, P., Cober, A.B. and Keeping, tional Review of Industrial and Organizational Psychology, Vol.
L.M. (2003) Organizational Web Sites: Web site content 16. Chichester: John Wiley, pp. 131–165.
and style as determinants of organizational attraction. Lievens, F. and Thornton, G.C.I. (2005) Assessment Centers:
International Journal of Selection and Assessment, 11, (2/3), Recent developments in practice and research. In: Evers, A.,
158–169. Voskuijl, O. and Anderson, N. (eds), Handbook of Personnel
Czaja, S.J. and Sharit, J. (1998) Age Differences in Attitudes Selection. London: Blackwell.
Toward Computers. Journals of Gerontology Series B: Psycho- Lievens, F., Van Dam, K. and Anderson, N. (2002) Recent
logical Sciences and Social Sciences, 53, (5), P329–P340. Trends and Challenges in Personnel Selection. Personnel
Derous, E., Born, M. and De Witte, K. (2004) How Applicants Review, 31, (5), 580–601.
Want and Expect to be Treated: Applicants’ selection Liljander, V., Riel, A.C.R. and Pura, M. (2002) Customer
treatment beliefs and the development of the social process Satisfaction with E-Services: The case of an online recruit-
questionnaire on selection. International Journal of Selection ment portal. In: Bruhn, M. and Stauss, B. (eds), Yearbook of
and Assessment, 12, (1/2), 99–119. Services Management 2002. Wiesbaden: Gabler, pp. 407–
Federale Overheidsdienst Economie and Eurostat. (2008) 432.
Communicatiemedia En Audiovisuele Media [Communication Mead, A.D. (2001) How Well Does Web-Based Testing Work?
Media and Audiovisual Media] http://www.statbel.fgov.be/ Results of a Survey of Users of NetAssess. Paper presented at
fiGurEs/d75_nl.asp (accessed October 1, 2008). the 16th Annual Conference of the Society for Industrial
Fiske, S.T. and Taylor, S.E. (1991) Social Cognition. New York: and Organizational Psychology, April, San Diego, CA.
McGraw-Hill. Murphy, K.R. and Tam, A.P. (2004) The Decisions Job Appli-
Freeman, R.B. (2002) The Labour Market in the New Infor- cants Must Make: Insights from a Bayesian perspective.
mation Economy. Oxford Review of Economic Policy, 18, (3), International Journal of Selection and Assessment, 12, (1/2),
288–305. 66–74.
Gilliland, S.W. (1993) The Perceived Fairness of Selection Newsom, J.T. (2003) SPSS Macro for Testing the Interaction
Systems: An organizational justice perspective. Academy of Between Two Continuous Variables and Calculating Simple
Management Review, 18, (4), 694–734. Slopes. Available at http://www.upa.pdx.edu/IOA/newsom/
Gilliland, S.W. (1994) Effects of Procedural and Distributive macros.htm (accessed July 28, 2006).
Justice on Reactions to a Selection System. Journal of Applied Ployhart, R.E. and Harold, C.M. (2004) The Applicant Attribu-
Psychology, 79, (5), 691–701. tion–Reaction Theory (AART): An integrative theory of
Gilliland, S.W. and Chan, D. (2001) Justice in Organizations: applicant attributional processing. International Journal of
Theory, methods, and applications. In: Anderson, N., Ones, Selection and Assessment, 12, (1/2), 84–98.
D.S., Sinangil, H.K. and Viswesvaran, C. (eds), Handbook of Potosky, D. and Bobko, P. (2004) Selection Testing Via the
Industrial, Work and Organizational Psychology, Vol. 2. London: Internet: Practical considerations and exploratory empirical
Sage, pp. 143–165. findings. Personnel Psychology, 57, (4), 1003–1034.
Harris, M.M., Lievens, F. and Van Hoye, G. (2004) ‘I Think they Richman-Hirsch, W.L., Olson-Buchanan, J.B. and Drasgow, F.
Discriminated Against Me’: Using prototype theory (2000) Examining the Impact of Administration Medium on
and organizational justice theory for understanding per- Examinee Perceptions and Attitudes. Journal of Applied
ceived discrimination in selection and promotion situations. Psychology, 85, (6), 880–887.
International Journal of Selection and Assessment, 12, (1/2), Ryan, A.M., Horvath, M. and Kriska, S.D. (2005) The Role of
54–65. Recruiting Source Informativeness and Organizational Per-
Hausknecht, J.P., Day, D.V. and Thomas, S.C. (2004) Applicant ceptions in Decisions to Apply. International Journal of
Reactions to Selection Procedures: An updated model and Selection and Assessment, 13, (4), 235–249.
meta-analysis. Personnel Psychology, 57, (3), 639–683. Ryan, A.M. and Ployhart, R.E. (2000) Applicants’ Perceptions
Heimrath, R. and Goulding, A. (2001) Internet Perception and of Selection Procedures and Decisions: A critical review
Use: A gender perspective. Program: Electronic Library and and agenda for the future. Journal of Management, 26, (3),
Information Systems, 35, (2), 119–134. 565–606.
Johnson, J.W. (2000) A Heuristic Method for Estimating the Rynes, S.L., Bretz, R.D. and Gerhart, B. (1991) The Impor-
Relative Weight of Predictor Variables in Multiple Regres- tance of Recruitment in Job Choice: A different way of
sion. Multivariate Behavioral Research, 35, (1), 1–19. looking. Personnel Psychology, 44, (3), 487–521.
LeBreton, J.M., Hargis, M.B., Griepentrog, B., Oswald, F.L. and Salgado, J.F. and Moscoso, S. (2003) Internet-Based Personality
Ployhart, R.E. (2007) A Multidimensional Approach for Testing: Equivalence of measures and assessees’ percep-
Evaluating Variables in Organizational Research and Prac- tions and reactions. International Journal of Selection and
tice. Personnel Psychology, 60, (2), 475–498. Assessment, 11, (2–3), 194–205.
Schumacher, P. and Morahan-Martin, J. (2001) Gender, Inter- Truxillo, D.M., Steiner, D.D. and Gilliland, S.W. (2004) The
net and Computer Attitudes and Experiences. Computers in Importance of Organizational Justice in Personnel Selec-
Human Behavior, 17, (1), 95–110. tion: Defining when selection fairness really matters. Inter-
Sharf, J.C. (2000) As if ‘G-Loaded’ Adverse Impact isn’t Bad national Journal of Selection and Assessment, 12, (1/2), 39–53.
Enough, Internet Recruiters can Expect to be Accused of Turban, D.B. (2001) Organizational Attractiveness as an
‘E-Loaded’ Impact. The Industrial–Organizational Psychologist, Employer on College Campuses: An examination of the
38, 156. applicant population. Journal of Vocational Behavior, 58, (2),
Sinar, E.F. and Reynolds, D.H. (2001) Applicant Reactions to 293–312.
Internet-Based Selection Techniques. Paper presented at the Van Vianen, A.E.M., Taris, R., Scholten, E. and Schinkel, S.
16th Annual Conference of the Society for Industrial and (2004) Perceived Fairness in Personnel Selection: Determi-
Organizational Psychology, San Diego. nants and outcomes in different stages of the assessment
Sinar, E.F., Reynolds, D.H. and Paquet, S.L. (2003) Nothing but procedure. International Journal of Selection and Assessment,
‘Net? Corporate Image and Web-Based Testing. Interna- 12, (1/2), 149–159.
tional Journal of Selection and Assessment, 11, (2/3), 150–157. Weiss, E.M. and Barbeite, G.F. (2001) Internet as a Job Source
Steiner, D.D. and Gilliland, S.W. (1996) Fairness Reactions to and Job Site Preference. Paper presented at the 16th Annual
Personnel Selection Techniques in France and the United Conference of the Society for Industrial and Organizational
States. Journal of Applied Psychology, 81, (2), 134–141. Psychology, San Diego.
Tabachnick, B.T. and Fidell, L.S. (2006) Using Multivariate Wiechmann, D. and Ryan, A.M. (2003) Reactions to Compu-
Statistics, International Edition (5th edn). Boston: Allyn and terized Testing in Selection Contexts. International Journal of
Bacon. Selection and Assessment, 11, (2/3), 215–229.
Thompson, L.F., Braddy, P.W. and Wuensch, K.L. (2008) E- Williamson, I., Lepak, D.P. and King, J. (2003) The Effect of
Recruitment and the Benefits of Organizational Web Company Recruitment Web Site Orientation on Indivi-
Appeal. Computers in Human Behavior, 24, (5), 2384–2398. duals’ Perceptions of Organizational Attractiveness. Journal
Truxillo, D.M., Bauer, T.N., Campion, M.A. and Paronto, M.E. of Vocational Behavior, 63, 242–263.
(2002) Selection Fairness Information and Applicant Reac- Zusman, R.R. and Landis, R.S. (2002) Applicant Preferences
tions: A longitudinal field study. Journal of Applied Psychology, for Web-Based Versus Traditional Job Postings. Computers
87, (6), 1020–1031. in Human Behavior, 18, (3), 285–296.