1 s2.0 S026840122200069X Main
1 s2.0 S026840122200069X Main
1 s2.0 S026840122200069X Main
A R T I C L E I N F O
A B S T R A C T
Keywords:
Artificial intelligence Artificial intelligence (AI) is gaining increasing attention from business leaders today. As a primary AI tool,
Chatbot chatbots have seen increasing use by companies to support customer service. An understanding of how chatbots
Customer service are used is essential for improving customer service. Based on the relevant literature, this study examined the
Agility impacts of chatbot-enabled agility (namely, internal and external chatbot agility) on customer service perfor-
Routine use
mance and explored the antecedents from the perspective of information technology use (both routine and
Innovative use
innovative use). We collected data from 294 U.S. marketing employees from various industries, using a survey for
Dynamic capabilities
the assessment of our research model. The results showed that both routine and innovative use of chatbots were
positively related to internal and external agility. In particular, the innovative use of chatbots plays an important
role in creating business agility. Moreover, internal and external agility are positively related to customer service
performance. Through a close look at chatbots and their use, our study provides insight into the role of AI in
creating business agility. Practically speaking, this study suggests that both the routine and the innovative use of
chatbots should be encouraged to create agility and develop business sustainability.
1. Introduction
companies’ ability to take advantage of their resources (e.g., technol-
Artificial intelligence (AI) has provided great opportunities for ogy) to efficiently identify and address opportunities and threats
companies to address challenges raised in today’s rapidly changing (Mathiassen & Pries-Heje, 2006). Companies must enhance business
marketplace (Borges, Laurindo, Spínola, Gonçalves, & Mattos, 2020; agility to respond to market changes by deploying proper IT. Such IT-
Duan, Edwards, & Dwivedi, 2019; Dwivedi et al., 2021; Hu, Lu, Pan, enabled agility is critical to sustaining business success (Chuang, 2020;
Gong, & Yang, 2021). For example, chatbots supported by AI have Trischler, Johnson, & Kristensson, 2020). To incorporate chatbots into
received increasing responsibility to provide effective customer customer service, practitioners need to recognize the business agility
communication (Chung, Ko, Joung, & Kim, 2020; Coombs, 2020; He, created by chatbots (Akhtar, Khan, Tarba, & Jayawickrama, 2018).
Zhang, & Li, 2021). These chatbots can process a large amount of data Such chatbot-enabled business agility can help firms to better manage
and train themselves to interact with customers (Mikalef & Gupta, the changing environment and meet customer needs (Akhtar et al.,
2021). Recent reports predict that retail sales via chatbots will reach 2018; Chuang, 2020).
$112 billion by 2023 (Williams, 2019). Chatbots constantly improve The literature has suggested that IT use can enhance business
their conversational abilities (Watson, 2019), which can help agility. For example, Chuang (2020) reported that social-information
companies respond to customer demand and market changes (Chiu & processing capability and customer cocreation build social media
Chuang, 2021). agility, which then enhances the strength of customer–firm
As such, chatbots have gained increasing popularity in creating new relationships. With the development of AI, organizations have
business agility enabled by information technology (IT) (Chung et al., increasingly used chatbots to support employees’ work, which is likely
2020; McLean & Osei-Frimpong, 2019). Business agility refers to to create new business agility. However, to the best of our knowledge,
few studies have attempted to investigate how the use of chatbots creates
business agility and supports
* Corresponding author.
E-mail addresses: [email protected] (X. Wang), [email protected] (X. Lin), [email protected] (B. Shao).
https://doi.org/10.1016/j.ijinfomgt.2022.102535
Received 27 May 2021; Received in revised form 26 May 2022; Accepted 27 May 2022
Available online 13 June 2022
0268-4012/© 2023 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-
nc-nd/4.0/).
X. Wang et International Journal of Information Management 66 (2022)
2
X. Wang et International Journal of Information Management 66 (2022)
organizational agility can be conceptualized in four dimensions:
culture,
3
X. Wang et International Journal of Information Management 66 (2022)
Table 1
Summary of the chatbot literature.
Study Method Context Independent variable Dependent Variables Summary
variable measuring
chatbot use
Adam, Wessel, EXperiment Online banking Anthropomorphic design cues; User compliance Anthropomorphism (identity,
and Benlian
(2020) foot-in-the-door technique small talk, and empathy) and
the need to stay consistent
Ashfaq, Yun, Yu, increase compliance.
and Loureiro Survey Information quality; service Satisfaction; The need for interaction
(2020) quality; perceived enjoyment; continuance moderates the relationships
perceived usefulness; perceived intention between perceived ease of use
ease of use and perceived usefulness and
satisfaction.
Chung et al. Survey E-service agents for luXury Interaction; entertainment; Satisfaction Service agents’ marketing
(2020) brands trendiness; customization, efforts can increase customers’
problem solving satisfaction via accuracy and
credibility.
Etemad-Sajadi Survey Airline carrier; travel Utilitarian and hedonic value E-service quality Utilitarian values influence
and Ghachem agency; nine dimensions of e-service
(2015) telecommunications; rail quality, whereas hedonic
transport; furniture values influence five
retailing; health insurance dimensions of e-service
quality.
Jain, Kumar, Interview; Eight chatbots were
Kota, and Patel second-hand evaluated.
(2018) data
Lalicic and Survey values; reasons for/against value co- Chatbot use intention can be
Weismayer chatbot creation; explained by four different
(2021) behavioral combinations.
intention
McLean and Survey Mobile services Website aesthetics; perceived Use of chatbot Three items Eight variables (e.g., website
Osei-Frimpong customization; perceived ease of measuring the aesthetics, perceived
(2019) use; perceived usefulness; use of chatbot customization) motivate
perceived information quality; chatbot use.
perceived web credibility;
perceived timeliness;
dissatisfaction with experience
Pizzi, Scarpi, and EXperiment Mobile services; car rental Assistant type/initiation Choice Anthropomorphic chatbots
Pantano (2021) can reduce reactance, but also
reduce satisfaction.
Rese et al. (2020) Survey Clothing company Behavioral A technology acceptance
intention model was compared with the
use and gratification theory to
predict chatbot acceptance.
Roy and Naidoo EXperiment Hotel; smartphone; clothing Conversation style Attitude toward Consumers can have positive
(2021) company brand; purchase attitudes and higher purchase
intention intentions when their time
orientations match their
conversation type.
Schuetzler, EXperiment Conversational skills Social presence; Chatbots with high
Grimes, and perceived conversational skills can lead
Scott Giboney humanness; to higher social presence and
(2020) partner anthropomorphism.
engagement
Shumanov and EXperiment Mobile services Consumer-chatbot personality Chatbot Chatbot Congruence between
Johnson (2021) engagement; engagement consumer and chatbot
purchasing (the average personality increases
behavior interaction consumer engagement and
duration) purchasing behaviors.
4
X. Wang et International Journal of Information Management 66 (2022)
engage in sensing business environmental changes and in formulating
responses. The use of advanced IT tools can enhance business agility
because they provide companies and organizations with new ways of
increasing agility (e.g., Akhtar et al., 2018; Lu & Ramamurthy,
2011).
The DCV is a useful theoretical lens through which to understand
the business agility created by IT, which can emerge in the form of
dynamic capabilities (e.g.,Gupta & Meissonier, 2020). It suggests that
“firms whose managers have superior dynamic managerial
capabilities can adapt and change more successfully than firms whose
managers have less effective or no dynamic managerial capabilities”
(Helfat & Martin, 2015, p. 1304). More specifically, dynamic
capabilities include firms’ abilities to identify and seize opportunities,
and they comprise three main clusters: identifying and developing
technological opportunities in response to customer needs (i.e.,
sensing), mobilizing resources to deal
5
X. Wang et International Journal of Information Management 66 (2022)
with these needs (i.e., seizing), and continual renewal (i.e., trans- 2020). Chatbots can also help achieve business agility through
forming) (Teece et al., 2016). Prior studies have demonstrated that IT external sourcing. Chatbots
can play a bridging role in developing dynamic capabilities by con-
necting organizational resources and operational business functions (e.
g., Duan, Faker, Fesak, & Stuart, 2013; Gupta, Drave et al., 2020; Zhang,
Qu, Ho, & Huang, 2011).
Therefore, sensing, seizing, and transforming are essential to
achieving agility (Teece et al., 2016), which is created by IT from a DCV
perspective. Sensing involves proactively developing new solutions
based upon customer needs and evaluating the effectiveness of these
solutions (e.g., scenario planning). Seizing deals with selecting appro-
priate solutions and implementing these solutions (e.g., developing
“slack,” re-engineering structures). Transforming includes iterative
improvement through trialing, launching, and learning. When firms
have dynamic capabilities that have emerged from IT, they can modify
organizational resources to respond to customer needs and market
changes, thereby achieving agility (Teece et al., 2016).
In addition, based on the DCV, the literature has argued that dynamic
capabilities can have internal and external sourcing and that both in-
ternal and external capabilities can strengthen relationships with cus-
tomers (e.g., Akhtar et al., 2018; Lokshin et al., 2008). In a recent
study, Chuang (2020) categorized social media agility as either
internal or external agility. Internal agility refers to firms’ flexibility in
dealing with customers’ demands in their day-to-day operations (i.e.,
internal sourcing). EXternal agility refers to firms’ flexibility in
responding to customers’ requirements stemming from external
information sources, links, and collaborative relationships (i.e.,
external sourcing).
In the digital age, AI can increase companies’ flexibility and ability to
respond to changes in the competitive business environment by under-
pinning such important business functions, such as automating business
processes, gaining insight through data analysis, and engaging with
customers and employees (Davenport & Ronanki, 2018). Chatbots
have been increasingly used by companies to support customer service.
They can effectively connect companies with their customers and
improve customer service through various technical features, such as
seamless live communication and 24/7 customer service (Ameen,
Tarhini, Reppel, & Anand, 2021; Huang & Rust, 2018; Hui, Fong, &
Jha, 2001). As such, chatbots enable companies to answer customers’
questions and address their problems more efficiently. Companies
using chatbots can also understand their customers better, identify
customer demands, and identify changes in targeted marketing based
on interaction with their customers. As such, they can better fulfill
customer needs, react to changes more efficiently and effectively, and
increase business agility. Therefore, it is clear that the merging of
chatbots and business opera- tions has created a new way for
companies to achieve the agility to respond to both internal
customer demand and external marketing changes, which we name
chatbot-enabled agility.
Following Chuang (2020), we developed the concept of chatbot-
enabled agility as one that has two dimensions: internal and external.
Internal chatbot agility refers to the flexibility of companies enabled by
chatbots to respond to customer demand by optimizing the delivery
and offering of products and services and by resolving cus- tomers’
questions efficiently and effectively. Specifically, chatbots can help
achieve business agility through internal sourcing. Chatbots can
analyze customer data via AI algorithms (e.g., machine learning) and
understand how to address customers’ questions (i.e., sensing). These
solutions can then be implemented in chatbots to better serve
customers (i.e., seizing). Last, such a process is interactive, and
chatbots can improve their performance through ongoing learning
from their in- teractions with customers (i.e., transforming). Thus,
chatbots can help businesses achieve sensing, seizing, and transformation
through internal sourcing and enabling of agility (Teece et al., 2016).
EXternal chatbot agility refers to the flexibility of companies
enabled by chatbots to respond to market changes efficiently and
effectively and to identify new marketing opportunities (Chuang,
6
X. Wang et International Journal of Information Management 66 (2022)
can analyze market trends and changes from external sources via AI information
algorithms (e.g., machine learning) and develop their estimations of
different markets (i.e., sensing). These estimations can then be inte-
grated into chatbots to better understand customers and provide
improved services (i.e., seizing). Last, given that the market keeps
changing, such a process is interactive, and chatbots can help firms
continuously adapt to the changing market (i.e., transforming). Thus,
chatbots can also help achieve sensing, seizing, and transforming via
external sourcing and achievement of agility (Teece et al., 2016).
Applying this distinction thus follows the literature, which posits
that agility can be captured as either internal or external (Da Silveira,
Borenstein, & Fogliatto, 2001; Huo, Gu, & Wang, 2018). One can
define agility using two orientations: companies’ ability to quickly
address customer needs or to address market change. Internal agility
addresses customers’ needs via internal business processes, focusing
on issues related to a company’s products and services as well as the
customers’ requirements. EXternal agility identifies and responds to
dynamics in the external business environment (e.g., the market).
7
X. Wang et International Journal of Information Management 66 (2022)
with web pages and tutorials, and to collect feedback from customers.
Chatbots can also be trained to better answer routine questions. Mar- product and service delivery (Pizzi et al., 2021). Without a doubt,
keting employees can participate in innovative use as well. For chatbot-supported internal agility will allow companies to
example, they can analyze conversational data with new methods to communicate with customers clearly and methodically and to decrease
help identify additional marketing opportunities. Employees can also the difficulty of maintaining relationships with customers. Therefore,
ask new ques- tions when interacting with customers. The conversational we hypothesized the following:
data can then be used to train chatbots so they can deal with new types
H1. : Internal chatbot agility is positively related to customer service
of questions or answer questions in new ways, based on specific
performance.
contexts.
Firms can engage in both routine and innovative use of chatbots. Moreover, we argue that increased external agility, enabled by
They can integrate chatbots into routine business operations while also chatbots, can also improve customer service performance. The market
discovering new approaches to obtain additional benefits from is dynamic—especially in the digital era—and companies must present
chatbots. Whether a certain way to use chatbots is innovative depends correct and timely responses to market changes to remain competitive
on the specific context. Specifically, when a certain usage approach to (Weber & Tarba, 2014). EXpected market changes include but are not
chatbots has not been routinized at a certain point in time, it is limited to factors such as consumer demand, market capacity, industry
considered innovative use and is consistent with operationalizations of inventory, competitor pricing, product quality, financing, interest
routine and innovative use in the existing literature (Li et al., 2013). It rates, asset prices, the employment rate, and national and regional
is possible that certain approaches to innovative use may become political stability. Through interactions with customers, chatbots can
routinized later and become routine use. collect a large volume of data. Data analysis can improve
understanding of customer profiles and needs and thus improve
3. Research model and hypotheses development understanding of targeted marketing (Pizzi et al., 2021). Specifically,
chatbots rely on AI algo- rithms such as machine learning, which can
Our model appears in Fig. 1. Based on the literature, we argue that be trained to monitor market changes (Phansalkar, Kamat, Ahirrao, &
marketing employees can engage in both routine and innovative use of Pawar, 2019). As such, chatbots can help companies monitor market
chatbots. These two types of use can enhance both internal and dynamics and respond to their changes (Chuang, 2020). We also
external chatbot agility, which ultimately will enhance customer anticipate the appearance of new business models, taxes, and
service per- formance. In the following text, we will describe each regulations—as well as a change in inflation rates. If a company is
hypothesis in more detail. involved in the international market, external agility will also help it to
withstand the fluctuation of exchange rates. Therefore, we proposed
3.1. The effect of agility on customer service performance the following hypothesis:
H2. : EXternal chatbot agility is positively related to customer service
Previous studies have shown a significant positive correlation be- performance.
tween business agility and performance (Queiroz, Tallon, Sharma, &
Coltman, 2018; Tallon & Pinsonneault, 2011). Based on the DCV,
recent studies have demonstrated that dynamic capabilities, which 3.2. The effect of routine use on agility
agility re- lies on, can improve various business outcomes, such as
economic per- formance, to sustain the business (e.g., Gupta & It is understood that a particular type of IT use is likely to be asso-
Meissonier, 2020; Helfat & Martin, 2015). Accordingly, we argue that ciated with individuals’ perceptions of outcomes resulting from the use
increased internal agility enabled by chatbots in organizations can (e.g., Bae, 2017). For example, Chuang (2020) showed that social-
boost customer service per- formance. AI-enabled chatbots can use information process capability of social media can positively affect
various algorithms (e.g., natural language processing) and understand users’ perceptions of social media agility. Social-information process
how to interact with customers (Mikalef & Gupta, 2021). Therefore, capability can be considered a specific type of social media use, which
this growth in internal agility, enabled by chatbots, allows a business’s increases the agility created by social media. Business agility has been
daily operations to adjust to handle revisions in customer demands referred to as a business’s ability “to sense and respond rapidly to
(Chuang, 2020). For example, chatbots can capture customers’ feedback unpredictable events in order to satisfy changing customer demands”
more quickly, in turn allowing the research and development (Holmqvist & Pessi, 2006, p. 146). It thus deals with firms’ capabilities
department to redesign products to meet updated requirements more to adapt to a changing environment driven by factors such as changing
quickly. customer preferences and target markets (Overby et al., 2006). As pre-
With the help of chatbots, the marketing department will be able to viously discussed, internal agility can capture the capabilities of com-
determine the best times to offer promotions. Furthermore, through panies to deal with customers by optimizing internal business processes.
analysis of data from chatbots, companies can streamline the sensing In our study, we argue that routine use of chatbots can increase
and reflection of customer needs to enhance product and customer internal agility. As previously discussed, routine use refers to the
service quality (Pizzi et al., 2021). The aforementioned rise in adapt- integration of chatbots into a firm’s standardized marketing process
ability to customer demands will also facilitate a more efficient system of (Li et al., 2013). Based on the DCV, routines are important to
support dynamic
8
X. Wang et International Journal of Information Management 66 (2022)
Fig. 1. Research model.
9
X. Wang et International Journal of Information Management 66 (2022)
1
X. Wang et International Journal of Information Management 66 (2022)
customer data chatbots collect. These new approaches of using
chatbots can help
1
X. Wang et International Journal of Information Management 66 (2022)
4.2. Measures We used SmartPLS 3.2.8, which offers the bootstrap resampling
method (using 5000 samples), to test our model. Our measures were not
Our measures were adapted from prior literature (see Appendi X A). normally distributed (i.e., Shapiro–Wilk tests were significant).
This study used 7-point Likert scales, with anchor 1 indicating Following Hair, Hult, Ringle, and Sarstedt (2016), it is appropriate to
“strongly disagree” and anchor 7 indicating “strongly agree.” We analyze unusually distributed data with PLS. Further, PLS focuses on
measured customer service performance using items modified from predicting and maximizing explained variance (Henseler, Ringle, &
Chuang (2020) and Setia, Setia, Venkatesh, and Joglekar (2013). In Sarstedt, 2015), consistent with our aim of predicting customer service
particular, Setia
et al. (2013) used items such as “retaining existing customers” and
“attracting new customers” to measure customer service performance. These items reflect a firm’s strengthened relationships with customers
1
X. Wang et International Journal of Information Management 66 (2022)
2
We thank one reviewer for providing very helpful comment regarding the
measures of customer service performance.
1
X. Wang et International Journal of Information Management 66 (2022)
1
X. Wang et International Journal of Information Management 66 (2022)
approaches to the use of chatbots, we divided our sample into two
3.3. Our analyses revealed that the VIFs for
CSP2 5.41 subsamples based on firm size. This post-hoc analysis provided further
1.23
routine and innovative use were both 1.74, and
insights for our research aims and helped us understand whether the
0.94 the VIFs for internal and external chatbot agility
strengths of the relationships presented in our model differed across
were both 2.86. All of these values were below
firm sizes. Seven participants did not report their firm sizes and were
3.3. Therefore, CMB seemed unlikely to be a
dropped from this analysis. According to one study (Dilger, 2017),
concern and unlikely to influence the research
firms with fewer than 500 employees are typically considered small-to-
results of this study.
medium firms. Therefore, we chose to divide our sample into small-to-
medium firms with fewer than 500 employees and large firms with 500
4.3.4. Post-hoc analysis
or more employees. We reran our model and compared the path
Because firms of different sizes may have
coefficients between two subsamples following Keil et al. (2000), using
different business processes and different
the following formula to calculate the t-value and evaluate the
1
X. Wang et International Journal of Information Management 66 (2022)
Table 5
The mediating effect of internal and external agility. Table 6
Post-hoc analysis (small-to-medium versus large firms).
Independent
Mediator Dependent Bootstrap analysis Hypothesis Small-to- Large Firms T-value Diff.
variable
variable Medium Firms (N = 177) Sig.?
Indirect Percentile
effect (N = 110)
confidence
H1: Internal chatbot 0.18 0.24** — 4.58 < ** *
Lower Upper
agility → Customer
Routine use of Internal Customer 0.08 —0.01 0.18 service performance
chatbots chatbot service H2: EXternal chatbot 0.67*** 0.61*** 5.33 > ** *
agility performance agility → Customer
EXternal 0.34 0.23 0.46 service performance
chatbot H3a: Routine use of 0.37*** 0.17* 18.51 > ** *
agility chatbots → Internal
Total 0.42 0.32 0.53 chatbot agility
Innovative use Internal Customer 0.10 0.01 0.23 H3b: Routine use of 0.37** 0.17* 17.38 > ** *
of chatbots chatbot service chatbots → EXternal
agility performance chatbot agility
EXternal 0.40 0.27 0.54 H4a: Innovative use of 0.41*** 0.58*** — 16.88 < ** *
chatbot chatbots → Internal
agility chatbot agility
Total 0.50 0.37 0.65 H4b: Innovative use of 0.41** 0.58*** — 14.95 < ** *
chatbots → EXternal
chatbot agility
significance levels of the differences:
*p < 0.05, **p < 0.01, ***p < 0.001, Diff. Sig. = different significantly.
t[ =
Path coefficientGroup1 — Path coefficentGroup2
] [ ]
√̅̅(̅m̅—̅̅̅1̅)̅2̅̅̅ ̅̅̅̅ ̅̅̅ ̅̅̅2̅̅̅̅̅̅̅̅̅̅̅ ̅̅̅̅̅̅(̅n̅—̅1̅)̅2̅̅̅̅ ̅̅̅̅̅ ̅̅̅ ̅̅̅2̅̅̅̅̅̅̅̅̅ √̅ ̅̅̅ ̅̅̅̅̅ ̅
1 1 m Chatbots share some counterwork. For example, they provide customers
×SE + (m+n—×SE ×
Group2 + n
with precise andcost
personalized
(m+n—
2)
Group1
2)
saves the labor of the callconsulting
center butservices, which
also makes usenot only greatly
of autonomous
where SEGroupi is the standard error of path in the structural model of interpretation.
group i, m is the sample size of Group 1 and n is the sample size of Group Two respondents remarked:
2. In the existing literature, this approach has been demonstrated as a
valid technique for testing subsample differences (e.g., Chiu, Wang,
Fang, & Huang, 2014; Lin & Wang, 2020; Zhang, Ma, Xu, & Xu, 2019).
The results (Table 6) show that all hypotheses were still significant
except for H1 for small-to-medium firms. Internal chatbot agility had a
stronger effect on customer service performance for large firms, whereas
external chatbot agility had a greater effect on small-to-medium firms.
Routine use of chatbots produced stronger effects on internal/external
chatbot agility for small-to-medium firms, whereas innovative use of
chatbots had greater effects on large firms. These research findings
offered some interesting insights into the use of chatbots and the impacts
across firms of different sizes. Nevertheless, the effects of routine and
innovative use on internal and external agility were significantly
different when comparing small-to-medium firms and large firms.
Future studies could further examine these differences.
1
X. learning
Wang et technology to analyze users’ preferences and habits, actively seek International Journal of Information Management 66 (2022)
and identify potential needs, and improve user engagement and conver-
sion rate.
The data provided by Chatbot will also be used as an aspect of the
company’s business reference. Managers will need this data to do
business scheduling analysis through the data.
The responses indicate that routine business processes
incorporate chatbots (i.e., routine use of chatbots, as defined in the
Section 2.3 Routine Versus Innovative Use), which can enhance
business agility. Respondents also highlighted the role of the
innovative use of chatbots in creating agility. For example, one
participant highlighted the following:
Compared with the traditional marketing methods, we can understand
the users’ feedback through the data and call recording after natural lan-
guage processing and constantly optimize the marketing scheme, which
is very good.
This response further confirms that data collected by chatbots can
be analyzed by advanced methods to help identify new marketing
oppor- tunities (i.e., innovative use of chatbots as defined in the
Routine Versus Innovative Use section).
Regarding the impacts of agility on customer service performance,
one participant stated the following:
1
X. Wang et International Journal of Information Management 66 (2022)
For mobile banking and credit-card-exclusive software, it not only could The effect of routine use is stronger for small-to-medium firms than large
do the company’s business but also bring it to more areas that can be
consumed with the chat robot, increasing customer experience, cohesion,
and loyalty.
Another participant also highlighted the following:
In the initial stage of product promotion, users can be effectively main-
tained, the retention rate of users can be improved, and the experience of
users can be improved.
These responses helped to explain the important role of chatbots in
improving customer service performance. In summary, the responses
highlighted how the use of chatbots can improve firms’ flexibility (i.e.,
enhance agility) in responding to customers’ requirements and to mar-
keting changes, which would, in turn, improve customer service
performance.
5. Discussion
1
X. Wang et International Journal of Information Management 66 (2022)
firms, whereas the effect of innovative use is greater for large firms chatbots in reaping business benefits (i.e., business agility) as well as
than for small-to-medium firms. It is possible that the business the role of
processes of small-to-medium firms are simpler due to having few
resources; there- fore, there are not many options for chatbots to
integrate into these businesses. In contrast, larger firms have more
complex business pro- cesses and can implement innovative ways to
use chatbots. Because our analysis was exploratory, future studies are
needed to further examine how firms of different sizes adopt
chatbots.
Last, our results reveal that internal and external agility can ulti-
mately improve customer service performance. This is consistent with
the findings of Chuang (2020), who reported that social media agility
is positively related to the strength of customer–firm relationships.
Customer service is a primary element in business sustainability (Huang,
Niu, & Pan, 2021). Our study provides further insights into how
customer service can be enhanced by digitally enabled agility created
by emerging AI tools. Our research results support this relationship
be- tween agility and customer service based on data collected from
mar- keting employees who are knowledgeable about customer
service. Our post-hoc analysis further showed that internal chatbot
agility has a stronger effect on customer service performance for large
firms than for small-to-medium firms, whereas external chatbot
agility has a greater effect on small-to-medium firms than on large
firms. Small-to-medium firms, which have fewer resources, become
more vulnerable to market changes, so increased external agility
would greatly improve their ability to respond to market changes and
serve customers. On the other hand, larger firms usually follow
standardized procedures to deal with customers, so internal agility,
which better supports these standardized procedures, would
tremendously enhance customer services for large firms. Our findings
entail important theoretical and practical implica- tions, which are
presented below.
1
X. Wang et International Journal of Information Management 66 (2022)
Chatbots have been increasingly used to support customer service. Xuequn Wang: Conceptualization, Methodology, Investigation,
This study aimed to examine how chatbot-enabled agility improved Formal analysis, Writing— original draft, Writing review & editing,
customer service performance and to explore the antecedents of chatbot- Xiaolin Lin: Conceptualization, Methodology, Investigation, Formal
analysis, Writing — original draft, Writing — review & editing, Bin Shao:
Conceptualization, Writing — original draft, Writing — review &
editing.
Appendix A. Measures
1
X. Wang et International Journal of Information Management 66 (2022)
Table B.1
Loadings and cross-loading. Coombs, C. (2020). Will COVID-19 be the tipping point for the intelligent automation of
work? A review of the debate and implications for research. International Journal
Routine Innovative Internal EXternal Customer of Information Management, 55, Article 102182.
Use of Use of Chatbot Chatbot Service Cooper, R. B., & Zmud, R. W. (1990). Information technology implementation research: a
Chatbots Chatbots Agility Agility Performance technological diffusion approach. Management Science, 36(2), 123–139.
Da Silveira, G., Borenstein, D., & Fogliatto, F. S. (2001). Mass customization: Literature
RTN1 0.89 0.54 0.49 0.50 0.53
review and research directions. International Journal of Production Economics, 72(1), 1–
RTN2 0.89 0.62 0.53 0.51 0.51
13.
RTN3 0.91 0.58 0.53 0.52 0.56
Davenport, T. H., & Ronanki, R. (2018). Artificial intelligence for the real world. Harvard
INV1 0.59 0.90 0.61 0.61 0.61 Business Review, 96(1), 108–116.
INV2 0.57 0.89 0.59 0.60 0.56 Dilger, R. J. (2017). Small Business Size Standards: A Historical Analysis of
INV3 0.56 0.86 0.60 0.59 0.54 Contemporary Issues. Congressional Research Service, July, 21, 7–5700.
IA1 0.52 0.63 0.89 0.73 0.68 Duan, J., Faker, P., Fesak, A., & Stuart, T. (2013). Benefits and drawbacks of cloud-based
IA2 0.52 0.58 0.86 0.67 0.60 versus traditional ERP systems. Proceedings of the 2012–13 course on Advanced
IA3 0.48 0.60 0.87 0.72 0.61 Resource Planning.
IA4 0.49 0.57 0.88 0.70 0.63 Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019). Artificial intelligence for decision
EA1 0.50 0.58 0.70 0.88 0.70 making in the era of Big Data–evolution, challenges and research agenda.
EA2 0.52 0.55 0.74 0.89 0.72 International Journal of Information Management, 48, 63–71.
EA3 0.47 0.59 0.68 0.86 0.70 Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., &
Williams, M. D. (2021). Artificial Intelligence (AI): Multidisciplinary perspectives on
EA4 0.51 0.66 0.72 0.89 0.72
emerging challenges, opportunities, and agenda for research, practice and policy.
CSP1 0.54 0.60 0.70 0.76 0.94
International Journal of Information Management, 57, Article 101994.
CSP2 0.57 0.61 0.65 0.76 0.94 https://doi.org/ 10.1016/j.ijinfomgt.2019.08.002
Etemad-Sajadi, R., & Ghachem, L. (2015). The impact of hedonic and utilitarian value of
online avatars on e-service quality. Computers in Human Behavior, 52, 81–86.
Gao, P., Zhang, J., Gong, Y., & Li, H. (2020). Effects of technical IT capabilities on
organizational agility: The moderating role of IT business spanning capability.
Table B.2 Industrial Management & Data Systems, 120(5), 941–961.
Heterotrait-monotrait ratio of correlations. Gupta, S., Drave, V. A., Dwivedi, Y. K., Baabdullah, A. M., & Ismagilova, E. (2020a).
Achieving superior organizational performance via big data predictive analytics: A
1 2 3 4 5 dynamic capability view. Industrial Marketing Management, 90, 581–592.
Gupta, S., Meissonier, R., Drave, V. A., & Roubaud, D. (2020b). EXamining the impact of
1 Routine use of chatbots
Cloud ERP on sustainable performance: A dynamic capability view. International
2 Innovative use of chatbots 0.75
Journal of Information Management, 51, Article 102028.
3 Internal agility 0.65 0.77 Gursoy, D., Chi, O. H., Lu, L., & Nunkoo, R. (2019). Consumers acceptance of artificially
4 EXternal agility 0.64 0.77 0.88 intelligent (AI) device use in service delivery. International Journal of Information
5 Customer service performance 0.61 0.66 0.69 0.88 Management, 49, 157–169.
Hair, J. F., Jr., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2016). A Primer on Partial Least
Squares Structural Equation Modeling (PLS-SEM). Sage Publications,.
References Hayes, A. F. (2017). Introduction to Mediation, Moderation, and Conditional Process
Analysis: A Regression-based Approach. Guilford Publications,.
He, W., Zhang, Z. J., & Li, W. (2021). Information technology solutions, challenges, and
Adam, M., Wessel, M., & Benlian, A. (2020). AI-based chatbots in customer service and
suggestions for tackling the COVID-19 pandemic. International Journal of Information
their effects on user compliance. Electronic Markets, 1–19.
Management, 57, Article 102287.
Akhtar, P., Khan, Z., Tarba, S., & Jayawickrama, U. (2018). The Internet of Things,
Helfat, C. E., & Martin, J. A. (2015). Dynamic managerial capabilities: Review and
dynamic data and information processing capabilities, and operational agility.
assessment of managerial impact on strategic change. Journal of Management, 41(5),
Technological Forecasting and Social Change, 136, 307–316.
1281–1312.
Altschuller, S., Gelb, D. S., & Henry, T. F. (2010). IT as a resource for competitive agility:
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing
an analysis of firm performance during industry turbulence. Journal of International
discriminant validity in variance-based structural equation modeling. Journal of the
Technology and Information Management, 19(1), 39–59.
Academy of Marketing Science, 43(1), 115–135.
Ameen, N., Tarhini, A., Reppel, A., & Anand, A. (2021). Customer experiences in the age
Holmqvist, M., & Pessi, K. (2006). Agility through scenario development and continuous
of artificial intelligence. Computers in Human Behavior, 114, Article 106548.
implementation: a global aftermarket logistics case. European Journal of Information
https:// doi.org/10.1016/j.chb.2020.106548
Systems, 15(2), 146–158.
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020). I, Chatbot: Modeling the
Hong, W., Chan, F. K., Thong, J. Y., Chasalow, L. C., & Dhillon, G. (2014). A framework
determinants of users’ satisfaction and continuance intention of AI-powered service
and guidelines for context-specific theorizing in information systems research.
agents. Telematics and Informatics, 54, Article 101473. https://doi.org/10.1016/j.
Information Systems Research, 25(1), 111–136.
tele.2020.101473
Hu, Q., Lu, Y., Pan, Z., Gong, Y., & Yang, Z. (2021). Can AI artifacts influence human
Ashrafi, A., Ravasan, A. Z., Trkman, P., & Afshari, S. (2019). The role of business
cognition? The effects of artificial autonomy in intelligent personal assistants.
analytics capabilities in bolstering firms’ agility and performance. International
International Journal of Information Management, 56, Article 102250.
Journal of Information Management, 47, 1–15.
Huang, M.-H., & Rust, R. T. (2018). Artificial intelligence in service. Journal of Service
Bae, S.-M. (2017). The relationship between the type of smartphone use and smartphone
Research, 21(2), 155–172.
dependence of Korean adolescents: National survey study. Children and Youth
Huang, P.-Y., Niu, B., & Pan, S. L. (2021). Platform-based customer agility: An integrated
Services Review, 81, 207–211.
framework of information management structure, capability, and culture.
Benner, M. J., & Tushman, M. (2002). Process management and technological
International Journal of Information Management, 59. https://doi.org/10.1016/j.
innovation: A longitudinal study of the photography and paint industries.
ijinfomgt.2021.102346
Administrative Science Quarterly, 47(4), 676–707.
Hui, S. C., Fong, A., & Jha, G. (2001). A web-based intelligent fault diagnosis system for
Borges, A. F., Laurindo, F. J., Spínola, M. M., Gonçalves, R. F., & Mattos, C. A. (2020).
customer service support. Engineering Applications of Artificial Intelligence, 14(4), 537–
The strategic use of artificial intelligence in the digital era: Systematic literature
548.
review and future research directions. International Journal of Information
Huo, B., Gu, M., & Wang, Z. (2018). Supply chain flexibility concepts, dimensions and
Management, 57, Article 102225. https://doi.org/10.1016/j.ijinfomgt.2020.102225
outcomes: an organisational capability perspective. International Journal of
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research. Guilford
Production Research, 56(17), 5883–5903.
Publications,.
Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018). Evaluating and informing the design of
Chiu, C., Wang, E., Fang, Y., & Huang, H. (2014). Understanding customers’ repeat
chatbots. Paper presented at the Proceedings of the 2018 Designing Interactive
purchase intentions in B2C e-commerce: the roles of utilitarian value, hedonic value
Systems Conference.
and perceived risk. Information Systems Journal, 24(1), 85–114.
Jasperson, J. S., Carter, P. E., & Zmud, R. W. (2005). A comprehensive conceptualization
Chiu, M.-C., & Chuang, K.-H. (2021). Applying transfer learning to achieve precision
of post-adoptive behaviors associated with information technology enabled work
marketing in an omni-channel system–a case study of a sharing kitchen platform.
systems. MIS Quarterly, 29(3), 525–557.
International Journal of Production Research, 1–16.
Jero´nimo, H. M., Henriques, P. L., de Lacerda, T. C., da Silva, F. P., & Vieira, P. R. (2020).
Chuang, S.-H. (2020). Co-creating social media agility to build strong customer-firm
Going green and sustainable: The influence of green HR practices on the
relationships. Industrial Marketing Management, 84, 202–211.
organizational rationale for sustainability. Journal of Business Research, 112,
Chung, M., Ko, E., Joung, H., & Kim, S. J. (2020). Chatbot e-service and customer
413–421.
satisfaction regarding luXury brands. Journal of Business Research, 117, 587–595.
Kappelman, L., Torres, R., McLean, E., Maurer, C., Johnson, V., & Kim, K. (2019). The
Claessen, V., Schmidt, A., & Heck, T. (2017). Virtual Assistants-A Study on the Usability
and User Perception of Customer Service Systems for E-Commerce. Paper presented 2018 SIM IT issues and trends study. MIS Quarterly Executive, 18(1), 7.
at the ISI. Karahanna, E., Xu, S. X., Xu, Y., & Zhang, N. A. (2018). The needs–affordances–features
perspective for the use of social media. MIS Quarterly, 42(3), 737–756.
1
X. Wang et International Journal of Information Management 66 (2022)
Keil, M., Tan, B. C., Wei, K.-K., Saarinen, T., Tuunainen, V., & Wassenaar, A. (2000). Roy, R., & Naidoo, V. (2021). Enhancing chatbot effectiveness: The role of
A cross-cultural study on escalation of commitment behavior in software projects. anthropomorphic conversational styles and time orientation. Journal of Business
MIS Quarterly, 299–325. Research, 126, 23–34.
Kock, N. (2015). Common method bias in PLS-SEM: A full collinearity assessment Sambamurthy, V., Bharadwaj, A., & Grover, V. (2003). Shaping agility through digital
approach. International Journal of e-Collaboration (ijec), 11(4), 1–10. options: Reconceptualizing the role of information technology in contemporary
Lalicic, L., & Weismayer, C. (2021). Consumers’ reasons and perceived value co-creation firms. MIS Quarterly, 27(2), 237–263.
of using artificial intelligence-enabled travel service agents. Journal of Business Schuetzler, R. M., Grimes, G. M., & Scott Giboney, J. (2020). The impact of chatbot
Research, 129, 891–901. conversational skill on engagement and perceived humanness. Journal of
Lee, M. T., & Raschke, R. L. (2020). Innovative sustainability and stakeholders’ shared Management Information Systems, 37(3), 875–900.
understanding: The secret sauce to “performance with a purpose”. Journal of Business Setia, P., Setia, P., Venkatesh, V., & Joglekar, S. (2013). Leveraging digital technologies:
Research, 108, 20–28. How information quality leads to localized capabilities and customer service
Li, X., Hsieh, J. P.-A., & Rai, A. (2013). Motivational differences across post-acceptance performance. MIS Quarterly, 565–590.
information system usage behaviors: An investigation in the business intelligence Shumanov, M., & Johnson, L. (2021). Making conversations with chatbots more
systems context. Information Systems Research, 24(3), 659–682. personalized. Computers in Human Behavior, 117, Article 106627. https://doi.org/
Liang, H., Saraf, N., Hu, Q., & Xue, Y. (2007). Assimilation of Enterprise Systems: The 10.1016/j.chb.2020.106627
Effect of Institutional Pressures and the Mediating Role of Top Management. MIS Sipior, J. C. (2020). Considerations for development and use of AI in response to COVID-
Quarterly, 31(1), 59–87. 19. International Journal of Information Management, 55, Article 102170.
Lin, X., & Wang, X. (2020). EXamining gender differences in people’s information- Tallon, P. P., & Pinsonneault, A. (2011). Competing perspectives on the link between
sharing decisions on social networking sites. International Journal of Information strategic information technology alignment and organizational agility: insights from
Management, 50, 45–56. a mediation model. MIS Quarterly, 35(2), 463–486.
Lokshin, B., Belderbos, R., & Carree, M. (2008). The productivity effects of internal and Tams, S., Thatcher, J. B., & Craig, K. (2018). How and why trust matters in post-adoptive
external R&D: Evidence from a dynamic panel data model. Oxford Bulletin of usage: The mediating roles of internal and external self-efficacy. The Journal of
Economics and Statistics, 70(3), 399–413. Strategic Information Systems, 27(2), 170–190.
Lu, Y., & Ramamurthy, K. (2011). Understanding the link between information Teece, D., Peteraf, M., & Leih, S. (2016). Dynamic capabilities and organizational agility:
technology capability and organizational agility: An empirical examination. MIS Risk, uncertainty, and strategy in the innovation economy. California Management
Quarterly, 931–954. Review, 58(4), 13–35.
Mathiassen, L., & Pries-Heje, J. (2006). Business agility and diffusion of information Teo, T. S., Srivastava, S. C., & Jiang, L. (2008). Trust and electronic government success:
technology. European Journal of Information Systems, 15(2), 116–119. An empirical study. Journal of Management Information Systems, 25(3), 99–132.
McLean, G., & Osei-Frimpong, K. (2019). Chat now… EXamining the variables Trischler, J., Johnson, M., & Kristensson, P. (2020). A service ecosystem perspective on
influencing the use of online live chat. Technological Forecasting and Social Change, the diffusion of sustainability-oriented user innovations. Journal of Business Research,
146, 55–67. 116, 552–560.
Mikalef, P., & Gupta, M. (2021). Artificial intelligence capability: Conceptualization, Venkatesh, V., Brown, S. A., Maruping, L. M., & Bala, H. (2008). Predicting different
measurement calibration, and empirical study on its impact on organizational conceptualizations of system use: the competing roles of behavioral intention,
creativity and firm performance. Information & Management, 58(3), Article 103434. facilitating conditions, and behavioral expectation. MIS Quarterly, 32(3), 483–502.
Mordor Intelligence, 2021, Chatbot market - growth, trends, COVID-19 impact, and Watson, H. J. (2019). Update tutorial: Big Data analytics: Concepts. Technology, and
forecasts (2021–2026). 〈 https://www.mordorintelligence.com/industry-reports/ Applications Communications of the Association for Information Systems, 44(1),
chatbot-market〉, Accessed on September 20, 2021. 364–379.
Nambisan, S., Agarwal, R., & Tanniru, M. (1999). Organizational mechanisms for Weber, Y., & Tarba, S. Y. (2014). Strategic agility: A state of the art introduction to the
enhancing user innovation in information technology. MIS Quarterly, 23(3), special section on strategic agility. California Management Review, 56(3), 5–12.
365–395. Williams, R., 2019, Study: Chatbots to drive $112B in retail sales by 2023. 〈https://www.
Ngai, E. W., Chau, D. C., & Chan, T. (2011). Information technology, operational, and mobilemarketer.com/news/study-chatbots-to-drive-112b-in-retail-sales-by-2023/
management competencies for supply chain agility: Findings from case studies. The 554416/ 〉, Accessed on May 24, 2021.
Journal of Strategic Information Systems, 20(3), 232–249. Zhang, X., Ma, L., Xu, B., & Xu, F. (2019). How social media usage affects employees’ job
Nishant, R., Kennedy, M., & Corbett, J. (2020). Artificial intelligence for sustainability: satisfaction and turnover intention: An empirical study in China. Information &
Challenges, opportunities, and a research agenda. International Journal of Information Management, 56(6), Article 103136. https://doi.org/10.1016/j.im.2018.12.004
Management, 53, Article 102104. Zhang, Y., Qu, T., Ho, O. K., & Huang, G. Q. (2011). Agent-based smart gateway for RFID-
Nold, H., Anzengrubcr, J., Woclfle, M., & Michel, L. (2018). Organizational agility- enabled real-time wireless manufacturing. International Journal of Production
testing, validity, and reliability of a diagnostic instrument. Journal of Organizational Research, 49(5), 1337–1352.
Psychology, 18(3), 104–117.
Overby, E., Bharadwaj, A., & Sambamurthy, V. (2006). Enterprise agility and the
Xuequn (Alex) Wang is a Senior Lecturer in Edith Cowan University. He received his Ph.
enabling role of information technology. European Journal of Information Systems, 15
D. in Information Systems from Washington State University. His research interests
(2), 120–131.
include social media, privacy, e-commerce, and human-computer interaction. His
Petter, S., DeLone, W., & McLean, E. R. (2012). The past, present, and future of “IS
research has appeared in MIS Quarterly, Information Systems Journal, Information &
success”. Journal of the Association for Information Systems, 13(5), 341–362.
Management, Communications of the ACM, ACM Transactions, and Communications of
Petter, S., Straub, D., & Rai, A. (2007). Specifying formative constructs in information
the Association for Information Systems, among others.
systems research. MIS Quarterly, 623–656.
Phansalkar, S., Kamat, P., Ahirrao, S., & Pawar, A. (2019). Decentralizing AI applications
with block chain. International Journal of Scientific & Technology Research, 8(9), 362– Xiaolin Lin is currently assistant professor of management information systems in the
370. college of business at California State University, Sacramento. Prior to that, he was an
Pizzi, G., Scarpi, D., & Pantano, E. (2021). Artificial intelligence and the new forms of assistant professor of computer information systems in the Paul and Virginia Engler Col-
interaction: Who has the control when interacting with a chatbot? Journal of Business lege of Business at West Texas A&M University. He received his Ph.D. in management
Research, 129, 878–890. information systems from Washington State University. His research focuses on the im-
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common plications of IT in e-commerce and healthcare, human-AI interaction, cyber security, and
method biases in behavioral research: a critical review of the literature and gender differences in IT behavioral research. He has published papers in premier journals
recommended remedies. Journal of Applied Psychology, 88(5), 879–903. such as Journal of Business Ethics, European journal of Information Systems, Decision
Queiroz, M., Tallon, P. P., Sharma, R., & Coltman, T. (2018). The role of IT application Sciences, Information & Management, International Journal of Electronic Commerce,
orchestration capability in improving agility and performance. The Journal of Journal of the Association for Information Science and Technology, and International
Strategic Information Systems, 27(1), 4–21. Journal of Information Management, among others. He has also presented numerous pa-
Rese, A., Ganster, L., & Baier, D. (2020). Chatbots in retailers’ customer communication: pers at international and national conferences.
How to measure their acceptance? Journal of Retailing and Consumer Services, 56,
Article 102176.
Bin Shao is a professor of decision management & Terry Professor of Business in the
Roberts, N., Campbell, D. E., & Vijayasarathy, L. R. (2016). Using information systems to
Department of Computer Information and Decision Management, Paul and Virginia
sense opportunities for innovation: Integrating postadoptive use behaviors with the
Engler College of Business, West Texas A&M University. She earned her Ph.D. from
dynamic managerial capability perspective. Journal of Management Information
University of Illinois at Urbana-Champaign. Her current research interests are mainly in
Systems, 33(1), 45–69.
the interdis- ciplinary areas of information systems, decision management, and
Rosenthal, R., & Rosnow, R. L. (2008). Essentials of Behavioral Research: Methods and Data
marketing. Her works have been published in International Advances in Economic
Analysis, 3rd ed. Boston: McGraw-Hill,.
Research, International Journal of Applied Management Science, Journal of Supply Chain
and Operations Man- agement, Journal of Management Information and Decision
Sciences, and many others.