Business Talk: Harnessing Generative AI With Data Analytics Maturity
Business Talk: Harnessing Generative AI With Data Analytics Maturity
Business Talk: Harnessing Generative AI With Data Analytics Maturity
7, December 2023
ABSTRACT
Generative AI applications offer transformative potential for business operations, yet their adoption
introduces substantial challenges. This paper utilizes the CBDAS data maturity model to pinpoint pivotal
success factors for seamless generative AI integration in businesses. Through a comprehensive analysis of
these factors, we underscore the essentials of generative AI deployment: cohesive architecture, robust data
governance, and a data-centric corporate ethos. The study also highlights the hurdles and facilitators
influencing its implementation. Key findings suggest that fostering a data-friendly culture, combined with
structured governance, optimizes generative AI adoption. The paper culminates in presenting the practical
implications of these insights, urging further exploration into the real-world efficacy of the proposed
recommendations.
KEYWORDS
Artificial Intelligence, Generative AI, Analytics, Maturity Model, Big Data
1. INTRODUCTION
Recent advancements in natural language processing (NLP) have resulted in a rapid development
and deployment of generative AI applications, including chatbots like ChatGPT and virtual
assistants, across various industries [1]. Literature highlights the potential of generative AI in
revolutionizing customer engagement, improving operational efficiency, and its role as a
decision-making tool in businesses [2]–[4]. Generative AI has been shown to significantly
enhance customer engagement by providing personalized and interactive experiences. Some
authors have demonstrated that generative AI enables organizations to establish stronger
connections with customers, enhance satisfaction levels, and build long-term relationships [3],
[5], [6]. By leveraging advanced natural language processing capabilities, generative AI systems
can engage customers in meaningful conversations, understand their preferences, and deliver
tailored solutions, resulting in higher levels of customer satisfaction and loyalty. Moreover, the
integration of generative AI systems has been found to drive improvements in operational
efficiency. Generative AI helps automating repetitive tasks, provides real-time information, and
streamlines operational processes [2], [4]. By doing so, organizations can reduce manual efforts,
minimize errors, and accelerate decision-making processes, leading to enhanced operational
efficiency and cost savings.
Generative AI also plays a vital role in business decision-making. Academic literature, including
studies by Catelluccio [7] and Davenport [4], emphasizes that AI, with its advanced analytics and
natural language processing capabilities, assists organizations in data-driven decision-making. By
Bibhu Dash et al: ISTECH, ITEORY, CSITAI -2023
pp. 01-10, 2023. IJCI – 2023 DOI:10.5121/ijci.2023.120701
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
analyzing vast amounts of data and extracting valuable insights, generative AI systems provide
organizations with recommendations and actionable intelligence to support strategic choices and
operational processes, ultimately leading to more informed and effective decision-making.
However, the adoption of generative AI poses certain challenges that need to be addressed. Some
authors highlight issues such as data privacy and security concerns, ethical considerations,
algorithmic bias, and the need for continuous monitoring and improvement to ensure optimal
performance and user satisfaction [8], [9]. Organizations must carefully navigate these challenges
to ensure responsible and ethical implementation of generative AI systems. Successful integration
of generative AI also requires organizational readiness and effective change management. Arrieta
et al. [10] and Castelluccio [7] emphasizes the importance of aligning generative AI initiatives
with overall business strategies, establishing appropriate governance structures, and fostering a
culture that embraces data-driven decision-making and innovation. Organizations need to
proactively address the organizational and cultural changes necessary to support the
implementation and ongoing management of generative AI systems.
Thus, the main question guiding this paper is: "What are the primary drivers and barriers to the
effectiveness of generative AI integration as a decision-making tool in companies?" To address
this question, we conduct a comprehensive review of the success factors for generative AI
integration in companies, by leveraging the Consensual Big Data Maturity Assessment System
(CBDAS) maturity model [11]. We introduce the CBDAS model and its application specifically
to generative AI, providing an overview of the key factors crucial for successful generative AI
integration in companies. Subsequently, we delve into each critical success factor in detail,
examining the specific requirements for implementing generative AI, identifying the inhibitors
and enhancers that influence its implementation, and discussing the actions that organizations can
undertake to ensure successful implementation. Through our analysis, we identify a well-
integrated architecture, robust data governance, and a data-friendly corporate culture as critical
factors for achieving successful generative AI implementation.
The structure of this paper is organized as follows. In the subsequent section, we present a
comprehensive literature review encompassing the CBDAS maturity model and generative AI
technologies. This review explores the current and potential applications of generative AI in the
business domain. Moving forward, Section three provides an overview of the critical success
factors for generative AI integration in companies. Section four further examines each critical
success factor, delving into the specific requirements, inhibitors, and enhancers for successful
implementation. Additionally, we propose actionable measures that organizations can take to
ensure success. Finally, in the concluding section, we discuss the implications of our findings for
practitioners, drawing on the insights provided by the aforementioned academic literature, and
offer concluding remarks and suggestions for future research.
2. LITERATURE REVIEW
2.1. The Consensual Big Data Assessment System
The CBDAS is a consensual framework [11] designed on a theoretical framework that outlines
the key success factors (CSFs) of data analytics [12], [13]. This framework encompasses the
factors and sub-domains, and the criteria of success of big data initiatives. The structure of the
CBDAS consists of two sections: the first section assesses the current maturity levels of
enterprises at various levels of granularity – from factor to subdomain level - while the second
section evaluates the relative importance of the CSFs for industry experts. The assessment system
is comprised of 59 questions, with 44 questions focusing on the maturity levels of the CSFs and
sub-domains and 15 questions addressing the underlying business needs. The results are obtained
2
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
through a standardized questionnaire with one closed-ended question per item and analyzed using
software such as Cognito, Zapier, and Google Sheets. The CBDAS is a quantitative method that
generates 156 potential outcomes based on the combination of sub-domain maturity levels and
their interdependencies. The second section of the questionnaire evaluates the importance of each
factor using the analytic hierarchy process (AHP) which evaluates individuals' and groups'
judgments and converts them into numerical values for objective comparison. The output of the
AHP is used as input to evaluate the relevance of each organizational area from the manager's
perspective, recognizing that the relevance of each factor may vary depending on context and
may not be applicable to all organizations.
2.2. Data Maturity Models: Evaluating the Drivers and Drainers of Generative AI
Integration
In recent years, the proliferation of generative AI applications has sparked recognition of their
transformative potential in revolutionizing business operations [3], [14], [15]. However, the
successful adoption and implementation of generative AI systems present significant challenges
for organizations [3], [4], [16], [17]. To address these challenges effectively, organizations need
to identify and analyze the critical success factors that influence the effectiveness of generative
AI as a decision-making tool [4], [8]. This is where data maturity models come into play.
Data maturity models, such as the Consensual Big Data Assessment System (CBDAS) maturity
model [11], provide a framework to assess and evaluate the maturity levels of organizations in
terms of their data capabilities [18]–[21]. By applying data maturity models like CBDAS,
organizations gain a comprehensive understanding of their strengths and weaknesses in relation
to generative AI integration [16], [22]. They can identify the drivers that contribute to successful
implementation, such as clear data strategies, well-integrated architectures, robust IT
infrastructure, user-friendly interfaces, skilled analytical workforces, collaborative organizational
structures, and data-driven corporate cultures. Simultaneously, organizations can uncover the
potential drainers, including inadequate data strategies, fragmented architectures, insufficient IT
infrastructure, complex interfaces, inadequate workforce competencies, siloed organizational
structures, and resistance to data-driven decision-making.
Understanding the drivers and drainers of generative AI integration through the lens of data
maturity models empowers organizations to make informed decisions and take strategic actions
[8], [14], [23]. It enables them to address the challenges effectively and leverage the drivers to
maximize the benefits of generative AI as a decision-making tool.
The CBDAS maturity model, as an example of a data maturity framework, outlines key success
factors (CSFs) that contribute to the effectiveness of data analytics initiatives, including
generative AI integration [24]. By utilizing the CBDAS model, organizations can assess the
maturity levels of various factors and sub-domains that are critical for the successful
implementation of generative AI. By soliciting expert opinions through a standardized
questionnaire, organizations can gain insights into the factors that industry experts consider
critical for achieving successful outcomes in generative AI integration. This assessment enables
organizations to align their efforts with expert opinions, ensuring they address the most impactful
drivers and mitigate potential drainers effectively.
Through the CBDAS questionnaire, organizations can collect data on a range of factors, such as
data strategy, integrated architecture, IT infrastructure, human data interface, analytical human
workforce, integrated organization, and data-friendly corporate culture [11]. Analyzing the
responses to these questions enables organizations to generate valuable insights about their data
3
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
maturity levels and the specific factors that drive or drain the effectiveness of generative AI
integration.
The current academic literature offers valuable insights into the applications of generative AI in
the business domain. Vaswani et al. [6] highlight how generative AI can revolutionize customer
engagement by providing personalized and interactive experiences, leading to stronger
connections with customers and enhanced satisfaction levels. Korzynski et al. [25] further
emphasize the potential of generative AI in improving customer engagement through efficient
and effective communication. These studies suggest that generative AI can help organizations
build long-term relationships with customers and drive business growth [26]. Moreover, some
authors discuss the current and potential applications of generative AI in streamlining operational
processes [3], [27]. By automating repetitive tasks and providing real-time information,
generative AI reduces manual efforts, minimizes errors, and accelerates decision-making
processes. Korzynski [25] highlight the efficiency gains that organizations can achieve by
integrating generative AI systems into their operations. These studies demonstrate how
generative AI can enhance operational efficiency and improve overall business performance.
Generative AI is also recognized as a valuable tool for data-driven decision-making in the
business domain. Chui and Malhotra [27] discuss how generative AI leverages advanced
analytics and natural language processing capabilities to analyze large volumes of data, extract
meaningful insights, and provide recommendations. By accessing relevant information and
generating real-time insights, generative AI empowers decision-makers to make informed choices
and drive strategic and operational success. While maturity models have been widely used in
various domains to assess organizational readiness and maturity, their specific application to
generative AI is not extensively discussed in the current literature [3], [20], [28]. However, as the
field continues to evolve, the adoption of maturity models could provide a valuable framework
for evaluating how organizations can leverage generative AI for business advantages, considering
the associated risks and benefits [3], [10]. Future research can explore the potential connections
between maturity models and generative AI to identify specific factors and assessment criteria
relevant to its successful implementation.
It is important to note that the field of generative AI is rapidly evolving, and further research is
needed to fully explore its potential applications and implications in different business settings.
The studies mentioned above serve as foundational references, and future research can build upon
them to deepen our understanding of the current and potential applications of generative AI in
various industries.
We leveraged the Consensual Big Data Assessment System (CBDAS) framework as our
foundational basis, encompassing its critical success factors such as data strategy, integrated
architecture, IT infrastructure, human data interface, analytical human workforce, integrated
organization, and data-friendly corporate culture. Our aim is to leverage this framework as a
4
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
starting point to construct a practical case-based framework that serves as a foundation for
understanding inhibitors and risks associated with an organization's adoption of generative AI.
The breadth of domains proposed in the framework allows for the incorporation of adjacent
aspects from big data analytics into the realm of generative AI maturity. While there is limited
explicit literature on the integration of big data analytics and generative AI maturity, the
integration of these two fields presents an opportunity to enhance the understanding of generative
AI within the broader context of data analytics maturity [29], [30]. This integration can facilitate
a holistic approach to harnessing the potential of generative AI and its interplay with big data
analytics, leading to more informed decision-making and improved organizational outcomes.
By considering these critical success factors and their specific requirements, organizations can
effectively deploy generative AI, ensuring compliance with information security standards and
mitigating risks related to proprietary data. This comprehensive approach will facilitate the
successful implementation of generative AI in domains such as productivity, content creation,
and knowledge transfer, enabling organizations to harness its advantages while minimizing
potential challenges.
5
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
- Sufficient storage and computational - Ensure sufficient storage and
resources computational resources are
- Appropriate cloud-based solutions and available
big data infrastructure - Select appropriate cloud-
based solutions and big data
infrastructure
Human Data - Easy-to-use and accessible generative - Develop and implement
Interface AI interfaces easy-to-use and accessible
- Comprehensive business intelligence generative AI interfaces
systems, analytical toolkits, and data - Adopt comprehensive
visualization platforms business intelligence systems,
- Guidelines and documentation on data analytical toolkits, and data
access and usage visualisation platforms
- Establish guidelines and
documentation on data access
and usage
Analytical - Skilled and competent analytical - Ensure the analytical
Human workforce workforce is skilled and
Workforce - Well-defined job families and training competent
guidelines for analytical roles - Develop and implement
- Corporate-wide development framework well-defined job families and
for analytical competencies training guidelines for
analytical roles
- Establish a corporate-wide
development framework for
analytical competencies
Integrated - Collaboration on generative AI across - Foster collaboration on
Organization the organisation generative AI across the
- Clear power and knowledge flows organisation
- Ensure clear power and
knowledge flows
Data-friendly - Data-driven decision-making - Foster a data-driven
Corporate - Openness to new technologies decision-making culture
Culture - Willingness to experiment and learn - Cultivate an openness to new
technologies
- Encourage experimentation
and learning with generative
AI
4. RESULTS
Within the CBDAS framework, one factor particularly relevant to generative AI adoption is the
establishment of a dedicated internal setup that ensures all use cases relating to leveraging
generative AI are channelled in a reliable, secure, and cost-effective manner. This includes
implementing a use case intake form, vetting the environment and services to ensure InfoSec
compliance and governance, enabling knowledge management sharing, and ensuring a thorough
understanding of the generative AI processes [22], [31].
For the IT infrastructure factor, organizations need to establish an environment where generative
AI can ensure data are stored securely, and models can be built within the organization's
proprietary environment. This includes vetting and ensuring the level of governance, InfoSec
compliance, and reliability of the OpenAI Azure offering [6]. It also involves understanding the
expected outcomes by identifying the types of problems that can yield good results when using
generative AI. Pilot use cases should be tracked and leveraged through knowledge and
6
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
documentation sharing, and comprehensive training materials should be delivered to facilitate the
deployment and usage processes of generative AI models. Additionally, organizations can
leverage and build on the learnings from previous projects to enhance productivity, content
creation, and knowledge transfer within the organization [32], [33]. By considering these critical
success factors and their specific requirements, organizations can effectively deploy generative
AI, ensure compliance with InfoSec standards, and mitigate risks associated with the use of
proprietary data. This comprehensive approach will facilitate the successful implementation of
generative AI in areas such as productivity, content creation, and knowledge transfer, enabling
organizations to leverage its advantages while minimizing potential challenges.
Actionable measures that organizations can take to ensure success in the implementation of
generative AI, considering the critical success factors discussed within the CBDAS framework
should be:
By implementing these actionable measures, organizations can enhance their chances of success
in deploying generative AI. These measures address the specific requirements outlined in the
critical success factors and contribute to building a solid foundation for generative AI
implementation. Regular monitoring, evaluation, and adaptation of these measures based on
evolving needs and emerging insights will further ensure the long-term success and continuous
improvement of generative AI initiatives within organizations [34]–[36].
7
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
5. CONCLUSIONS
The paper concludes with important implications for practitioners in the field of generative AI.
The adoption of maturity models, specifically the CBDAS framework, can serve as a valuable
tool for organizations seeking to leverage generative AI for business advantages. The identified
critical success factors, including the establishment of a dedicated internal setup, robust IT
infrastructure, understanding of expected outcomes, comprehensive training and support, and
leveraging insights from previous projects, provide actionable measures for organizations to
ensure successful implementation. Practitioners should consider these recommendations to
enhance their ability to deploy generative AI effectively, ensure compliance with InfoSec
standards, and mitigate risks associated with proprietary data. By doing so, organizations can tap
into the potential benefits of generative AI in domains such as productivity, content creation, and
knowledge transfer.
By bridging the gap between academic research and practical application, future research can
contribute to a deeper understanding of how organizations can leverage generative AI for
business advantages and navigate the associated challenges. This will ultimately support
practitioners in making informed decisions and driving successful implementation of generative
AI in diverse business settings.
REFERENCES
[1] A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, “Language models are
unsupervised multitask learners,” OpenAI Blog, 2019.
[2] M. Chui and J. Manyika, “Where machines could replace humans—and where they can’t (yet),”
McKinsey Q., 2016.
[3] Y. Duan, J. S. Edwards, and Y. K. Dwivedi, “Artificial intelligence for decision making in the era of
Big Data – evolution, challenges and research agenda,” Int. J. Inf. Manage., vol. 48, pp. 63–71, Oct.
2019.
[4] T. H. Davenport and R. Ronanki, “Artificial intelligence for the real world,” Harv. Bus. Rev., 2018.
[5] T. B. Brown et al., “Language models are few-shot learners,” Neural Inf. Process. Syst., pp. 1877–
1901, 2020.
[6] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, and A. N. Gomez, “Attention is all you
need,” Neural Inf. Process. Syst., 2017.
[7] M. Castelluccio, “The promise and challenges of AI,” Strateg. Financ., pp. 98(1), 23–30, 2016.
[8] N. Bostrom, “Superintelligence: Paths, dangers, strategies,” Oxford Oxford Univ. Press, 2014.
[9] W. Knight, “Biased algorithms are everywhere, and no one seems to care,” MIT Technol. Rev., 2017.
[10] A. B. Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, and A. Barbado, “Explainable
Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible
AI,” Inf. Fusion, pp. 58, 82–115, 2020.
[11] A. De Mauro, M. Greco, M. Grimaldi, S. Malacaria, and B. Mignacca, “Toward the implementation
of a Consensual Maturity Model for Big Data in Consumer Goods companies,” in Proceedings of
IFKAD 2022 Knowledge Drivers for Resilience and Transformation, 2022, pp. 2380–2402.
[12] Y. P. Freund, “Critical success factors,” Plan. Rev., pp. 20–23, 1988.
[13] M. Tsoy and D. S. Staples, “What Are the Critical Success Factors for Agile Analytics Projects?,”
Inf. Syst. Manag., vol. 00, no. 00, pp. 1–18, 2020.
[14] T. H. Davenport and R. Bean, “How big data and AI are accelerating business transformation,” pp. 1–
16, 2019.
8
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
[15] E. Brynjolfsson and A. McAfee, “The second machine age: Work, progress, and prosperity in a time
of brilliant technologies,” WW Nort. Co., 2014.
[16] F. Chollet, “Deep Learning with Python,” Manning Publ. Co, 2018.
[17] S. Klee, A. Janson, and J. M. Leimeister, “How Data Analytics Competencies Can Foster Business
Value– A Systematic Review and Way Forward,” Inf. Syst. Manag., vol. 38, no. 3, pp. 200–217,
2021.
[18] T. R. Shah, “Can big data analytics help organisations achieve sustainable competitive advantage? A
developmental enquiry,” Technol. Soc., vol. 68, no. July 2021, p. 101801, 2022.
[19] Z. A. Al-Sai, R. Abdullah, and M. H. Husin, “A review on big data maturity models,” 2019 IEEE
Jordan Int. Jt. Conf. Electr. Eng. Inf. Technol. JEEIT 2019 - Proc., pp. 156–161, 2019.
[20] J. B. S. dos Santos-Neto and A. P. C. S. Costa, “Enterprise maturity models: a systematic literature
review,” Enterp. Inf. Syst., vol. 13, no. 5, pp. 719–769, 2019.
[21] M. Comuzzi and A. Patel, “How organisations leverage: Big Data: A maturity model,” Ind. Manag.
Data Syst., vol. 116, no. 8, pp. 1468–1492, 2016.
[22] I. Goodfellow, Y. Bengio, and A. Courville, “Deep learning,” MIT Press, 2016.
[23] F. Provost and T. Fawcett, “Data science for business,” O’Reilly Media, 2013.
[24] B. Marr, Big data in practice: how 45 successful companies used big data analytics to deliver
extraordinary results. 2016.
[25] P. Korzynski, G. Mazurek, A. Altmann, J. Ejdys, J. Kazlauskaite, R. Paliszkiewicz, and E. Ziemba,
“Generative artificial intelligence as a new context for management theories: analysis of ChatGPT.,”
Cent. Eur. Manag. J., 2023.
[26] J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional
transformers for language understanding,” arXiv Prepr. arXiv1810.04805, 2018.
[27] M. Chui and S. Malhotra, “AI adoption advances, but foundational barriers remain,” McKinsey Q.,
2018.
[28] P. Mikalef, I. O. Pappas, J. Krogstie, and M. Giannakos, “Big data analytics capabilities: a systematic
literature review and research agenda,” Inf. Syst. E-bus. Manag., no. September, pp. 1–32, 2017.
[29] C. Loebbecke and A. Picot, “Reflections on societal and business model transformation arising from
digitization and big data analytics: A research agenda,” J. Strateg. Inf. Syst., vol. 24, no. 3, pp. 149–
157, 2015.
[30] E. Gökalp and V. Martinez, “Digital transformation maturity assessment: development of the digital
transformation capability maturity model,” Int. J. Prod. Res., 2021.
[31] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach. 2016.
[32] G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. R. Mohamed, and N. Jaitly, “Deep neural networks for
acoustic modeling in speech recognition: The shared views of four research groups,” IEEE Signal
Process. Mag., pp. 29(6), 82–97, 2012.
[33] J. Schmidhuber, “Deep learning in neural networks: An overview,” Neural networks, pp. 61, 85–117,
2015.
[34] P. Weill and J. W. Ross, “IT Governance: How top performers manage IT decision rights for superior
results,” Harvard Bus. Press, 2004.
[35] T. H. Davenport and J. G. Harris, “Competing on analytics: The new science of winning,” Harvard
Bus. Press, 2007.
[36] V. Grover, R. H. L. Chiang, T.-P. Liang, and D. Zhang, “Creating Strategic Business Value from Big
Data Analytics: A Research Framework,” J. Manag. Inf. Syst., vol. 35, no. 2, pp. 388–423, Apr. 2018.
AUTHOR
Michele Grimaldi Since 2006, Michele Grimaldi is Professor in Business and Economic Engineering at
the University of Cassino and Southern Lazio (Italy). He actually is a tenured professor of "Accountancy
and Management Auditing" and “Industrial Organization” at the University of Cassino and Southern Lazio;
a tenured professor of “Knowledge Management” in the second level Master in Business Administration
9
International Journal on Cybernetics & Informatics (IJCI) Vol.12, No.7, December 2023
organized by the Faculty of Engineering of the “Tor Vergata” University of Rome; a tenured professor of
“Intangible Assets” in the Executive Master of Business Administration organized by the Faculty of
Economics of the “Tor Vergata” University of Rome. He is qualified to Associate Professor in Business
and Economic Engineering through the National Academic Qualification System (Abilitazione Scientifica
Nazionale)
Marco Greco Marco Greco is Assistant Professor (Department of Civil and Mechanical Engineering at the
University of Cassino and Southern Lazio (Italy). His actual research focus on open innovation, intellectual
capital, big data, strategy, and negotiation. He actually is a professor of “Economics Applied to
Engeenering”, “Industrial Marketing and Business Management” and “Business Organization” at the
University of Cassino and Southern Lazio.
Andrea De Mauro Andrea De Mauro has over ten years of experience as an IT manager and Senior Data
Scientist at Procter & Gamble. Today he is responsible for Southern Europe Data Analytics team and is
responsible for the professional training of all P&G analysts in Europe. Adjunct Professor of Marketing
Analytics and Business Intelligence at the Universities of Bari and Florence, his academic research focuses
on the impact of Big Data in the enterprise sector. Author of the book Big Data Analytics (2019).
10