Artificial Intelligence Big Data 01 Research Paper
Artificial Intelligence Big Data 01 Research Paper
Abstract:
Artificial intelligence in finance is transforming the way individuals interact
with money. Artificial intelligence is helping the financial industries to
streamline and optimize processes ranging from credit decisions to quantitative
trading and financial risk management. This paper provides a deep knowledge
about how the structured and unstructured data known as big data used by
artificial intelligence helps the finance sector to grow successfully and also
provides reason to use it.
CHAPTER-1-INTRODUCTION
Data is lifeblood of artificial intelligence. An artificial intelligence system needs
to learn from data in order to be able to fulfil its function. Here artificial
intelligence is useless without data and data is also useless without artificial
intelligence. In this paper we are going to study two types of big data
Structured data
Unstructured data
1
1.1 structured data: structured data is most often categorized quantitative data,
and it’s the type of data mostly used in work. Structured data usually resides
in relational database (RDBMS). Example of structured data includes
names, dates, address, credit card numbers, stock information, geolocation
and more.
1.2 Unstructured data: unstructured data is essentially everything else.
Unstructured data has internal structure but is not structured through pre-
defined data models or it may be textual or non textual and human or
machine – generated. It may be stored within a non relational database like
NOSQL. Typical human generated unstructured data includes text files,
email, social media, website, mobile data etc typical machine-generated
unstructured data includes satellite imagery, scientific data, digital
survelliance, sensor data.
1.3 Characteristic:
Variety of Big Data refers to structured, unstructured data that is
gathered from multiple sources. While in the past, data could only be
collected from spreadsheets and databases, today data comes in an array
of forms such as emails, PDFs, photos, videos, audios, SM posts, and so
much more. Variety is one of the important characteristics of big data.
Velocity essentially refers to the speed at which data is being created in
real-time. In a broader prospect, it comprises the rate of change, linking
of incoming data sets at varying speeds, and activity bursts.
Volume is one of the characteristics of big data. We already know that
Big Data indicates huge ‘volumes’ of data that is being generated on a
daily basis from various sources like social media platforms, business
processes, machines, networks, human interactions, etc. Such a large
amount of data are stored in data warehouses.
2
1.4 purpose of big data analysis:
Big data analysis has many purposes and goals, which can be summarized
under three headings:
3
Unlock the true potential of data-driven marketing.
Dig in customer data to create tailor-made products, services, offers,
discounts, etc.
Facilitate speedy delivery of products/services that meet and exceed
client expectations.
Diversify revenue streams to boost company profits and ROI.
Respond to customer requests, grievances, and queries in real-time.
Foster innovation of new business strategies, products, and services.
1.5 Advantages of big data:
Cost optimization: One of the most significant benefits of Big Data
tools like Hadoop and Spark is that these offer cost advantages to
businesses when it comes to storing, processing, and analysing large
amounts of data. Not just that, big data tools can also identify efficient
and cost-savvy ways of doing business.
Operational efficiency: Big Data tools can improve operational
efficiency by leaps and bounds. By interacting with customers/clients
and gaining their valuable feedback, Big Data tools can amass large
amounts of useful customer data. This data can then be analysed and
interpreted to extract meaningful patterns hidden within (customer
taste and preferences, pain points, buying behavior, etc.), which
allows companies to create personalized products/services.
Foster competitive pricing: Big Data Analytics facilitates real-time
monitoring of the market and your competitors. You can not only
keep track of the past actions of your competitors but also see what
strategies they are adopting now.
Boost sales and retails customer: Big Data aims to gather and
analyse vast volumes of customer data. The digital footprints that
customers leave behind reveal a great deal about their preferences,
needs, buying behavior, and much more. This customer data offers
4
the scope to design tailor-made products and services to cater to the
specific needs of individual customer segments. The higher the
personalization quotient of a business, the more it will attract
customers. Naturally, this will boost sales considerably.
Innovate: Big Data Analytics and tools can dig into vast datasets to
extract valuable insights, which can be transformed into actionable
business strategies and decisions. These insights are the key to
innovation.
The insights you gain can be used to tweak business.
Focus on local environment : This is particularly relevant for
small businesses that cater to the local market and its customers.
Even if your business functions within a constrained setting, it is
essential to understand your competitors, what they are offering,
and the customers.
Control and monitor online reputation: As an increasing number
of businesses are shifting towards the online domain, it has become
increasingly crucial for companies to check, monitor, and improve
their online reputation. After all, what customers are saying about
you on various online and social media platforms can affect how
your potential customers will view your brand.
1.6 areas that big data impacting:
retailers: Loyalty cards and company credit cards are not issued just as a
courtesy to customers. The data captured from the cards is processed by a
big data platform, providing retailers with information that allows them to
make better decisions about pricing, inventory control and customer
incentives.
Finance sector: The banking industry has embraced big data whole-
heartedly. Fraud detection is one reason. A customer’s history and
transaction data can be used to detect any out-of-the-ordinary activity.
5
Health care: One obvious area big data will help is in handling electronic
health record safely and accurately across medical organizations. Having
accurate records will provide patients with better service and decrease
errors. The health care field, for obvious reasons, is adapting big data at a
slower pace in order to conform to government regulations regarding
patient confidentiality.
Social media: Big data’s ability to analyse, in near real time, social
network posts (Twitter and Facebook, for example) allows companies,
brands and organizations a unique opportunity to determine
customer/member loyalty and how customers feel about products and/or
service.
Marketing: No doubt about it, marketers love big data. The more data
they have, the better they feel. What big data offers marketers that they
did not have before is the ability to mine the tiniest detail about customer
behavior towards their products. Marketing firm 360i says that big data
has been helpful in:
6
analysis of market trends, social media sentiment analysis, and spending
patterns.
Consumer analytics: Consumer analytics entails the analysis of
spending patterns, investments, shopping trends, personal philosophies,
and other backgrounds that are relevant to their finances. This helps in
targeting customers with useful solutions and is a powerful lead
generation strategy.
Influence strategy: Big Data tremendously influences company policy
and strategy. This is an emerging trend being experienced across the
financial industry. Leveraging the improved forecasting using Big Data
tools, companies can improve their predictions and incorporate them into
the overall strategy.
Digital transformation: Digital transformation is one of the most
significant changes in the financial industry and is largely powered by
data. By unlocking new insights from analysis, companies better
understand their products, usage patterns, and missing links. They can
embark on closing those links with new digital products or services to
retain their existing customers.
Optimize operational efficiency: Another important influence of big
data on modern finance is the improvement of operational efficiency. For
instance, using Big Data, analysis of all compliance requirements from
the government for banks can be automated and scaled to all customers.
Future prospects
7
multichannel banking. Such capability will include GIS data, business
data, movement, process, and more. Analytics in finance will advance
enough to provide industry-reliable insights and products for e-
commerce, manufacturing, process management, learning solutions
among others.
Predictive analytics and automation: The concept of predictive
analytics is relatively young but as it matures, specialized analytics will
become a norm and reliable enough to make accurate predictions based
on Big Data analytics. At this stage, much of the analytics processes
will be automated using machine learning and sophisticated AI.
Competition in finance will soon depend on how prepared a company is
to take up such advanced tools and use them to serve their customers.
New careers in finance: new technologies call for new expertise and
industry requirements. It is likely that in the near future, new careers in
predictive analytics and product analytics will emerge with experts able
to use Big Data for future predictions and make product
recommendations. It is possible that data science professionals will
specialize in domains such as business experts, consumer tech,
manufacturing, etc.
Customer segmentation: Financial institutions serve customers with
diverse requirements and behavior. Customer segmentation will
transform the bank from a general-purpose institution to the one that
places its customers in groups and targets them as such. Already, Big
Data is helping institutions analyse customer behavior and spending
patterns. In the future, the dynamic segmentation of customers will
advance even further to include specialized products backed with AI.
Uncharted territory: As deep learning and AI become more
operationalized and sophisticated, we will see the industry head into
new directions from the current trends. AI-only banking apps might be
8
one of such changes. It could also mean ditching the UI that we are
accustomed to for a simpler, intuitive, and flexible interface powered
by bots to deliver personalized feel unique to each us.
9
CHAPTER 2- RESEARCH METHODOLOGY
Research methodology is the specific procedure or technique used to identify,
select, process, and analyse information about a topic. In a research paper, the
methodology section allows the reader to critically evaluate a study’s overall
validity and reliability.
2.2 hypothesis:
H1; fraud detection can be happened with the help of big data
H3; there is a significant relationship between big data and stock market
H7; risk of bad investor and payer gets impacted by big data.
Sample design:
1) Population:
10
A. Element: big data in finance sector
B. Sampling unit: students from class, finance persons, friends,
relatives
C. Extended: Maharashtra state.
D. Time: 10/02/2020 to 1/10/2020
Variables:
1. Gender
2. Age
3. Qualification
4. Experience
5. Source of income
6. Status of respondent
2. secondary data through internet, journal and article, books and internet
experts etc.
11
CHAPTER-3: REVIEW OF LITERATURE
12
also lead them to gain competitive advantages, minimize costs, convert
challenges to opportunities and face the risk more confidently.
(sunni hafiz olaswasola 2015) : the technical key to useful
implementation of big data and digitization of business process is the
capability of organization to collect and process all the required data and
inject this big data into its business process in current time or more
accurately in right time. If the banking industry will implement the big
data effectively will increase the efficiency of the banking sector.
(taruna seth and Vipin Chaudhary 2015) : the financial sector has
always been driven from data availability. Today the big data is prevalent
at various levels of this sector, ranging from the financial services
industry to capital markets. The availability of big data in this section has
opened up new avenues for innovation in this field and has offered
immense opportunities for global growth and sustainability.
(pingale murali manish , sheetal kesale , anit dani simon) : the big data
analytics and banking uses information as services .big data analytics helps
in the full exploitation of resources if used to its full, has the potential to
anticipate unforeseen benefits and insight information into the existing banks
and the services provided .
(vadlamani Ravi 2017) : The big data analytics is changing the market of
financial services industry. In the banking industry, large amount of system-
generated and customer-generated data provides growth of the business.
There are many different ways that big data analytics can bring a new face
to the banking industry. Various forms of analytics discussed in the paper
indeed can benefit immensely from the big data available in the related
problems including the new technologies IoT, Blockchain, Robotics,
Chatbots and data lake.
13
( abhinav Kathuria 2016 ) : Nowadays, banking sector is generating huge
amount of data. Previously, most bannks did not have utilized this data.
However, in today’s era, banks have started using this data to reach their
main objectives of marketing. By using this big data, many secrets can be
revealed like money movements, thefts, disaster.
14
( raef Lawson 2019) : In order to stay relevant, finance professionals
must take advantage by creating opportunities for their business through
the big data available to them. It includes addressing the areas of data
governance, the use of data to gain insight into business latest happening
and an organization’s operations, and the use of Big Data to enhance
organizational risk management.
15
financial system to accept new concepts and apply new technologies.
However, with the proper application and popularization of Internet
technology in the financial field, the traditional finance has been rapidly
transformed from the economic field into a new industry through internet
finance.
16
( Helena forest and Evelyn foo) : financial industry is one of the most data-
driven industries . At the end of 2012, it was found that financial and
securities organisations were managing 3.8 petabytes of data per firm. Data
sets have grown immensely in terms of size, type and complexity, and it is
difficult to work with using traditional database management tools. Many
large financial and banking industries .are reaching the upper limits of their
legacy systems and are now using latest analytics and framework for their
organizations to work more effectively.
( utkarsh srivastava, santosh gopalkrishnan 2015 ): The big data
revolution that is happening in 21st century has found a resonance with
banking firms, considering the valuable data they’ve been loading since
many decades. This data has unlocked secrets of money movements, helped
prevent major disasters and thefts and understand changing consumer
behaviour. Banks take the most benefits from big data available to their use
as they now can extract good information quickly and easily from their data
and convert it into meaningful benefits for themselves and their customers.
Banks internationally has started to utilize the power of big data in order to
derive utility across various area of their functioning, ranging from sentiment
analysis of customer, product selling, regulatory compliances management,
reputational risk management, financial crime management and much more
which will help them to grow globally.
17
CHAPTER-4: DATA ANALYSIS, INTERPRETATION
AND PRESENTATION
SUMMARY
Varianc
Groups Count Sum Average e
0.69046
V1 103 379 3.67961165 3
4.18446601 0.64210
V2 103 431 9 9
3.85436893
V3 103 397 2 0.96878
3.82524271 1.00837
V4 103 394 8 6
3.81553398 1.23034
V5 103 393 1 5
V6 103 410 3.98058252 1.01922
18
4 7
3.79611650 1.00704
V7 103 391 5 4
3.84466019 1.03445
V8 103 396 4 7
0.90196
V9 103 412 4 1
ANOVA
Source of
Variation SS df MS F P-value F crit
Between 17.82524 2.35845 0.0163297 1.948472
Groups 3 8 2.22815534 7 4 4
867.2815 0.94475114
Within Groups 5 918 7
Interpretation: from the above one factor anova’s observation it is seen that
there is significant impact of above variable on the study thus we accept
following hypothesis
H1; fraud detection can be happened with the help of big data
H3; there is a significant relationship between big data and stock market
H7; risk of bad investor and payer gets impacted by big data.
19
4.2 analysis of regression:
Regression Statistics
Multiple R 0.4776024
R Square 0.228104
Adjusted R
Square 0.1534044
Standard Error 0.4347938
Observations 103
ANOVA
Significance
df SS MS F F
0.57727302
Regression 9 5.1954572 1 3.05362 0.003019975
0.18904561
Residual 93 17.581242 1
Total 102 22.776699
20
1.68135030 -
V9 0.0866013 0.051507 6 0.09605 0.015681386 0.18888403 -0.015681
Interpretation : from the above study it is seen that gender doesn’t have much
significance impact on the variables. Thus we reject following hypothesis
H1; fraud detection can be happened with the help of big data
H3; there is a significant relationship between big data and stock market
H7; risk of bad investor and payer gets impacted by big data.
V1 V2 V3
21
6 3 5
Skewness -0.80022 Skewness -1.04718 Skewness -0.9595
Range 4 Range 4 Range 4
Minimum 1 Minimum 1 Minimum 1
Maximum 5 Maximum 5 Maximum 5
Sum 379 Sum 431 Sum 397
Count 103 Count 103 Count 103
Largest(1) 5 Largest(1) 5 Largest(1) 5
Smallest(1) 1 Smallest(1) 1 Smallest(1) 1
Confidence 0.16239 Confidence 0.15660 Confidence 0.19236
Level(95.0%) 9 Level(95.0%) 9 Level(95.0%) 5
V4 V5 V6
3.82524 3.98058252
Mean 3 Mean 3.815534 Mean 4
0.09894 0.109293 0.09947566
Standard Error 5 Standard Error 6 Standard Error 9
Median 4 Median 4 Median 4
Mode 4 Mode 4 Mode 4
1.00417 1.00956778
Standard Deviation 9 Standard Deviation 1.109209 Standard Deviation 3
1.00837 1.230344 1.01922710
Sample Variance 6 Sample Variance 6 Sample Variance 8
- 0.63476860
Kurtosis -0.0117 Kurtosis 0.327019 Kurtosis 9
-
- 0.95166427
Skewness 0.70624 Skewness -0.72459 Skewness 5
Range 4 Range 4 Range 4
Minimum 1 Minimum 1 Minimum 1
Maximum 5 Maximum 5 Maximum 5
Sum 394 Sum 393 Sum 410
Count 103 Count 103 Count 103
Largest(1) 5 Largest(1) 5 Largest(1) 5
Smallest(1) 1 Smallest(1) 1 Smallest(1) 1
Confidence 0.19625 Confidence 0.216783 Confidence 0.19730951
Level(95.0%) 6 Level(95.0%) 4 Level(95.0%) 9
V7 V8 V9
22
5 2
0.09887933 0.100216 0.09357831
Standard Error 2 Standard Error 1 Standard Error 4
Median 4 Median 4 Median 4
Mode 4 Mode 4 Mode 4
Standard 1.00351561 Standard 1.017082 Standard
Deviation 7 Deviation 3 Deviation 0.94971616
1.00704359 1.034456 0.90196078
Sample Variance 4 Sample Variance 5 Sample Variance 4
-
0.24266442 1.027377 1.45983192
Kurtosis 5 Kurtosis 2 Kurtosis 6
- -
0.52730825 - 1.12048340
Skewness 2 Skewness 0.992482 Skewness 5
Range 4 Range 4 Range 4
Minimum 1 Minimum 1 Minimum 1
Maximum 5 Maximum 5 Maximum 5
Sum 391 Sum 396 Sum 412
Count 103 Count 103 Count 103
Largest(1) 5 Largest(1) 5 Largest(1) 5
Smallest(1) 1 Smallest(1) 1 Smallest(1) 1
Confidence 0.19612668 Confidence 0.198778 Confidence 0.18561214
Level(95.0%) 6 Level(95.0%) 2 Level(95.0%) 2
Interpretation: from the above analysis we found that the all above studied
variable have positive effect on big data used in finance sector, if used perfectly
and it is assumed the success of finance sector is dependant on management of
proper use of big data.
V1 V2 V3 V4 V5 V6 V7 V8 V9
0.68375
V1 9
0.30181 0.63587
V2 9 5
0.21547 0.22103 0.95937
V3 7 9 4
23
0.13818 0.27495 0.08134 0.99858
V4 5 5 6 6
0.22245 0.11169 0.23527 0.35611 1.21839
V5 3 8 2 3 9
0.22688 0.00688 0.09369 0.26826 1.00933
V6 0.21708 3 1 4 3 2
0.31331 0.37741 0.15477 0.16825 0.32161 0.26788 0.99726
V7 9 5 4 3 4 6 6
0.21236 0.25195 0.12819 0.45678 0.17174 0.30813 1.02441
V8 7 6 0.26864 3 2 1 5 3
0.18446 0.25242 0.20388 0.28155 0.32038 0.14563 0.13592 0.27184
V9 6 7 3 3 8 1 2 5 0.893203883
24
CHAPTER-5- CONCLUSION AND SUGGESTION
5.1 RESULTS:
5.2 CONCLUSION:
the finance sector is growing more effectively with the help of big
data available through artificial intelligence.
Business risk can be easily tackled with the help of big data.
Finance sector can provide more satisfaction to customer with the
help of big data available to them.
Frauds can be prevented when big data of structured and
unstructured information used properly.
5.3 SUGGESTIONS:
25
References:
www.Wikipedia.com
journal of science engineering and technology research
research paper on impact of big data analytics on banking
sector
research paper on big data opportunities for account and
finance practice and research
research paper on predictive analytics with structured and
unstructured data
research paper on big data in financial management and
structured literature review and opportunities for IS research.
26
APPENDIX
Questionnaire:
1. Name of respondent *
2. gender *
Female
Male
3. Age *
Below 20
20-30
30-40
40-50
Above 50
4. Qualification *
27
Mark only one oval.
Under graduate
Graduate
Post graduate
Professional
Other
5. Experience *
Below 5 years
5-10 years
10-15 years
15-20 years
Above 20 years
Employed
Owner of business
Investor
Other
Non financial
28
8. big data in banking sector helps in fraud detection * Mark only one oval.
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
9. application of big data helps the finance sector to face competition more confidently *
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
10. application of big data allows proper analysis and appropriate decisions in stock
market *
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
29
11. business risk such as bad investors and payers can be avoided through proper analysis
of big data * Mark only one oval.
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
12. proper utilization of big data can help in global growth of business * Mark only one
oval.
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
13. Analysis of big data helps the finance sector to provide maximum customer
satisfaction *
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
30
14. smooth functioning of regulatory compliance given by government can be achieved
through big data * Mark only one oval.
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
15. Proper decision making can be achieved through big data available to business * Mark
only one oval.
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
16. big data helps in innovating new services as per preferences of customers * Mark only
one oval.
Strongly agree
Agree
Neutral
Disagree
Strongly Disagree
31
32