Pertemuan 3

ABC: AI, Big Data, and Cloud

Computing

D4 Teknologi Rekayasa Perangkat Lunak

 Business Intelligence (BI)
1 Introduction to BI and Data Science

2 Descriptive Analytics

3 Predictive Analytics

4 Prescriptive Analytics

5 Big Data Analytics

6 Future Trends
2
 ABC:
AI,
Big Data,
Cloud Computing
3
 Outline

• AI
• Big Data
• Cloud Computing

4
Business Intelligence, Analytics, and Data Science:
A Managerial Perspective, 4th Edition,
Ramesh Sharda, Dursun Delen, and Efraim Turban,
Pearson, 2017.

Source: https://www.amazon.com/Business-Intelligence-Analytics-Data-Science/dp/0134633288 5
Big Data, Data Mining, and Machine Learning: Value Creation for
Business Leaders and Practitioners,
Jared Dean,
Wiley, 2014.

Source: https://www.amazon.com/Data-Mining-Machine-Learning-Practitioners/dp/1118618041 6
Social Network Based Big Data Analysis and Applications,
Lecture Notes in Social Networks,
Mehmet Kaya, Jalal Kawash, Suheil Khoury, Min-Yuh Day,
Springer International Publishing, 2018.

Source: https://www.amazon.com/Network-Analysis-Applications-Lecture-Networks/dp/3319781952 7
 AI, Big Data, Cloud Computing
Evolution of Decision Support,
Business Intelligence, and Analytics
AI
AI Cloud Computing Big Data
DM BI

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),

Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 8
 Evolution of top keywords in
“BD & BI” publications

2014 2015 2016 2017

• Management • Big Data • Cloud • Knowledge

• Text Mining Analytics Computing Management
• Data Mining • Social Media • Data
• Data Science • Business Warehouse
Analytics
• Information
System

Source: Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big Data analytics: A bibliometrics study”,
Expert Systems with Applications, Volume 111, 30, 2018, pp. 2-10 10
 Framework for BD and BI Research
• Data Collection • Business
• Data Storage • Medicate
• Data Analytics • Supply Chain
• Infrastructure • Engineering
• Services
Technology Application

Impact Management

• Value Creation • Adoption of BD/BI

• Individual Impact • Cost Benefit
• Organizational Impact • Security/Privacy
• Social Impact • Human Resource
Source: Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big Data analytics: A bibliometrics study”,
Expert Systems with Applications, Volume 111, 30, 2018, pp. 2-10 11
Business Intelligence and Big Data analytics

Source: Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big Data analytics: A bibliometrics study”,
Expert Systems with Applications, Volume 111, 30, 2018, pp. 2-10 12
13
 Definition
of
Artificial Intelligence
(A.I.)
14
 Artificial Intelligence

“… the science and

engineering
of
making
intelligent machines”
(John McCarthy, 1955)
Source: https://digitalintelligencetoday.com/artificial-intelligence-defined-useful-list-of-popular-definitions-from-business-and-science/ 15
Artificial Intelligence
“… technology that
thinks and acts
like humans”
Source: https://digitalintelligencetoday.com/artificial-intelligence-defined-useful-list-of-popular-definitions-from-business-and-science/ 16
 Artificial Intelligence
“… intelligence
exhibited by machines
or software”
Source: https://digitalintelligencetoday.com/artificial-intelligence-defined-useful-list-of-popular-definitions-from-business-and-science/ 17
 4 Approaches of AI

Thinking Humanly Thinking Rationally

Acting Humanly Acting Rationally

Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 18
 4 Approaches of AI
2. 3.
Thinking Humanly: Thinking Rationally:
The “Laws of Thought”
The Cognitive Approach
Modeling Approach

1. 4.
Acting Humanly: Acting Rationally:
The Turing Test The Rational Agent
Approach (1950) Approach
Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 19
 AI Acting Humanly:
The Turing Test Approach
(Alan Turing, 1950)

• Natural Language Processing (NLP)

• Knowledge Representation
• Automated Reasoning
• Machine Learning (ML)
• Computer Vision
• Robotics

Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 20
Boston Dynamics: Atlas

https://www.youtube.com/watch?v=fRj34o4hN4I 21
Humanoid Robot: Sophia

https://www.youtube.com/watch?v=S5t6K9iwcdw 22
Can a robot pass a university entrance exam?
Noriko Arai at TED2017

https://www.ted.com/talks/noriko_arai_can_a_robot_pass_a_university_entrance_exam
https://www.youtube.com/watch?v=XQZjkPyJ8KU 23
Artificial Intelligence (A.I.) Timeline

Source: https://digitalintelligencetoday.com/artificial-intelligence-timeline-infographic-from-eliza-to-tay-and-beyond/ 24
 Artificial Intelligence
Machine Learning & Deep Learning

Source: https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/
25
 AI, ML, DL
Artificial Intelligence (AI)

Machine Learning (ML)

Supervised Unsupervised
Learning Learning
Deep Learning (DL)
CNN
RNN LSTM GRU
GAN
Semi-supervised Reinforcement
Learning Learning
Source: https://leonardoaraujosantos.gitbooks.io/artificial-inteligence/content/deep_learning.html 26
Artificial Intelligence (AI)
is many things

Ecosystem of AI
Source: https://www.i-scoop.eu/artificial-intelligence-cognitive-computing/ 27
 Artificial Intelligence (AI)
Intelligent Document Recognition algorithms

Source: https://www.i-scoop.eu/artificial-intelligence-cognitive-computing/ 28
Deep Learning Evolution

Source: http://www.erogol.com/brief-history-machine-learning/ 29
 Machine Learning Models
Deep Learning Kernel

Association rules Ensemble

Decision tree Dimensionality reduction

Clustering Regression Analysis

Bayesian Instance based

Source: Sunila Gollapudi (2016), Practical Machine Learning, Packt Publishing 30

3 Machine Learning Algorithms

Source: Enrico Galimberti, http://blogs.teradata.com/data-points/tree-machine-learning-algorithms/

31
Machine Learning (ML) / Deep Learning (DL)
Support Vector
Decision Tree Machine (SVM)
Classifiers
Supervised Neural Network
Learning Linear (NN)
Classifiers Deep Learning
(DL)
Rule-based
Machine Classifiers Naïve Bayes
Learning (NB)
(ML) Unsupervised Probabilistic
Bayesian
Learning Classifiers Network (BN)
Maximum
Entropy (ME)

Reinforcement
Learning

Source: Jesus Serrano-Guerrero, Jose A. Olivas, Francisco P. Romero, and Enrique Herrera-Viedma (2015),
"Sentiment analysis: A review and comparative analysis of web services," Information Sciences, 311, pp. 18-38. 32
Big Data
33
Evolution of Business Intelligence (BI) Chapter 1 • An Overview of Business Intelligence, Analytics, and D

Quer ying and

ETL
r epor t ing

M et adat a Dat a war ehouse

DSS
EIS/ESS

Financial Dat a mar t s Spr eadsheet s

r epor t ing (M S Excel)

OLAP

Digit al cockpit s
and dashboar ds
Business
Scor ecar ds and Int elligence
dashboar ds

Wor kflow

Aler t s and
not ificat ions

Dat a & t ext

mining Pr edict ive Br oadcast ing
Por t als
analyt ics t ools

FIGU RE 1.9Business
Evolution ofSource: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),
Business Intelligence (BI).
Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 34
 mining Predict ive Br oadcast ing
Por t als
analyt ics t ools

A High-Level Architecture of BI
FIGU RE 1.9 Evolution of Business Intelligence (BI).

Dat a Warehouse Business Analyt ics Performance and

Environment Environment St rat egy

Dat a M anagers/execut ives

Technical st af f Business user s
Sources
Build t he dat a w arehouse Access BPM st rat egies
Dat a
- Organizing warehouse
- Summarizing M anipulat ion, result s
- St andardizing

User int erface

Fut ure component : - Browser
Int elligent syst ems - Port al
- Dashboard

FIGU RE 1.10 A High-Level Architecture of BI. (Source: Based on W. Eckerson, Smart Companies in the 21st
Century: The Secrets of Creating Successful
Source: Business Intelligent
Ramesh Sharda, Solutions.
Dursun Delen, andThe Data
Efraim Warehousing
Turban (2017), Institute, Seattle, W A,
Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 35
 Three Types of Analytics

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),

Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 36
 Analytics Ecosystem

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),

Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 37
 Job Titles of Analytics

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),

Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 38
A Data to Knowledge Continuum

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017),

Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson 39
 Big Data
Analytics
and
Data Mining
40
Big Data 4 V

Source: https://www-01.ibm.com/software/data/bigdata/ 41
42
 Stephan Kudyba (2014),
Big Data, Mining, and Analytics:
Components of Strategic Decision Making, Auerbach Publications

Source: http://www.amazon.com/gp/product/1466568704 43
 Architecture of Big Data Analytics
Big Data
Big Data Big Data Big Data Analytics
Sources Transformation Platforms & Tools Applications

Middleware Queries
* Internal Hadoop
Raw Transformed MapReduce Big Data
* External Data Pig Analytics
Data Extract
Hive
Transform Reports
* Multiple Jaql
Load
formats Zookeeper
Hbase
* Multiple Data Cassandra OLAP
locations Warehouse Oozie
Avro
* Multiple Traditional Mahout
applications Format Others Data
CSV, Tables Mining

Source: Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision Making, Auerbach Publications 44
 Architecture of Big Data Analytics
Big Data
Big Data Big Data Big Data Analytics
Sources Transformation Platforms & Tools Applications

* Internal

* External
Raw
Data Mining
Middleware

Extract Data
Hadoop
Transformed MapReduce
Pig
Big Data
Analytics
Queries

Data

Big Data
Hive
Transform Reports
* Multiple Jaql
Load
formats Zookeeper
Hbase
Data

Analytics
* Multiple Cassandra OLAP
locations Warehouse Oozie
Avro
* Multiple Traditional Mahout
Data
Applications
applications Format Others
CSV, Tables Mining

Source: Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision Making, Auerbach Publications 45
 Social Big Data Mining
(Hiroshi Ishikawa, 2015)

Source: http://www.amazon.com/Social-Data-Mining-Hiroshi-Ishikawa/dp/149871093X 46
 Architecture for
Social Big Data Mining
(Hiroshi Ishikawa, 2015)
Enabling Technologies Analysts
• Integrated analysis model • Model Construction
Integrated analysis • Explanation by Model

Conceptual Layer
• Construction and
• Natural Language Processing confirmation
• Information Extraction Data
of individual
• Anomaly Detection Mining hypothesis
• Discovery of relationships • Description and
Multivariate Application
among heterogeneous data execution of
analysis specific task
• Large-scale visualization application-specific
Logical Layer task

• Parallel distrusted processing Social Data

Software
Hardware
Physical Layer

Source: Hiroshi Ishikawa (2015), Social Big Data Mining, CRC Press 47
Business Intelligence (BI) Infrastructure

Source: Kenneth C. Laudon & Jane P. Laudon (2014), Management Information Systems: Managing the Digital Firm, Thirteenth Edition, Pearson. 48
Business Intelligence and Data Mining
Increasing potential
to support
business decisions End User
Decision
Making

Data Presentation Business

Analyst
Visualization Techniques
Data Mining Data
Information Discovery Analyst

Data Exploration
Statistical Summary, Querying, and Reporting

Data Preprocessing/Integration, Data Warehouses

DBA
Data Sources
Paper, Files, Web documents, Scientific experiments, Database Systems
Source: Jiawei Han and Micheline Kamber (2006), Data Mining: Concepts and Techniques, Second Edition, Elsevier 49
 Data Mining at the
Intersection of Many Disciplines

Ar
tifi
Pattern

c
ial
Recognition

s
tic

Int
tis

ellig
Sta

en
ce
DATA Machine
MINING Learning

Mathematical
Modeling Databases

Management Science &

Information Systems

Source: Turban et al. (2011), Decision Support and Business Intelligence Systems 50
 Data Mining:
Core Analytics Process

The KDD Process for

Extracting Useful Knowledge
from Volumes of Data
Source: Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996). The KDD Process for Extracting Useful Knowledge from Volumes of Data.
Communications of the ACM, 39(11), 27-34. 51
Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996).
The KDD Process for
Extracting Useful Knowledge
from Volumes of Data.
Communications of the ACM, 39(11), 27-34.

52
 Data Mining
Knowledge Discovery in Databases (KDD) Process
(Fayyad et al., 1996)

Source: Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996). The KDD Process for Extracting Useful Knowledge from Volumes of Data.
Communications of the ACM, 39(11), 27-34. 53
 Knowledge Discovery (KDD) Process

Data mining: Pattern Evaluation

core of knowledge discovery process

Data Mining

Task-relevant Data

Data Warehouse Selection

Data Cleaning

Data Integration

Databases
Source: Han & Kamber (2006) 54
 Data Mining Processing Pipeline
(Charu Aggarwal, 2015)

Data Preprocessing
Analytical Processing Output
Data Cleaning
Feature Building Building for
Collection and Analyst
Extraction Integration Block 1 Block 2

Feedback (Optional)

Feedback (Optional)

Source: Charu Aggarwal (2015), Data Mining: The Textbook Hardcover, Springer 55
A Taxonomy for Data Mining Tasks
Data Mining Learning Method Popular Algorithms

Classification and Regression Trees,

Prediction Supervised
ANN, SVM, Genetic Algorithms

Decision trees, ANN/MLP, SVM, Rough

Classification Supervised
sets, Genetic Algorithms

Linear/Nonlinear Regression, Regression

Regression Supervised
trees, ANN/MLP, SVM

Association Unsupervised Apriory, OneR, ZeroR, Eclat

Link analysis Unsupervised Expectation Maximization, Apriory

Algorithm, Graph-based Matching

Sequence analysis Unsupervised Apriory Algorithm, FP-Growth technique

Clustering Unsupervised K-means, ANN/SOM

Outlier analysis Unsupervised K-means, Expectation Maximization (EM)

Source: Turban et al. (2011), Decision Support and Business Intelligence Systems 56
Cloud Computing

57
58
Google Cloud Big Data Analytics

Source: https://cloud.google.com/solutions/big-data/ 59
 Google Cloud
Machine learning and Cloud AI

Source: https://cloud.google.com/solutions/big-data/overview/machine-learning-cloud-ai/ 60
 Google Colab

https://colab.research.google.com/notebooks/welcome.ipynb 61
 Cloud Computing
AWS
Amazon Web Services

Source: https://aws.amazon.com/ 62
Data Lakes and Analytics on AWS
Data Movement
Import your data from on-premises,
and in real-time.

Data Lake
Store any type of data securely, from
gigabytes to exabytes.

Analytics
Analyze your data with a broad
selection of analytic tools and engines.

Machine Learning
Forecast future outcomes, and
prescribe actions.
Source: https://aws.amazon.com/big-data/datalakes-and-analytics/ 63
 AWS Products
Analytics
• Amazon Athena • Amazon Redshift
– Query data in S3 using SQL – Fast, simple, cost-effective data
• Amazon CloudSearch warehousing
– Managed search service • Amazon QuickSight
• Amazon EMR – Fast business analytics service
– Hosted Hadoop framework • AWS Data Pipeline
• Amazon Elasticsearch Service – Orchestration service for periodic,
data-driven workflows
– Run and scale Elasticsearch
clusters • AWS Glue
• Amazon Kinesis – Prepare and load data
– Analyze real-time video and
data streams

Source: https://aws.amazon.com/ 64
 Machine Learning on AWS
Machine learning in the hands of
every developer and data scientist

Source: https://aws.amazon.com/machine-learning/ 65
 Cloud Computing
AWS Cloud Practitioner
AWS Solutions Architect
AWS Certified Big Data Specialty

Source: https://aws.amazon.com/certification/ 66
 Summary

• AI
• Big Data
• Cloud Computing

67
 References
• Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics,
and Data Science: A Managerial Perspective, 4th Edition, Pearson.
• Jared Dean (2014), Big Data, Data Mining, and Machine Learning: Value Creation for Business
Leaders and Practitioners, Wiley.
• Mehmet Kaya, Jalal Kawash, Suheil Khoury, and Min-Yuh Day (2018), Social Network Based
Big Data Analysis and Applications, Lecture Notes in Social Networks, Springer International
Publishing.
• Varun Grover, Roger HL Chiang, Ting-Peng Liang, and Dongsong Zhang (2018), "Creating
Strategic Business Value from Big Data Analytics: A Research Framework", Journal of
Management Information Systems, 35, no. 2, pp. 388-423.
• Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big
Data analytics: A bibliometrics study”, Expert Systems with Applications, 111, no. 30, pp. 2-
10.
• Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd
Edition, Pearson International.
• Javier Mata, Ignacio de Miguel, Ramón J. Durán, Noemí Merayo, Sandeep Kumar Singh,
Admela Jukan, and Mohit Chamania (2018), "Artificial intelligence (AI) methods in optical
networks: A comprehensive survey", Optical Switching and Networking, 28, pp. 43-57
• Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision
Making, Auerbach Publications.

68