ABC China
ABC China
University
Assistant Professor
http://mail. tku.edu.tw/myday/
2018-09-26 1
(Syllabus)
(Week) (Date) (Subject/Topics)
1 2018/09/12
(Course Orientation for Practices of Business Intelligence)
2 2018/09/19
(Business Intelligence, Analytics, and Data Science)
3 2018/09/26
(ABC: AI, Big Data, and Cloud Computing)
4 2018/10/03 I
(Descriptive Analytics I: Nature of Data, Statistical Modeling,
and Visualization)
5 2018/10/10 ( ) (National Day) (Day off)
6 2018/10/17 II
(Descriptive Analytics II: Business Intelligence and
Data Warehousing)
2
(Syllabus)
(Week) (Date) (Subject/Topics)
7 2018/10/24 I
(Predictive Analytics I: Data Mining Process,
Methods, and Algorithms)
8 2018/10/31 II
(Predictive Analytics II: Text, Web, and
Social Media Analytics)
9 2018/11/07 (Midterm Project Report)
10 2018/11/14 (Midterm Exam)
11 2018/11/21
(Prescriptive Analytics: Optimization and Simulation)
12 2018/11/28
(Social Network Analysis)
3
(Syllabus)
(Week) (Date) (Subject/Topics)
13 2018/12/05
(Machine Learning and Deep Learning)
14 2018/12/12
(Natural Language Processing)
15 2018/12/19 AI
(AI Chatbots and Conversational Commerce)
16 2018/12/26
(Future Trends, Privacy and
Managerial Considerations in Analytics)
17 2019/01/02 (Final Project Presentation)
18 2019/01/09 (Final Exam)
4
Business Intelligence (BI)
1 Introduction to BI and Data Science
2 Descriptive Analytics
3 Predictive Analytics
4 Prescriptive Analytics
6 Future Trends
5
ABC:
AI,
Big Data,
Cloud Computing
6
Outline
• AI
• Big Data
• Cloud Computing
7
Business Intelligence, Analytics, and Data Science:
A Managerial Perspective, 4th Edition,
Ramesh Sharda, Dursun Delen, and Efraim Turban,
Pearson, 2017.
Source: https://www.amazon.com/Business-Intelligence-Analytics-Data-Science/dp/0134633288 8
Big Data, Data Mining, and Machine Learning: Value Creation for
Business Leaders and Practitioners,
Jared Dean,
Wiley, 2014.
Source: https://www.amazon.com/Data-Mining-Machine-Learning-Practitioners/dp/1118618041 9
Social Network Based Big Data Analysis and Applications,
Lecture Notes in Social Networks,
Mehmet Kaya, Jalal Kawash, Suheil Khoury, Min-Yuh Day,
Springer International Publishing, 2018.
Source: https://www.amazon.com/Network-Analysis-Applications-Lecture-Networks/dp/3319781952 10
with limited resources. Such decision support models were typically called operations
AI, Big Data, Cloud Computing
research (OR). The problems that were too complex to solve optimally (using linear or
nonlinear mathematical programming techniques) were tackled using heuristic methods
Decision Support Systems Enterprise/Executive IS Business Intelligence Analytics Big Data ...
Source: Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big Data analytics: A bibliometrics study”,
Expert Systems with Applications, Volume 111, 30, 2018, pp. 2-10 13
Framework for BD and BI Research
• Data Collection • Business
• Data Storage • Medicate
• Data Analytics • Supply Chain
• Infrastructure • Engineering
• Services
Technology Application
Impact Management
T
IP
CR
US
AN
M
E D
E PT
Source: Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big Data analytics: A bibliometrics study”,
Expert Systems with Applications, Volume 111, 30, 2018, pp. 2-10 15
AI 16
Definition
of
Artificial Intelligence
(A.I.)
17
Artificial Intelligence
Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 21
4 Approaches of AI
2. 3.
Thinking Humanly: Thinking Rationally:
The “Laws of Thought”
The Cognitive
Approach
Modeling Approach
1. 4.
Acting Humanly: Acting Rationally:
The Turing Test The Rational Agent
Approach (1950) Approach
Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 22
AI Acting Humanly:
The Turing Test Approach
(Alan Turing, 1950)
Source: Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd Edition, Pearson International 23
Boston Dynamics: Atlas
https://www.youtube.com/watch?v=fRj34o4hN4I 24
Humanoid Robot: Sophia
https://www.youtube.com/watch?v=S5t6K9iwcdw 25
Can a robot pass a university entrance exam?
Noriko Arai at TED2017
https://www.ted.com/talks/noriko_arai_can_a_robot_pass_a_university_entrance_exam
https://www.youtube.com/watch?v=XQZjkPyJ8KU 26
Artificial Intelligence (A.I.) Timeline
Source: https://digitalintelligencetoday.com/artificial-intelligence-timeline-infographic-from-eliza-to-tay-and-beyond/ 27
Artificial Intelligence
Machine Learning & Deep Learning
Source: https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/
28
AI, ML, DL
Artificial Intelligence (AI)
Supervised Unsupervised
Learning Learning
Deep Learning (DL)
CNN
RNN LSTM GRU
GAN
Semi-supervised Reinforcement
Learning Learning
Source: https://leonardoaraujosantos.gitbooks.io/artificial-inteligence/content/deep_learning.html 29
Artificial Intelligence (AI)
is many things
Ecosystem of AI
Source: https://www.i-scoop.eu/artificial-intelligence-cognitive-computing/ 30
Artificial Intelligence (AI)
Intelligent Document Recognition algorithms
Source: https://www.i-scoop.eu/artificial-intelligence-cognitive-computing/ 31
Deep Learning Evolution
i ng
arn
Le
ep
De
Source: http://www.erogol.com/brief-history-machine-learning/ 32
Machine Learning Models
Deep Learning Kernel
Maximum
Entropy (ME)
Reinforcement
Learning
Source: Jesus Serrano-Guerrero, Jose A. Olivas, Francisco P. Romero, and Enrique Herrera-Viedma (2015),
"Sentiment analysis: A review and comparative analysis of web services," Information Sciences, 311, pp. 18-38. 35
Big Data
36
Evolution of Business Intelligence (BI) Chapter 1 • An Overview of Business Intelligence, Analytics, and D
Querying and
ETL
reporting
OLAP
Digital cockpits
and dashboards
Business
Scorecards and Intelligence
dashboards
Workflow
Alerts and
notifications
A High-Level Architecture of BI
FIGURE 1.9 Evolution of Business Intelligence (BI).
Data Managers/executives
Technical staff Business users
Sources
Build the data warehouse Access BPM strategies
Data
- Organizing warehouse
- Summarizing Manipulation, results
- Standardizing
User interface
Future component: - Browser
Intelligent systems - Portal
- Dashboard
FIGURE 1.10 A High-Level Architecture of BI. (Source: Based on W. Eckerson, Smart Companies in the 21st
Century: The Secrets of Creating SuccessfulSource: Business Intelligent
Ramesh Sharda, Solutions.
Dursun Delen, andThe Data
Efraim Warehousing
Turban (2017), Institute, Seattle, WA,
38
2003, p. 32, Illustration Business
5.) Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson
types of analytics applications is evident. We next introduce these three levels of analytics.
Three Types of Analytics
Business Analytics
Data
Data
Management
Generation
Infrastructure
Infrastructure
Providers
Providers Regulators and
Policy Makers
Data
Analytics
Analytics- Warehouse
Analytics Industry
Focused Providers
User Analysts &
Software Organization Influencers
Developers Application
Developers:
Industry Specific Academic
or General Institutions and
Certification Middleware
Agencies Providers
Data Service
Providers
Business Process
UOB
2.2
Internet/Social Media
Data Protection
Instagram
te
rn
s End Users
Pinterest Facebook t
Test Pa
Twitter LinkedIn
Snapchat YouTube Built
Trends
Flicker Google+ Data Storage Validate
Foursqare Tumblr Analytics
Reddit Applications
Cloud Storage and Kn
ow
led
Computing ge
Machines/Internet of Things
Source: https://www-01.ibm.com/software/data/bigdata/ 44
Value
45
Stephan Kudyba (2014),
Big Data, Mining, and Analytics:
Components of Strategic Decision Making, Auerbach Publications
Source: http://www.amazon.com/gp/product/1466568704 46
Architecture of Big Data Analytics
Big Data
Big Data Big Data Big Data Analytics
Sources Transformation Platforms & Tools Applications
Middleware Queries
* Internal Hadoop
Raw Transformed MapReduce Big Data
* External Data Pig Analytics
Data Extract
Hive
Transform Reports
* Multiple Jaql
Load
formats Zookeeper
Hbase
* Multiple Data Cassandra OLAP
locations Warehouse Oozie
Avro
* Multiple Traditional Mahout
applications Format Others Data
CSV, Tables Mining
Source: Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision Making, Auerbach Publications 47
Architecture of Big Data Analytics
Big Data
Big Data Big Data Big Data Analytics
Sources Transformation Platforms & Tools Applications
* Internal
* External Raw
Data Mining
Middleware
Data
Hadoop
Transformed MapReduce
Pig
Big Data
Analytics
Queries
Big Data
Data Extract
Hive
Transform Reports
* Multiple Jaql
Load
formats Zookeeper
Hbase
Analytics
* Multiple Data Cassandra OLAP
locations Warehouse Oozie
Avro
* Multiple Traditional Mahout
Applications
applications Format Others Data
CSV, Tables Mining
Source: Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision Making, Auerbach Publications 48
Social Big Data Mining
(Hiroshi Ishikawa, 2015)
Source: http://www.amazon.com/Social-Data-Mining-Hiroshi-Ishikawa/dp/149871093X 49
Architecture for
Social Big Data Mining
(Hiroshi Ishikawa, 2015)
Enabling Technologies Analysts
• Integrated analysis model • Model Construction
Integrated analysis • Explanation by Model
Conceptual Layer
• Construction and
• Natural Language Processing confirmation
• Information Extraction Data
of individual
• Anomaly Detection Mining hypothesis
• Discovery of relationships • Description and
Multivariate Application
among heterogeneous data execution of
analysis specific task
• Large-scale visualization application-specific
Logical Layer task
Hardware
Physical Layer
Source: Hiroshi Ishikawa (2015), Social Big Data Mining, CRC Press 50
Business Intelligence (BI) Infrastructure
Source: Kenneth C. Laudon & Jane P. Laudon (2014), Management Information Systems: Managing the Digital Firm, Thirteenth Edition, Pearson. 51
Business Intelligence and Data Mining
Increasing potential
to support
business decisions End User
Decision
Making
Data Exploration
Statistical Summary, Querying, and Reporting
Ar
Pattern
tifi
c
Recognition
ial
s
tic
Int
tis
ellig
Sta
en
ce
DATA Machine
MINING Learning
Mathematical
Modeling Databases
Source: Turban et al. (2011), Decision Support and Business Intelligence Systems 53
Data Mining:
Core Analytics Process
55
Data Mining
Knowledge Discovery in Databases (KDD) Process
(Fayyad et al., 1996)
Source: Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996). The KDD Process for Extracting Useful Knowledge from Volumes of Data.
Communications of the ACM, 39(11), 27-34. 56
Knowledge Discovery (KDD) Process
Data Mining
Task-relevant Data
Data Cleaning
Data Integration
Databases
Source: Han & Kamber (2006) 57
Data Mining Processing Pipeline
(Charu Aggarwal, 2015)
Data Preprocessing
Analytical Processing Output
Data Cleaning
Feature Building Building for
Collection and Analyst
Extraction Integration Block 1 Block 2
Feedback (Optional)
Feedback (Optional)
Source: Charu Aggarwal (2015), Data Mining: The Textbook Hardcover, Springer 58
A Taxonomy for Data Mining Tasks
Data Mining Learning Method Popular Algorithms
Source: Turban et al. (2011), Decision Support and Business Intelligence Systems 59
Cloud Computing
60
61
Google Cloud Big Data Analytics
Source: https://cloud.google.com/solutions/big-data/ 62
Google Cloud
Machine learning and Cloud AI
Source: https://cloud.google.com/solutions/big-data/overview/machine-learning-cloud-ai/ 63
Google Colab
https://colab.research.google.com/notebooks/welcome.ipynb 64
Cloud Computing
AWS
Amazon Web Services
Source: https://aws.amazon.com/ 65
Data Lakes and Analytics on AWS
Data Movement
Import your data from on-premises,
and in real-time.
Data Lake
Store any type of data securely, from
gigabytes to exabytes.
Analytics
Analyze your data with a broad
selection of analytic tools and engines.
Machine Learning
Forecast future outcomes, and
prescribe actions.
Source: https://aws.amazon.com/big-data/datalakes-and-analytics/ 66
AWS Products
Analytics
• Amazon Athena • Amazon Redshift
– Query data in S3 using SQL – Fast, simple, cost-effective data
• Amazon CloudSearch warehousing
– Managed search service • Amazon QuickSight
• Amazon EMR – Fast business analytics service
– Hosted Hadoop framework • AWS Data Pipeline
• Amazon Elasticsearch Service – Orchestration service for periodic,
data-driven workflows
– Run and scale Elasticsearch
clusters • AWS Glue
• Amazon Kinesis – Prepare and load data
– Analyze real-time video and
data streams
Source: https://aws.amazon.com/ 67
Machine Learning on AWS
Machine learning in the hands of
every developer and data scientist
Source: https://aws.amazon.com/machine-learning/ 68
Cloud Computing
AWS Cloud Practitioner
AWS Solutions Architect
AWS Certified Big Data Specialty
Source: https://aws.amazon.com/certification/ 69
Summary
• AI
• Big Data
• Cloud Computing
70
References
• Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics,
and Data Science: A Managerial Perspective, 4th Edition, Pearson.
• Jared Dean (2014), Big Data, Data Mining, and Machine Learning: Value Creation for Business
Leaders and Practitioners, Wiley.
• Mehmet Kaya, Jalal Kawash, Suheil Khoury, and Min-Yuh Day (2018), Social Network Based
Big Data Analysis and Applications, Lecture Notes in Social Networks, Springer International
Publishing.
• Varun Grover, Roger HL Chiang, Ting-Peng Liang, and Dongsong Zhang (2018), "Creating
Strategic Business Value from Big Data Analytics: A Research Framework", Journal of
Management Information Systems, 35, no. 2, pp. 388-423.
• Ting-Peng Liang and Yu-Hsi Liu (2018), "Research Landscape of Business Intelligence and Big
Data analytics: A bibliometrics study”, Expert Systems with Applications, 111, no. 30, pp. 2-
10.
• Stuart Russell and Peter Norvig (2016) , Artificial Intelligence: A Modern Approach, 3rd
Edition, Pearson International.
• Javier Mata, Ignacio de Miguel, Ramón J. Durán, Noemí Merayo, Sandeep Kumar Singh,
Admela Jukan, and Mohit Chamania (2018), "Artificial intelligence (AI) methods in optical
networks: A comprehensive survey", Optical Switching and Networking, 28, pp. 43-57
• Stephan Kudyba (2014), Big Data, Mining, and Analytics: Components of Strategic Decision
Making, Auerbach Publications.
71