UET

Since 2004

ĐẠI HỌC CÔNG NGHỆ, ĐHQGHN

VNU-University of Engineering and Technology

INT3405E - Machine Learning

Lecture 1: Introduction to ML

Hanoi, 08/2023
 Outline
● Motivating Examples
● Introduction to Machine Learning
● Statistics vs Machine Learning
● Machine Learning vs Deep Learning
● Applications of Machine Learning
● Types of Machine Learning
○ Supervised Learning
○ Unsupervised Learning
○ Reinforcement Learning

FIT-CS INT3405 - Machine Learning 2

 Amazon robot

See more: https://www.youtube.com/watch?v=HSA5Bq-1fU4

FIT-CS INT3405E - Machine Learning 3

 Harvesting Robot

See more: https://www.youtube.com/watch?v=5chk9Sory88

FIT-CS INT3405E - Machine Learning 4

 Automatic Driving - Tesla

See more: https://www.youtube.com/watch?v=tlThdr3O5Qo

FIT-CS INT3405E - Machine Learning 5

 ChatGPT

FIT-CS INT3405E - Machine Learning 6

 GPT-3 Applications

https://www.youtube.com/watch?v=_x9AwxfjxvE

FIT-CS INT3405E - Machine Learning 7

 Google Translate

https://ai.googleblog.com/2016/09/a-neural-network-for-machine.html

FIT-CS INT3405E - Machine Learning 8

 Google Assistant

FIT-CS INT3405E - Machine Learning 9

 Youtube

FIT-CS INT3405E - Machine Learning 10

 What is Machine Learning?

FIT-CS INT3405E - Machine Learning 11

 Formal Definition of Machine Learning (ML)
• Arthur Samuel, 1959: Field of study that gives
computers the ability to learn without being
explicitly programmed.

• Tom Mitchell, 1997: Any computer program that

improves its performance at some task through
experience.

• Kevin Murphy, 2012: To develop methods that can

automatically detect patterns in data, and then to
use the uncovered patterns to predict future data or
other outcomes of interest.

FIT-CS INT3405E - Machine Learning 12

 Formal Definition of Machine Learning (ML)

Machine learning is an application of

artificial intelligence (AI) that provides
systems the ability to automatically
learn and improve from experience
without being explicitly programmed.

Machine learning focuses on the

development of computer programs
that can access data and use it learn
for themselves.
https://www.expertsystem.com/machine-learning-definition/

FIT-CS INT3405E - Machine Learning 13

 Traditional Programming vs Machine Learning?

Source:https://images.techhive.com/images/article/2017/05/traditional-programming-vs-machine-learning-100723299-large.jpg

FIT-CS INT3405E - Machine Learning 14

 Statistics vs Machine Learning?

Source: https://pythonprogramminglanguage.com/what-is-the-difference-between-statistics-and-machine-learning/

FIT-CS INT3405E - Machine Learning 15

 Machine Learning vs. Deep Learning?

Source: https://www.linkedin.com/pulse/lets-understand-difference-between-machine-learning-vs-gauri-bapat

FIT-CS INT3405E - Machine Learning 16

 Machine Learning vs. Deep Learning vs AI?

Source: https://www.ibm.com/blogs/systems/ai-machine-learning-and-deep-learning-whats-the-difference/

FIT-CS INT3405E - Machine Learning 17

 Why Machine Learning?

https://www.striim.com/blog/real-time-data-striim-helps-prepare-for-growth/

FIT-CS INT3405E - Machine Learning 18

 How Much Data Every Minute?

Data never sleeps

Source: https://dailyinfographic.com/how-much-data-is-generated-
every-minute

FIT-CS INT3405E - Machine Learning 19

 Applications of Machine Learning

Source: https://www.quantinsti.com/blog/machine-learning-basics

FIT-CS INT3405E - Machine Learning 20

 Applications of Machine Learning: Examples

Image retrieval

FIT-CS INT3405E - Machine Learning 21

 A Brief History

Source: https://i0.wp.com/www.marketcalls.in/wp-content/uploads/2024/01/Evolution-of-Machine-
Learning-Infographic-since-1800.png?ssl=1

FIT-CS INT3405E - Machine Learning 22

 Types of Machine Learning

Source: https://medium.com/marketing-
and-entrepreneurship/10-companies-
using-machine-learning-in-cool-ways-
887c25f913c3

FIT-CS INT3405E - Machine Learning 23

 Supervised Learning

FIT-CS INT3405E - Machine Learning 24

 Classification

FIT-CS INT3405E - Machine Learning 25

 Classification: Classifying Flowers

FIT-CS INT3405E - Machine Learning 26

 Classification: Emotion Detection

• Anger
• Disgust
• Fear
• Happiness
• Neutral
• Sadness
• Surprise
https://www.freecodecamp.org/news/facial-emotion-recognition-develop-a-c-n-n-and-break-into-kaggle-top-10-f618c024faa7/

FIT-CS INT3405E - Machine Learning 27

 Regression

FIT-CS INT3405E - Machine Learning 28

 Unsupervised Learning

FIT-CS INT3405E - Machine Learning 29

 Clustering
• Clusters:
– subgroups or subpopulations
in the data

• Goals:
– Discovering the subgroups
– Estimating which subgroup a
data point belongs to

https://i2.wp.com/techielobang.com/blog/wp-content/uploads/2014/01/best-school-happiest-kids.jpg

FIT-CS INT3405E - Machine Learning 30

 Clustering: MNIST Handwritten Digits

”The original black and white (bilevel)

images from NIST were size
normalized to fit in a 20x20 pixel box
while preserving their aspect ratio. The
resulting images contain grey levels as
a result of the anti-aliasing technique
used by the normalization algorithm.
the images were centered in a 28x28
image by computing the center of mass
of the pixels, and translating the image
so as to position this point at the center
of the 28x28 field.”
Source: http://yann.lecun.com/exdb/mnist/

Source: http://lvdmaaten.github.io/tsne/examples/mnist_tsne.jpg

FIT-CS INT3405E - Machine Learning 31

 Curse of Dimensionality

FIT-CS INT3405E - Machine Learning 32

 Occam's Razor Principle

Occam’s Razor is a principle that likes

simplicity. It says that the simplest
solution is usually the best one. In machine
learning, this means that if we have two
models that work about as well as each
other, we should choose the simpler one.

FIT-CS INT3405E - Machine Learning 33

 Dimensionality Reduction

Projecting the data to a

lower-dimensional subspace
that captures the “essence”
of the data

Source:
https://www.flickr.com/photos/digitalanthill/4617998281/

FIT-CS INT3405E - Machine Learning 34

 Dimensionality Reduction: Olivetti Faces

”There are ten different images of each

of 40 distinct subjects. For some
subjects, the images were taken at
different times, varying the lighting,
facial expressions (open / closed eyes,
smiling / not smiling) and facial details
(glasses / no glasses). All the images
were taken against a dark
homogeneous background with the
subjects in an upright, frontal position
(with tolerance for some side
movement).”
Source:
Source:
https://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html
http://lvdmaaten.github.io/tsne/examples/olivetti_tsne.jpg

FIT-CS INT3405E - Machine Learning 35

 Markov Decision Process

Markov decision process (MDP) is a

discrete-time stochastic control
process. It provides a mathematical
framework for modeling decision
making in situations where
outcomes are partly random and
partly under the control of a
decision maker
Source: https://en.wikipedia.org/wiki/Markov_decision_process

FIT-CS INT3405E - Machine Learning 36

 Reinforcement Learning

Reinforcement learning (RL) is an

area of machine learning concerned
with how intelligent agents ought to
take actions in an environment in
order to maximize the notion of
cumulative reward

Source: https://en.wikipedia.org/wiki/Reinforcement_learning

FIT-CS INT3405E - Machine Learning 37

 Reinforcement Learning vs Traditional Learning

Source: https://www.mathworks.com/discovery/reinforcement-
learning.html

FIT-CS INT3405E - Machine Learning 38

 Summary

● Introduction to Machine Learning

● Statistics vs Machine Learning
● Machine Learning vs Deep Learning
● Applications of Machine Learning
● Types of Machine Learning
○ Supervised Learning
○ Unsupervised Learning
○ Reinforcement Learning

FIT-CS INT3405E - Machine Learning 39

UET
Since 2004

ĐẠI HỌC CÔNG NGHỆ, ĐHQGHN

VNU-University of Engineering and Technology

Q&A
UET
Since 2004

ĐẠI HỌC CÔNG NGHỆ, ĐHQGHN

VNU-University of Engineering and Technology

https://zalo.me/g/vtvcun868
Link join zalo group cua lop INT 3405E 57