0% found this document useful (0 votes)
5 views

Machine and Deep Learning Intro

The document provides an introduction to Machine Learning (ML) and Deep Learning, explaining their definitions, types of learning, and the machine learning process. It outlines various learning types such as classification, regression, and reinforcement learning, and discusses the iterative nature of algorithms that improve through experience. Additionally, it highlights the significance of deep learning and its applications, as well as the growing investment in AI technologies.

Uploaded by

gaxosiw600
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
5 views

Machine and Deep Learning Intro

The document provides an introduction to Machine Learning (ML) and Deep Learning, explaining their definitions, types of learning, and the machine learning process. It outlines various learning types such as classification, regression, and reinforcement learning, and discusses the iterative nature of algorithms that improve through experience. Additionally, it highlights the significance of deep learning and its applications, as well as the growing investment in AI technologies.

Uploaded by

gaxosiw600
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 36

Introduction to

Machine Learning and


Deep Learning

MDT903: AI Practitioner
What is Machine Learning (ML)? How is it different than
Statistics and Data Mining?
Machine Learning is the branch of Computer Science (Artificial
Intelligence in particular) that studies systems that learn.
Systems that learn = systems that improve their performance with
experience

2
Types of Learning: Output
• Classification
– Binary, multi‐class, multi‐label, hierarchical, etc.
• Classify email as spam vs. ham
• Loss: accuracy
• Ranking
– Order examples by preference
• Rank results of web search
• Loss: Swapped pairs
• Regression
– Real‐valued output
• Predict the price of tomorrow’s stock price
• Loss: Squared loss
• Structured prediction
– Sequences, trees, segmentation
• Find faces in an image
• Loss: Precision/Recall of faces
3
Types of Learning: Output
• Classification
• Binary, multi‐class, multi‐label, hierarchical, etc.
• Classify email as spam vs. ham
• Loss: accuracy
• Ranking
• Order examples by preference
• Rank results of web search
• Loss: Swapped pairs
• Regression
• Real‐valued output
• Predict the price of tomorrow’s stock price
• Loss: Squared loss
• Structured prediction
• Sequences, trees, segmentation
• Find faces in an image
• Loss: Precision/Recall of faces 5
Types of learning
• Unsupervised Learning
• Supervised learning
• Reinforcement learning
• Deep Learning
• Transfer learning
• Generative AI

6
What is the Machine learning Process
• The basic concept of machine learning in data science involves using statistical
learning and optimization methods that let computers analyze datasets and
identify patterns Machine learning techniques leverage data mining to identify
historic trends and inform future models.
• The typical supervised machine learning algorithm consists of roughly three
components:
1.A decision process: A recipe of calculations or other steps that takes in the data
and “guesses” what kind of pattern your algorithm is looking to find.
2.An error function: A method of measuring how good the guess was by comparing
it to known examples (when they are available). Did the decision process get it
right? If not, how do you quantify “how bad” the miss was?
3.An updating or optimization process: A method in which the algorithm looks at
the miss and then updates how the decision process comes to the final decision,
so next time the miss won’t be as great.
(view a visual of machine learning via R2D3External: http://www.r2d3.us/visual‐intro‐to‐machine‐learning‐part‐1/
7
Machine Learning a Simple Example
• For example, if you’re building a movie recommendation system, you can provide
information about yourself and your watch history as input.
• The algorithm will take that input and learn how to return an accurate output:
movies you will enjoy.
• Some inputs could be movies you watched and rated highly, the percentage of
movies you’ve seen that are comedies, or how many movies feature a particular
actor.
• The algorithm’s job is to find these parameters and assign weights to them. If the
algorithm gets it right, the weights it used stay the same. If it gets a movie wrong,
the weights that led to the wrong decision get turned down so it doesn’t make
that kind of mistake again.
• Since a machine learning algorithm updates autonomously, the analytical
accuracy improves with each run as it teaches itself from the data it analyzes. This
iterative nature of learning is both unique and valuable because it occurs without
human intervention — empowering the algorithm to uncover hidden insights
without being specifically programmed to do so.
8
The process

9
Machine Learning Models (supervised Learning)
• Regression
• Decision Tree
• SVM
• Random Forest
• XGBoost
• Neural Networks
• Deep Learning (Convolutional Neural Networks)

10
What is Deep Learning?

• Deep learning allows computational models that are composed of multiple


processing layers to learn representations of data with multiple levels of
abstraction.
• Deep Learning by Y. LeCun et al. Nature 2015

11
Feature Engineering

12
Feature Engineering

13
14
15
16
17
18
19
20
21
22
Neurons in Brain
The Neuron ‐ A Biological Information
Processor
• dentrites ‐ the receivers
• soma ‐ neuron cell body (sums input
signals)
• axon ‐ the transmitter
• synapse ‐ point of transmission
• neuron activates after a certain threshold
is met
Learning occurs via electro‐chemical
changes in effectiveness of synaptic
junction.

23
A Perceptron: Artificial Neuron
Perceptrons were
developed in the
1950s and 1960s by
the scientist Frank
Rosenblatt,
Inspired by earlier
work by Warren
McCulloch and
Walter Pitts
A perceptron takes
several binary inputs
and produces a single
binary output
25
26
27
28
29
30
Convolution
with filter
Fully Connected
Convolution layer

31
32
33
Investors have put more than $4.2
billion into generative AI start‐ups
in 2021 and 2022 through 215
deals after interest surged in 2019,
recent data from CB Insights
showed.

Globally, AI investments are


projected to hit $200 billion by
2025 and could possibly have a
bigger impact on gross domestic
product, Goldman Sachs Economic
Research said in a report in
August.
34
35
References
• Many slides was borrowed from Dr Y. LeCun’s Lecture on Introduction
to Deep Learning.

36

You might also like