Module1_Lecture4
Module1_Lecture4
1. Supervised Learning
2. Unsupervised Learning
3. Reinforcement Learning
SUPERVISED LEARNING
In this type of machine learning algorithm,
Supervised Learning is the most popular paradigm for performing ML operations. It
is widely used for data where there is a precise mapping between Input-Output data.
The training data set is a labelled data set. i.e., the algorithm identifies the features
explicitly and carries out predictions or classification accordingly.
In other words, the training data set contains the input value (X) and target value
(Y).
The learning algorithm generates a model.
Then, new data set (testing data) consisting of only the input value is fed.
The model then generates the target value based on its learning.
Diagram:
Example:
Consider a sample database consisting of two columns where-
The first column specifies mails.
The second column specifies whether those emails are spam or not.
In this training data set, emails categorized as spam or not are done by a
supervisor’s knowledge.
So, it is supervised learning algorithm.
Mail-1 Yes
Mail-2 No
Mail-3 No
Mail-4 No
Real-Life Examples
Spam Filtering
House Price Prediction
Credit Scoring (high risk or a low-risk customer while lending loans by the
banks)
Face Recognition etc
Types of Supervised Machine Learning
There are two types of supervised learning algorithm-
1. Regression
2. Classification
Regression
The target variable (Y) has continuous value or real value. (like rupees,
height….)
Example- house price prediction, Risk assessment, Score prediction etc….
Classification
The target variable (Y) has discrete values or category or a group such as Yes or
No, 0 or 1, black and white, spam or no spam and many more.
Example- Credit Scoring, Email Spam Filtering, Image classification, Fraud
detection, Diagnostics etc….
UNSUPERVISED LEARNING
Unsupervised learning is a learning method in which a machine learns without any
supervision.
The training is provided to the machine with the set of data that has not been
labelled, classified, or categorized, and the algorithm needs to act on that data
without any supervision.
In this type of machine learning algorithm,
The training data set is an unlabelled data set.
In other words, the training data set contains only the input value (X) and not the
target value (Y).
Based on the similarity between data, it tries to draw inference from the data such as
finding patterns or clusters.
Diagram
Diagram
Real-Life Applications
Document Clustering
Finding fraudulent transactions
DNA patterns to analyse evolutionary biology.
Customer segmentation, or understanding different customer groups around
which to build marketing or other business strategies.
Types of Unsupervised Machine Learning
Unsupervised Learning can be further classified into two types, which are given
below:
1. Clustering
2. Association
Clustering
Clustering where you want to discover the inherent groupings in the data.
Ex: grouping customers based on their purchasing behaviour
Association
Association where you want to discover rules that describes large portions of
your data.
Ex: people that buy X also tend to buy Y
REINFORCEMENT LEARNING
Reinforcement learning is a feedback-based learning method, in which a learning
agent gets a reward for each right action and gets a penalty for each wrong action.
The agent learns automatically with these feedbacks and improves its performance.
In reinforcement learning, the agent interacts with the environment and explores it.
The goal of an agent is to get the most reward points, and hence, it improves its
performance.
The agent acts in an environment in order to maximize the rewards and minimize the
penalty.
Follow trial and error method to solve the problem.
Unlike supervised learning, no data is provided to the agent.
The agent itself takes action or sequence of actions whether right or wrong to
perform a task and learn from the experience.
Popular algorithms are Q-learning and SARSA.
Diagram
Example
You can see a dog and a master. Let’s imagine you are training your dog to get the
stick. Each time the dog gets a stick successfully, you offered him a feast (a bone
let’s say). Eventually, the dog understands the pattern, that whenever the master
throws a stick, it should get it as early as it can to gain a reward (a bone) from a
master in a lesser time.
Real-life Applications
Game Playing
Robot Navigation
Self-driving cars.