PROF ANIL KUMAR

INTRODUCTION TO
MACHINE LEARNING
• Machine Learning is used anywhere from automating
mundane tasks to offering intelligent insights, industries in
every sector try to benefit from it.
• You may already be using a device that utilizes it.
• For example, a wearable fitness tracker like Fitbit, or
• an intelligent home assistant like Google Home.

• But there are much more examples of ML in use.

 INTRODUCTION TO
MACHINE LEARNING
• Machine Learning is getting computers to
program themselves.
• If programming is automation, then machine learning
is automating the process of automation.

• Machine learning is the way to make

programming scalable.
• Traditional Programming: Data and program is
run on the computer to produce the output.
• Machine Learning: Data and output is run on the
computer to create a program. This program can be
used in traditional programming.
 WHAT IS MACHINE LEARNING

• According to Arthur Samuel, Machine Learning algorithms enable

the computers to learn from data, and even improve themselves,
without being explicitly programmed.
• Machine learning (ML) is a category of an algorithm that allows
software applications to become more accurate in predicting
outcomes without being explicitly programmed.
• The basic premise of machine learning is to build algorithms that can
receive input data and use statistical analysis to predict an output
while updating outputs as new data becomes available.
 APPLICATIONS OF MACHINE LEARNING

Sample applications of machine learning:

• Web search: ranking page based on what you are most likely to click
on.
• Computational biology: rational design drugs in the computer based on
past experiments.
• Finance: decide who to send what credit card offers to. Evaluation of
risk on credit offers. How to decide where to invest money.
• E-commerce: Predicting customer churn. Whether or not a transaction
is fraudulent.
 APPLICATIONS OF MACHINE LEARNING

Sample applications of machine learning:

• Space exploration: space probes and radio astronomy.
• Robotics: how to handle uncertainty in new environments. Autonomous. Self-
driving car.
• Information extraction: Ask questions over databases across the web.
• Social networks: Data on relationships and preferences. Machine learning to
extract value from data.
• Debugging: Use in computer science problems like debugging. Labor intensive
process. Could suggest where the bug could be.
A QUICK HISTORY OF MACHINE LEARNING
TYPES OF MACHINE LEARNING?

• Machine learning can be classified into 3 types of

algorithms.
• Supervised Learning
• Unsupervised Learning
• Reinforcement Learning
TYPES OF MACHINE LEARNING?
 SUPERVISED LEARNING

In Supervised learning, an AI system is presented with data

which is labeled, which means that each data tagged with the
correct label.
• Labeled data means where the answer is already known. So here our system
learn by predicting the value. Then it does an accuracy check by using a cost
function, to check how close the prediction was to actual output.

• The goal is to approximate the mapping function so well that when you have
new input data (x) that you can predict the output variables (Y) for that data.

• It is called supervised — because there is a teacher or supervisor.

SUPERVISED LEARNING ALGORITHMS
 SUPERVISED LEARNING

• Classification: A classification problem is when

the output variable is a category, such as “red” or
“blue” or “disease” and “no disease”.
• Example: Suppose from the train data you come to know that
your best friend like some of the movies. Now one new
movie (test data) released. Now you want to know your best
friend like it or not. Here the output which you are expecting
will either be Yes or No so we will use Classification.
SUPERVISED LEARNING:
CLASSIFICATION

• Example: we have initially taken

some data and marked them as
‘Spam’ or ‘Not Spam’. This
labeled data is used by the
training supervised model, this
data is used to train the model.
• Once it is trained we can test
our model by testing it with
some test new mails and
checking of the model is able to
predict the right output.
OTHER APPLICATIONS USING
CLASSIFICATION
• In finance and banking for credit card fraud detection
(fraud, not fraud).
• In the marketing area used for text sentiment analysis
(happy, not happy).
• In medicine, for predicting whether a patient has a
particular disease or not
 SUPERVISED LEARNING:
REGRESSION
• Regression: A regression problem is when the
output variable is a real value, such as “dollars” or
“weight”.
• Suppose from the data you come to know that your best
friend like some of the movies. You also know how many
times each particular movie seen by your friend. Now one
new movie (test data) released. Now you are going to find
how many times this newly released movie will your friend
watch. It could be 5 times, 6 times,10 times so here we will
use Regression.
OTHER APPLICATIONS USING
REGRESSION
• Predicting house/property price
• Predicting stock market price
OTHER ALGORITHMS FOR SUPERVISED

• Decision Trees
• K Nearest Neighbours
• Linear SVC (Support vector Classifier)
• Logistic Regression
• Naive Bayes
• Neural Networks
• Linear Regression
• Support Vector Regression (SVR)
• Regression Trees
 UNSUPERVISED LEARNING

• In unsupervised learning, an AI system is presented with unlabeled,

uncategorized data and the system’s algorithms act on the data without
prior training.
• In this, the result is not known, we approach with little or No knowledge
of what the result would be, the machine is expected to find the hidden
patterns and structure in un-labelled data on their own.
• That’s why it is called unsupervised — there is no supervisor to teach the
machine.
• The output is dependent upon the coded algorithms. Subjecting a system
to unsupervised learning is one way of testing AI.
UNSUPERVISED LEARNING

• Example, we have given some

characters to our model which
are ‘Ducks’ and ‘Not Ducks’.
• In our training data, we don’t
provide any label to the
corresponding data.
• The unsupervised model is able
to separate both the characters
by looking at the type of data and
models the underlying structure
or distribution in the data in
order to learn more about it.
 UNSUPERVISED LEARNING:
CLUSTERING
• Clustering: A clustering problem is where you want to discover the
inherent groupings in the data, such as grouping customers by purchasing
behavior.
• Clustering means segregating or dividing a data set into a number of
groups such that data set in the same groups are more similar than those
in other groups. In simple words, the aim is to separate groups with
similar traits and assign them into clusters.
• Example. Suppose, you are the head of a rental store and wish to
understand the preferences of your customers to scale up your business.
What you can do is to cluster all of your customers into 10 groups based
on their purchasing habits and use a separate strategy for customers in
each of these 10 groups.
 UNSUPERVISED LEARNING:
ASSOCIATION
• Association: An association rule learning problem is where you
want to discover rules that describe large portions of your data,
such as people that buy X also tend to buy Y.
• Association is about discovering some interesting relationships
between variables in large databases.
• For example, people that buy a new house also tend to buy new
furniture. It discovers the probability of the co-occurrence of items
in a collection.
OTHER ALGORITHMS FOR UNSUPERVISED

• K-means clustering
• Dimensionality Reduction
• Neural networks / Deep Learning
• Principal Component Analysis
• Singular Value Decomposition
• Independent Component Analysis
• Distribution models
• Hierarchical clustering
 APPLICATIONS OF UNSUPERVISED

• In marketing segmentation, when a company wants to segment its

customers to better adjust products and offerings.
• Social network analysis.
• Image Segmentation.
• Google news.
REINFORCEMENT LEARNING

A reinforcement learning algorithm, or agent, learns by

interacting with its environment.
• The agent receives rewards by performing correctly
and penalties for performing incorrectly.
• The agent learns without intervention from a human by
maximizing its reward and minimizing its penalty. It is a
type of dynamic programming that trains algorithms
using a system of reward and punishment.
REINFORCEMENT LEARNING

• Example, we can see that the agent is

given 2 options i.e. a path with water
or a path with fire.
• A reinforcement algorithm works on
reward a system i.e. if the agent uses
the fire path then the rewards are
subtracted and agent tries to learn
that it should avoid the fire path.
• If it had chosen the water path or
the safe path then some points
would have been added to the
reward points, the agent then would
try to learn what path is safe and
what path isn’t.