Scribd
Upload
41 views

Support Vector Machine

Support Vector Machine (SVM) is a supervised machine learning algorithm used for classification and regression analysis. It works by finding the optimal separation hyperplane that distinguishes data points of one class from another. The hyperplane is chosen such that it has the largest distance from the nearest data points of any class. These nearest data points are called support vectors, and they help define the hyperplane. SVM can perform linear classification for linearly separable data using a linear kernel or nonlinear classification for nonlinearly separable data using kernels like polynomial or radial basis function.

Uploaded by

Mukesh Gautam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
41 views

Support Vector Machine

Support Vector Machine (SVM) is a supervised machine learning algorithm used for classification and regression analysis. It works by finding the optimal separation hyperplane that distinguishes data points of one class from another. The hyperplane is chosen such that it has the largest distance from the nearest data points of any class. These nearest data points are called support vectors, and they help define the hyperplane. SVM can perform linear classification for linearly separable data using a linear kernel or nonlinear classification for nonlinearly separable data using kernels like polynomial or radial basis function.

Uploaded by

Mukesh Gautam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 8

Support Vector Machine

 SVM is one of the most popular Supervised Learning algorithms, which is


used for Classification as well as Regression problems. However, primarily,
it is used for Classification problems in Machine Learning.

 The goal of the SVM algorithm is to create the best line or decision
boundary that can segregate n-dimensional space into classes so that we can
easily put the new data point in the correct category in the future.

 This best decision boundary is called a hyperplane.

 SVM chooses the extreme points/vectors that help in creating the


hyperplane. These extreme cases are called as support vectors, and hence
algorithm is termed as Support Vector Machine.
Consider the below diagram in which there are two different categories that are
classified using a decision boundary or hyperplane:
Types of SVM
SVM can be of two types:
 Linear SVM: Linear SVM is used for linearly separable data,
which means if a dataset can be classified into two classes by
using a single straight line, then such data is termed as linearly
separable data, and classifier is used called as Linear SVM
classifier.
 Non-linear SVM: Non-Linear SVM is used for non-linearly
separated data, which means if a dataset cannot be classified by
using a straight line, then such data is termed as non-linear data
and classifier used is called as Non-linear SVM classifier.
 There can be multiple lines/decision boundaries to segregate the
classes in n-dimensional space, but we need to find out the best
decision boundary that helps to classify the data points.

 This best boundary is known as the hyperplane of SVM.

 The dimensions of the hyperplane depend on the features present


in the dataset, which means if there are 2 features (as shown in
image), then hyperplane will be a straight line. And if there are 3
features, then hyperplane will be a 2-dimension plane.

 We always create a hyperplane that has a maximum margin,


which means the maximum distance between the data points.
How does SVM works?
 The working of the SVM algorithm can be understood by using an example. Suppose
we have a dataset that has two tags (green and blue), and the dataset has two
features x1 and x2. We want a classifier that can classify the pair(x1, x2) of
coordinates in either green or blue. Consider the below image:

So as it is 2-d space so by just


using a straight line, we can
easily separate these two
classes. But there can be
multiple lines that can
separate these classes.
 Hence, the SVM algorithm helps to find the best line or decision boundary;
this best boundary or region is called as a hyperplane.
 SVM algorithm finds the closest point of the lines from both the classes. These
points are called support vectors.
 The distance between the vectors and the hyperplane is called as margin. And
the goal of SVM is to maximize this margin.
 The hyperplane with maximum margin is called the optimal hyperplane.
Non-Linear SVM:

You might also like