Scribd
Upload
2 views8 pages

Logistics Regression

Logistic regression is a supervised learning algorithm used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It differs from linear regression by fitting an 'S' shaped logistic function and is applicable for classification problems. The method includes assumptions about the data, types of logistic regression (binomial, multinomial, ordinal), and steps for implementation in Python.

Uploaded by

zzvnqe
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
2 views8 pages

Logistics Regression

Logistic regression is a supervised learning algorithm used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It differs from linear regression by fitting an 'S' shaped logistic function and is applicable for classification problems. The method includes assumptions about the data, types of logistic regression (binomial, multinomial, ordinal), and steps for implementation in Python.

Uploaded by

zzvnqe
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

Logistic Regression

Logistic Regression in Machine Learning


Logistic regression is one of the most popular Machine Learning algorithms, which comes under the Supervised Learning technique. It is used
for predicting the categorical dependent variable using a given set of independent variables.

● Logistic regression predicts the output of a categorical dependent variable. Therefore the outcome must be a categorical or discrete
value. It can be either Yes or No, 0 or 1, true or False, etc. but instead of giving the exact value as 0 and 1, it gives the probabilistic
values which lie between 0 and 1.
● Logistic Regression is much similar to the Linear Regression except that how they are used. Linear Regression is used for solving
Regression problems, whereas Logistic regression is used for solving the classification problems.
● In Logistic regression, instead of fitting a regression line, we fit an "S" shaped logistic function, which predicts two maximum values (0
or 1).
● The curve from the logistic function indicates the likelihood of something such as whether the cells are cancerous or not, etc.
● Logistic Regression is a significant machine learning algorithm because it has the ability to provide probabilities and classify new data
using continuous and discrete datasets.
● Logistic Regression can be used to classify the observations using different types of data and can easily determine the most effective
variables used for the classification.
Logistic Function
Logistic Function (Sigmoid Function):

● The sigmoid function is a mathematical function used to map the predicted values
to probabilities.
● It maps any real value into another value within a range of 0 and 1.
● The value of the logistic regression must be between 0 and 1, which cannot go
beyond this limit, so it forms a curve like the "S" form. The S-form curve is called
the Sigmoid function or the logistic function.
● In logistic regression, we use the concept of the threshold value, which defines the
probability of either 0 or 1. Such as values above the threshold value tends to 1,
and a value below the threshold values tends to 0.
Assumptions for Logistic Regression:

● The dependent variable must be categorical in nature.


● The independent variable should not have multi-collinearity.
● No Outliers
● Large Dataset Size
Logistic Regression Equation:

The Logistic regression equation can be obtained from the Linear Regression equation. The mathematical steps to get Logistic
Regression equations are given below:

● We know the equation of the straight line can be written as:

● In Logistic Regression y can be between 0 and 1 only, so for this let's divide the above equation by (1-y):

● But if we need range between -[infinity] to +[infinity], then take logarithm of the equation it will become:
Type of Logistic Regression:

On the basis of the categories, Logistic Regression can be classified into three types:

● Binomial: In binomial Logistic regression, there can be only two possible types of the
dependent variables, such as 0 or 1, Pass or Fail, etc.
● Multinomial: In multinomial Logistic regression, there can be 3 or more possible
unordered types of the dependent variable, such as "cat", "dogs", or "sheep"
● Ordinal: In ordinal Logistic regression, there can be 3 or more possible ordered types of
dependent variables, such as "low", "Medium", or "High".
Steps in Logistic Regression: To implement the Logistic Regression using Python, we will use
the same steps as we have done in previous topics of Regression. Below are the steps:

● Data Pre-processing step


● Fitting Logistic Regression to the Training set
● Predicting the test result
● Test accuracy of the result(Creation of Confusion matrix)
● Visualizing the test set result.

You might also like