Scribd
Upload
0 views13 pages

Supervised Logistic Regression

Logistic regression is a supervised machine learning algorithm used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It employs a sigmoid function to map predicted values to probabilities and can be classified into binomial, multinomial, and ordinal types. Key assumptions include the categorical nature of the dependent variable and the absence of multi-collinearity among independent variables.

Uploaded by

jovita
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0 views13 pages

Supervised Logistic Regression

Logistic regression is a supervised machine learning algorithm used for predicting categorical dependent variables based on independent variables, providing probabilistic outputs between 0 and 1. It employs a sigmoid function to map predicted values to probabilities and can be classified into binomial, multinomial, and ordinal types. Key assumptions include the categorical nature of the dependent variable and the absence of multi-collinearity among independent variables.

Uploaded by

jovita
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 13

LOGISTIC

REGRESSION
INTRODUCTION
INTRODUCTION

 Logistic regression is one of the most popular Machine Learning algorithms, which comes under the
Supervised Learning technique. It is used for predicting the categorical dependent variable using a given set
of independent variables.
 Logistic regression predicts the output of a categorical dependent variable. Therefore the outcome must be
a categorical or discrete value. It can be either Yes or No, 0 or 1, true or False, etc. but instead of giving the
exact value as 0 and 1, it gives the probabilistic values which lie between 0 and 1.
 Logistic Regression is much similar to the Linear Regression except that how they are used. Linear
Regression is used for solving Regression problems, whereas Logistic regression is used for solving the
classification problems.
INTRODUCTION

 In Logistic regression, instead of fitting a regression line, we fit an "S" shaped logistic function, which predicts
two maximum values (0 or 1).
 Logistic Regression is a significant machine learning algorithm because it has the ability to provide
probabilities and classify new data using continuous and discrete datasets.
 Logistic Regression can be used to classify the observations using different types of data and can easily
determine the most effective variables used for the classification.
ASSUMPTIONS FOR LOGISTIC REGRESSION:

 The dependent variable must be categorical in nature.


 The independent variable should not have multi-collinearity.
LOGISTIC FUNCTION
LOGISTIC FUNCTION (SIGMOID FUNCTION)

 The sigmoid function is a mathematical function used to map the predicted values to probabilities.
 It maps any real value into another value within a range of 0 and 1.
 The value of the logistic regression must be between 0 and 1, which cannot go beyond this limit, so it forms a
curve like the "S" form. The S-form curve is called the Sigmoid function or the logistic function.
 In logistic regression, we use the concept of the threshold value, which defines the probability of either 0 or 1.
Such as values above the threshold value tends to 1, and a value below the threshold values tends to 0.
LOGISTIC FUNCTION (SIGMOID FUNCTION)
EQUATIONS
LOGISTIC REGRESSION EQUATIONS
The Logistic regression equation can be obtained from the Linear Regression equation. The mathematical steps to get
Logistic Regression equations are given below:

 We know the equation of the straight line can be written as:


𝑦 = 𝑏0 + 𝑏1 𝑥1 + 𝑏2 𝑥2 + 𝑏3 𝑥3 + ⋯ + 𝑏𝑛 𝑥𝑛
 In Logistic Regression y can be between 0 and 1 only, so for this let's divide the above equation by (1-y):
𝑦
; 0 𝑓𝑜𝑟 𝑦 = 0, 𝑎𝑛𝑑 𝑖𝑛𝑓𝑖𝑛𝑖𝑡𝑦 𝑓𝑜𝑟 𝑦 = 1
1−𝑦
 But we need range between -[infinity] to +[infinity], then take logarithm of the equation it will become:
𝑦
log = 𝑏0 + 𝑏1 𝑥1 + 𝑏2 𝑥2 + 𝑏3 𝑥3 + ⋯ + 𝑏𝑛 𝑥𝑛
1−𝑦
TYPE OF LOGISTIC REGRESSION
TYPE OF LOGISTIC REGRESSION

On the basis of the categories, Logistic Regression can be classified into three types:

 Binomial
In binomial Logistic regression, there can be only two possible types of the dependent variables, such as 0 or 1, Pass
or Fail, etc.
 Multinomial
In multinomial Logistic regression, there can be 3 or more possible unordered types of the dependent variable, such
as "cat", "dogs", or "sheep"
 Ordinal
In ordinal Logistic regression, there can be 3 or more possible ordered types of dependent variables, such as "low",
"Medium", or "High".
REFFERENCES

 https://towardsdatascience.com/introduction-to-logistic-regression-66248243c148
 https://www.javatpoint.com/logistic-regression-in-machine-learning

You might also like