Scribd
Upload
1 views9 pages

Logistic Regression2

Logistic regression is a supervised machine learning algorithm used for binary classification, predicting the probability of an instance belonging to a class based on independent variables. It utilizes an 'S' shaped logistic function and is distinct from linear regression, which predicts continuous outcomes. Key assumptions include linearity in log-odds, independence of observations, and minimal multicollinearity among independent variables.

Uploaded by

Nithish Reddy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
1 views9 pages

Logistic Regression2

Logistic regression is a supervised machine learning algorithm used for binary classification, predicting the probability of an instance belonging to a class based on independent variables. It utilizes an 'S' shaped logistic function and is distinct from linear regression, which predicts continuous outcomes. Key assumptions include linearity in log-odds, independence of observations, and minimal multicollinearity among independent variables.

Uploaded by

Nithish Reddy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 9

Logistic Regression

Logistic regression is a supervised machine learning algorithm used


for classification tasks where the goal is to predict the probability that an
instance belongs to a given class or not. Logistic regression is a statistical
algorithm which analyze the relationship between two data factors.

Logistic Regression is a statistical method used for binary classification


problems. It predicts the probability of a binary outcome (0/1, True/False,
Yes/No) based on one or more independent variables.

In Logistic regression, instead of fitting a regression line, we fit an “S” shaped


logistic function, which predicts two maximum values (0 or 1).
we use the sigmoid function where the input will be z and we find the
probability between 0 and 1. i.e. predicted y.
Linear Regression Logistic Regression

Linear regression is used to predict the Logistic regression is used to predict the
continuous dependent variable using a categorical dependent variable using a
given set of independent variables. given set of independent variables.

Linear regression is used for solving It is used for solving classification


regression problem. problems.
In this we predict the value of continuous In this we predict values of categorical
variables variables
In this we find best fit line. In this we find S-Curve.
Least square estimation method is used for Maximum likelihood estimation method is
estimation of accuracy. used for Estimation of accuracy.

The output must be continuous value, such Output must be categorical value such as 0
as price, age, etc. or 1, Yes or no, etc.

It required linear relationship between


It not required linear relationship.
dependent and independent variables.

There may be collinearity between the There should be little to no collinearity


independent variables. between independent variables.
Assumptions:

Linear Relationship: The independent variables are linearly related to the


log-odds of the dependent variable.

Independence: The observations should be independent of each other.

No Multicollinearity: Independent variables should not be highly


correlated with each other.

Interpretation of Coefficients:
Once the parameters are estimated, they can be interpreted in terms of log-odds and
odds ratio:

Coefficients (β) represent the change in the log-odds of the outcome for a one-unit
change in the corresponding predictor.

Odds Ratio (e^β): Exponentiation the coefficients gives the odds ratio, which tells how
the odds of the outcome change with a one-unit increase in the predictor.

You might also like