Scribd
Upload
70 views47 pages

Chapter 05 Regression Analysis

This document discusses regression analysis techniques in machine learning. It defines regression analysis as a supervised learning method where the value of a dependent variable Y is estimated based on independent variable(s) X. The document covers various types of regression including linear regression, logistic regression, polynomial regression, and regularization methods like ridge and lasso regression. It also discusses evaluating and validating regression models using measures like the coefficient of determination.

Uploaded by

Madan Prabhu Durai
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
70 views47 pages

Chapter 05 Regression Analysis

This document discusses regression analysis techniques in machine learning. It defines regression analysis as a supervised learning method where the value of a dependent variable Y is estimated based on independent variable(s) X. The document covers various types of regression including linear regression, logistic regression, polynomial regression, and regularization methods like ridge and lasso regression. It also discusses evaluating and validating regression models using measures like the coefficient of determination.

Uploaded by

Madan Prabhu Durai
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 47

Machine

Learning
S. Sridhar and M. Vijayalakshmi

© Oxford University Press 2021. All rights reserved


Chapter 2

Regression Analysis

© Oxford University Press 2021. All rights reserved


What is Regression Analysis?
• A KIND OF SUPERVISORY LEARNING
• Y=F(X)

HERE, Y IS CALLED DEPENDENT VARIABLE AND X IS CALLED INDEPENDENT


VARIABLE.

© Oxford University Press 2021. All rights reserved


Focus of Regression Analysis

© Oxford University Press 2021. All rights reserved


Applications of Regression Analysis

© Oxford University Press 2021. All rights reserved


Correlation
CORRELATION BETWEEN TWO VARIABLES CAN BE FOUND USING A SCATTER
PLOT

© Oxford University Press 2021. All rights reserved


Causation
1. CAUSATION IS ABOUT RELATIONSHIP BETWEEN TWO VARIABLES AS X CAUSES
Y. THIS IS CALLED X IMPLIES B.

2. REGRESSION IS DIFFERENT FROM CAUSATION.

© Oxford University Press 2021. All rights reserved


Linear and Non-Linear Relationships

© Oxford University Press 2021. All rights reserved


Types of Regression

© Oxford University Press 2021. All rights reserved


Limitations of Regression

© Oxford University Press 2021. All rights reserved


Linear Regression

© Oxford University Press 2021. All rights reserved


Ordinary Least Square Approach

© Oxford University Press 2021. All rights reserved


Linear Regression Model

© Oxford University Press 2021. All rights reserved


Linear Regression Example

© Oxford University Press 2021. All rights reserved


Linear Regression Example

© Oxford University Press 2021. All rights reserved


Linear Regression Example

© Oxford University Press 2021. All rights reserved


Linear Regression Example

© Oxford University Press 2021. All rights reserved


Linear Regression in Matrix Form

© Oxford University Press 2021. All rights reserved


Linear Regression in Matrix Form

© Oxford University Press 2021. All rights reserved


Linear Regression in Matrix Form

© Oxford University Press 2021. All rights reserved


Validation of Regression Methods

© Oxford University Press 2021. All rights reserved


Validation of Regression Methods

© Oxford University Press 2021. All rights reserved


Validation of Regression Methods

© Oxford University Press 2021. All rights reserved


Validation of Regression Methods

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Validation of Regression Methods
COEFFICIENT OF DETERMINATION

© Oxford University Press 2021. All rights reserved


Multiple Regression Model

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Polynomial Regression

© Oxford University Press 2021. All rights reserved


Polynomial Regression

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Logistic Regression

© Oxford University Press 2021. All rights reserved


Logistic Regression

© Oxford University Press 2021. All rights reserved


Logistic Regression

© Oxford University Press 2021. All rights reserved


Logistic Regression

© Oxford University Press 2021. All rights reserved


Logistic Regression

© Oxford University Press 2021. All rights reserved


Example

© Oxford University Press 2021. All rights reserved


Regularization Methods

© Oxford University Press 2021. All rights reserved


Ridge

© Oxford University Press 2021. All rights reserved


Procedure

© Oxford University Press 2021. All rights reserved


Lasso

© Oxford University Press 2021. All rights reserved


Ridge Vs Lasso

© Oxford University Press 2021. All rights reserved


Elastic Net

© Oxford University Press 2021. All rights reserved


Summary

© Oxford University Press 2021. All rights reserved


Summary

© Oxford University Press 2021. All rights reserved

You might also like