Scribd
Upload
37 views11 pages

Polynomial Regression: Delivered By: Garima Koushik

Polynomial regression is an extension of linear regression that allows for modeling of nonlinear relationships between an independent variable x and a dependent variable y. It fits data using terms of increasing degrees like x^2, x^3 etc. to capture nonlinear patterns like curves that a simple linear model cannot. Both underfitting, where a simple linear model cannot capture patterns, and overfitting, where a high-degree model fits noise, can occur. The goal is to find a model with the optimal complexity that balances low bias from underfitting and low variance from overfitting to perform well on both training and new data.

Uploaded by

Garima Kaushik
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
37 views11 pages

Polynomial Regression: Delivered By: Garima Koushik

Polynomial regression is an extension of linear regression that allows for modeling of nonlinear relationships between an independent variable x and a dependent variable y. It fits data using terms of increasing degrees like x^2, x^3 etc. to capture nonlinear patterns like curves that a simple linear model cannot. Both underfitting, where a simple linear model cannot capture patterns, and overfitting, where a high-degree model fits noise, can occur. The goal is to find a model with the optimal complexity that balances low bias from underfitting and low variance from overfitting to perform well on both training and new data.

Uploaded by

Garima Kaushik
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 11

Polynomial Regression

Delivered by : Garima Koushik


Why Polynomial Regression ?
 What if data points are scattered like this?
 After applying the Linear Regression model, it will look
something like this –
Polynomial Regression
 It is same as Linear Regression but it is used for non linear
distribution of the data.
 After applying the Polynomial Regression technique on the
same data , the best fit line will be like as below-
Under fitting
 It occurs when a straight line is unable to capture the pattern
in data.
 To overcome under fitting, we increase the complexity of
model.
 The linear model,

 Can be transferred to
 After fitting cubic curve i.e. Degree = 3
Over fitting
 When degree of the model is set to a very high number than
model starts capturing the noise in the data, it is called as
over fitting.
Bias and Variance
 Bias refers to the error due to the model’s simplistic
assumptions in fitting the data. A high bias means that the
model is unable to capture the patterns in the data and this
results in under-fitting.
 Variance refers to the error due to the complex model
trying to fit the data. High variance means the model passes
through most of the data points and it results in over-
fitting the data.
Which one is correct model?
Outcome
 Machine learning model with low variance and low bias
 As complexity increases, bias will also decreases but variance
increases
 It becomes difficult to have both low bias and variance
 So, we try to achieve good model that will perform well on
train and unseen data.

You might also like