Scribd
Upload
8 views

Supervised Learning Algorithms Simple Linear Regression

Supervised-Learning-Algorithms-Simple-Linear-Regression

Uploaded by

lawrancedevaraj
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
8 views

Supervised Learning Algorithms Simple Linear Regression

Supervised-Learning-Algorithms-Simple-Linear-Regression

Uploaded by

lawrancedevaraj
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 8

Supervised Learning

Algorithms: Simple
Linear Regression
Supervised learning is a machine learning technique where an algorithm learns from labeled
data to make predictions on new, unseen data. Simple linear regression is a fundamental
supervised learning algorithm used to model the relationship between two variables.

by Mr.G.Lawrance 1678
What is Simple Linear Regression?
Simple linear regression is a statistical method used to model the relationship between a dependent variable and an independent
variable using a straight line.

Dependent Variable Independent Variable

The variable you are trying to predict. The variable used to predict the dependent variable.
Assumptions of Simple Linear
Regression
Simple linear regression relies on several assumptions that need to be met to ensure the accuracy and
validity of the model.

1 Linearity
A linear relationship exists between the dependent and independent variables.

2 Independence
The observations are independent of each other.

3 Homoscedasticity
The variance of the errors is constant across all values of the independent variable.

4 Normality
The errors are normally distributed.
Estimating the Regression Line
The regression line represents the best fit line that minimizes the sum of squared errors between the predicted and actual values of the
dependent variable.

Least Squares Method


Finds the line that minimizes the sum of squared residuals.

Slope
Indicates the change in the dependent variable for a unit change in the independent variable.

Intercept
Represents the value of the dependent variable when the independent variable is zero.
Evaluating the Regression Model
Evaluating the performance of the regression model helps to determine how well it fits the data
and how accurate its predictions are.

R-squared Indicates the proportion of variance in the


dependent variable explained by the
independent variable.

Root Mean Squared Error (RMSE) Measures the average difference between
predicted and actual values.

P-value Indicates the significance of the regression


coefficients.
Interpreting the Regression Coefficients
The regression coefficients provide information about the relationship between the variables.

Slope Intercept
Indicates the change in the dependent variable for a unit Represents the value of the dependent variable when the
change in the independent variable. independent variable is zero.
Predictions Using the Regression Model
Once the regression model is built, it can be used to make predictions for new, unseen data points.

New Data Predictions


Input new values for the independent variable. The model generates predictions for the dependent variable
based on the input values.
Limitations and Extensions of
Simple Linear Regression
Simple linear regression has limitations, but it can be extended to handle more complex
situations.

1 Linearity
May not accurately model nonlinear relationships.

2 Multicollinearity
Can be affected by highly correlated independent variables.

3 Outliers
Sensitive to outliers that can significantly influence the regression line.

You might also like