Scribd
Upload
23 views7 pages

1 Linear Regreesion Introduction

This document discusses linear regression, including: - Linear regression models the linear relationship between input variables (x) and a single output variable (y). Simple linear regression uses one input, multiple linear regression uses multiple inputs. - Linear regression models are represented by a linear equation that assigns coefficients to each input variable and an intercept term. Least squares is commonly used to estimate the coefficients from data. - The document will discuss representing linear regression models, learning algorithms like least squares to estimate coefficients, assumptions of linear regression, and preparing data for linear regression modeling.

Uploaded by

Monis Khan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
23 views7 pages

1 Linear Regreesion Introduction

This document discusses linear regression, including: - Linear regression models the linear relationship between input variables (x) and a single output variable (y). Simple linear regression uses one input, multiple linear regression uses multiple inputs. - Linear regression models are represented by a linear equation that assigns coefficients to each input variable and an intercept term. Least squares is commonly used to estimate the coefficients from data. - The document will discuss representing linear regression models, learning algorithms like least squares to estimate coefficients, assumptions of linear regression, and preparing data for linear regression modeling.

Uploaded by

Monis Khan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 7

Linear Regression

????
• What is linear model means
• Prerequisites
• Simple linear regression
• Multiple linear regression
• Polynomial linear regression
• Training Methods (Gradient Descent, Least Squares )
• Hands-on
Linear Regression

Linear regression is perhaps one of the most well known and well understood
algorithms in statistics and machine learning.

Our Concern:

• The representation of Linear Regression Model.


• Learning algorithms used to create a linear regression model.
• Assumptions
• Optimizations
• How to best prepare your data when modeling using linear regression.
Linear Regression: Background
• Linear regression is a linear model, e.g. a model that assumes a linear relationship
between the input variables (x) and the single output variable (y).
• More specifically, that y can be calculated from a linear combination of the input
variables (x).
• When there is a single input variable (x), the method is referred to as simple
linear regression.
• When there are multiple input variables, literature from statistics often refers to
the method as multiple linear regression.
• Different techniques can be used to train the linear regression model (equation)
from data, the most common of which is called Least Squares. It is common to
therefore refer to a model prepared this way as Least Squares Linear Regression.
Linear Regression Model Representation
• The representation is a linear equation that combines a specific set of
input values (x) which is used to predict output values (y). As such, both
the input values (x) and the output value are numeric.

• The linear equation assigns one scale factor to each input value, called a
coefficient that is commonly represented by the Greek letter Beta (β).
One additional coefficient is also added, giving the line an additional
degree of freedom (e.g. moving up and down on a two-dimensional plot)
and is often called the intercept or the bias coefficient. For example,
y = B0 + B1 x
intercept/bias Coefficient
Contd.
• In higher dimensions when we have more than one input (x), the line
is called a plane or a hyperplane.

• It is common to talk about the complexity of a regression model like


linear regression. This refers to the number of coefficients and its
magnitude used in the model.

• When a coefficient becomes zero, it effectively removes the influence


of the input variable on the model
Linear Regression Model Learning

Learning a linear regression model means estimating the values of the


coefficients with the data that we have available.

Lets have a discussion on training (Least Square Method))

You might also like