Scribd
Upload
21 views20 pages

ML Lecture#02

Uploaded by

alhajibran90
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
21 views20 pages

ML Lecture#02

Uploaded by

alhajibran90
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 20

CT-562

MACHINE LEARNING

NED University of Engineering & Technology


1
SELF ASSESSMENT QUIZ

DR. HAIDER ALI 2


INTRODUCTION TO
MACHINE LEARNING
ALGORITHMS

DR. HAIDER ALI Machine Learning 3


MACHINE LEARNING ALGORITHMS

Machine
Learning

Supervised Unsupervised Reinforced


Learning Learning Learning

DR. HAIDER ALI Machine Learning 4


SUPERVISED LEARNING CLASSIFICATION
Training algorithms using labeled
input/output data.
REGRESSION

MACHINE
LEARNING
Subset of AI that UNSUPERVISED LEARNING
enable machines Training algorithms with no labeled
CLUSTERING
to improve at data. It attempts at discovering
tasks with hidden patterns on its own.
experience

REINFORCEMENT
LEARNING
Algorithm take actions to
maximize cumulative reward.

DR. HAIDER ALI Machine Learning 5


SUPERVISED MACHINE LEARNING
Supervised learning is the types of machine learning in which machines are trained using well "labelled" training
data, and on basis of that data, machines predict the output. The labelled data means some input data is already
tagged with the correct output.

DR. HAIDER ALI Machine Learning 6


TYPES OF SUPERVISED MACHINE LEARNING

DR. HAIDER ALI Machine Learning 7


REGRESSION

DR. HAIDER ALI Machine Learning 8


CLASSIFICATION

DR. HAIDER ALI Machine Learning 9


REGRESSION
 Regression searches for relationships
among variables.
 A regression is a statistical technique that
relates a dependent variable to one or more
independent (explanatory) variables.
 For example, you can observe several employees of
some company and try to understand how their
salaries depend on their features, such as
experience, education level, role, city of
employment, and so on.

DR. HAIDER ALI Machine Learning 10


TYPES OF LINEAR REGRESSION
Linear regression can be further divided into two types of the algorithm:

 Simple Linear Regression:

 Multiple Linear Regression:

DR. HAIDER ALI Machine Learning 11


LINEAR REGRESSION LINE
 Positive Linear Relationship
 Negative Linear Relationship

DR. HAIDER ALI Machine Learning 12


SIMPLE LINEAR REGRESSION ALGORITHM
HOW DO WE REPRESENT
Training Set h?

Learning Algorithm

Size of h Estimated
house price

Linear regression with one variable.


Univariate linear regression.

DR. HAIDER ALI Machine Learning 13


SIMPLE LINEAR REGRESSION ALGORITHM

SIMPLIFIED
Hypothesis:

Parameters:

Cost Function:

Goal:

DR. HAIDER ALI Machine Learning 14


SIMPLE LINEAR REGRESSION ALGORITHM

(for fixed , this is a function of x) (function of the parameter )

3 3

2 2
y
1 1

0 0
0 1 2 3 -‐0.5 0 0.5 1 1.5 2 2.5
x

DR. HAIDER ALI Machine Learning 15


SIMPLE LINEAR REGRESSION ALGORITHM

DR. HAIDER ALI Machine Learning 16


SIMPLE LINEAR REGRESSION ALGORITHM

Hypothesis:

Parameters:

Cost Function:

Goal:

DR. HAIDER ALI Machine Learning 17


SIMPLE LINEAR REGRESSION ALGORITHM
(FOR
FIXED , this is a function of x) (function of the parameters )

500

400
Price ($) 300
in 1000’s
200

100

0
0 1000 2000 3000
Size in feet2 (x)

DR. HAIDER ALI Machine Learning 18


SIMPLE LINEAR REGRESSION ALGORITHM

DR. HAIDER ALI Machine Learning 19


THANK YOU

DR. HAIDER ALI Machine Learning 21

You might also like