Scribd
Upload
31 views

Lecture 2: Introduction To Machine Learning

This document provides an introduction to machine learning. It defines machine learning as a field that allows computers to learn without being explicitly programmed, by improving performance on some task through experience. Supervised learning algorithms use labeled training data to predict continuous-valued outputs for regression tasks or discrete outputs for classification tasks. Unsupervised learning algorithms find hidden patterns in unlabeled data by clustering them into groups. Some examples of machine learning applications discussed are handwriting recognition, spam filtering, market segmentation, and medical diagnosis.

Uploaded by

Malik Ubaid
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
31 views

Lecture 2: Introduction To Machine Learning

This document provides an introduction to machine learning. It defines machine learning as a field that allows computers to learn without being explicitly programmed, by improving performance on some task through experience. Supervised learning algorithms use labeled training data to predict continuous-valued outputs for regression tasks or discrete outputs for classification tasks. Unsupervised learning algorithms find hidden patterns in unlabeled data by clustering them into groups. Some examples of machine learning applications discussed are handwriting recognition, spam filtering, market segmentation, and medical diagnosis.

Uploaded by

Malik Ubaid
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 20

Lecture 2: Introduction to

Machine Learning

Machine Learning Definition


Field of study that gives
computer the ability to learn
without being explicitly
programmed (Arthur Samuel,
1956)
Study of algorithms that
improve their performance P at
some task T with experience E
(Tom Mitchell, 1998)

Well defined learning task: <P,


T, E>

T: Play checkers
P: % of games won
E: Playing against
self

Well Defined Learning Task


Handwriting Recognition
Task T: recognizing and classifying handwritten words
within images
Performance P: percent of words correctly classified
Training experience E: a database of written words
with given classification

Question
Suppose your email program watches which email you
do and do not mark as spam and based on that learn
how to better filter spam. What is the task in this setting
Classifying emails as spam or not spam
The number of emails correctly classifying as spam/not spam
Labelling emails as spam/ not spam
Non of above: This is not a machine learning problem

Machine Learning
Algorithms
Supervised Learning Algorithms
Unsupervised Learning Algorithms

Supervised Learning

Right answers are given for inputs


Regression refers to predicting
continuous valued output (e.g. price)

Supervised Learning

Classification refers to predict


discrete valued output (e.g. 0 or 1)

Supervised Learning

More sophisticated features are:


Uniformity of cell size
Uniformity of cell shape, etc

Question
Suppose you are running a company and want to
develop a learning algorithm to address each of two
problems:
Problem 1: you have large inventory of identical items.
You want to predict how many of items will sell over
next 3 months.
Problem 2: you would like your program to examine
individual customer accounts and for each account
decide if it has been hacked or not.
Should you treat these as classification or regression
problem ?
Treat
Treat
Treat
Treat

both as classification problem


problem 1 as classification and 2 as regression problem
both as regression problem
1 as regression and 2 as classification problems

Unsupervised Learning

Unsupervised Learning Application

Unsupervised Learning
Application

Unsupervised Learning
Application

Figure: DNA microarray data of


individuals

Unsupervised Learning
Application
Fridge, computer and dishwasher
3000
2500

Average power consumptionn[W]

2000
1500
1000
250
200

Fridge and computer

150

Fridge

100
50
0

Window size = 2

50

100

150

200

250

Windows [#]

300

350

400

450

Unsupervised Learning
Application
Fridge, computer and dishwasher

State
sequence
of fridge
sequence
of diswasher
StateState
sequence
of fridge
and
computer
S
S
S
S2S6 1 S5S7 4 S2S6 3 S5S7

Average
power
Average
power
Average
power [W]
consumption
consumption
[W]
consumption [W]
Average power consumptionn[W]

3000
120
160
3000
State:
S1S2S2
State:
State:
2500
State:
S
State:S
State:
S
140
1002500
3 5 5
State:
S6
State:
S
4
120
State:
S7
80
2000
2000
100
60
1500
80
1500
40
60
1000
40
20
1000
500
20
0
00 0310 10 320 20 330 30 340 40 350 50 360 60 370 70 380 80 390
250 130 140 150 Windows
120
160 170
[#] 180 190 200 210

State: S1
State: S2
State: S3
State: S4
State: S5
State: S6
State: S7

[#]
WindowsWindows
[#]

200

Fridge and computer

150

Fridge

100
50
0

Window size = 2

50

100

150

200

250

Windows [#]

300

350

400

450

Unsupervised Learning Applications

Unsupervised Learning Application:


Cocktail Party Problem

Unsupervised Learning Application:


Cocktail Party Algorithm

Question
Of following examples, which one you address
using unsupervised learning algorithm?
Given email labelled as spam/not spam, learn a
spam filter
Given a set of news articles on the web, group
them into set of articles about the same story
Given a database of customer data, automatically
discover market segments and group customer
into different market segments
Given a database of patients diagnosed as either
having diabetes or not, learn to classify a new
patients as either having a diabetes or not.

Ungraded Assignment
Install Octave an open source software
or
Practice with:
Elementary operation: add, subtract,
multiplication, power, divide, etc
Conditional operation: equal, not equal,
greater, greater and equal to, etc
Logical operations: AND, OR, XOR, etc
Variable assignment
Vectors and matrices: defining vectors and
matrices, ones, zeros, rand, eye
doc and help comand

You might also like