Lec1 Intoduction
Lec1 Intoduction
Introduction to machine
learning
Lec 1
Instructor:
Assoc Lecturer : Ahmed Yousry
Data
Output
Progra
Machine
m Learning
Data
Program
Output
Examples
Example 1 : Tic-Tac-Toe
Examples
Example 2 : face recognition
Examples
Example 3: Prediction of search queries
Examples
Example 4: Ranking search results
Examples
Example 5
Examples
Example 6
Examples
Example 7
Problem setup
So we need to separate
• Experience is a dataset.
• Recognizing patterns:
– Facial identities or facial expressions
– Handwritten or spoken words
– Medical images
• Generating patterns:
– Generating images or motion sequences
• Recognizing anomalies:
– Unusual credit card transactions
– Unusual patterns of sensor readings in a nuclear power plant
• Prediction:
– Future stock prices or currency exchange rates
Slide credit: Geoffrey Hinton
Supervised Learning
In supervised learning, we are given a data set and already
know what our correct output should look like, having the
idea that there is a relationship between the input and the
output.
Supervised learning problems are categorized into "regression"
and "classification" problems.
In a regression problem, we are trying to predict results within
a continuous output, meaning that we are trying to map input
variables to some continuous function.
In a classification problem, we are instead trying to predict
results in a discrete output. In other words, we are trying to
Learning entries
Training
usually entries are encoded
Text, Images as vector (x1,x2,…..,xn)
Omic data, Featur
Etc… e
vectors Human expert labels
each learning entries
Machine
Labels learning
algorithm
Featur
Testing
e
Text, Images Expected
vector Predictiv
Omic data, e Label
Etc… Model
250
175
750
Classification
X
Unsupervised
X
Unsupervised learning is where you only have input data
and no corresponding output variables.
Unsupervised Learning applications
The expression of set of genes for a
certain individual
Genes
Individuals
We need to cluster the individuals based of the similarity of
their genes.
Genes
Individuals
Microarray data
• Have a group of individuals
• On each measure expression of a gene
• Run algorithm to cluster individuals into types of
people
[Source: Daphne Koller]
Learning Types
Supervised Unsupervised
Discrete
Classification Clustering
Continuous
Dimensionality
Regression
reduction
Machine Learning more types