Introduction to Machine
Learning
Adama Science and Technology University
School of Electrical Engineering and Computing
Department of CSE
Dr. Mesfin Abebe Haile (2020)
Outline
Why Machine Learning (ML)?
Examples of ML applications
Related to the course
Major classes of ML Algorithms
ML Vs AI
Questions about ML
11/07/22 2
Why Machine Learning ?
It is very hard to write programs that solve complex problem.
(Defining the requirements)
Computing the probability of a credit card transaction is
fraudulent.
Recognizing a three-dimensional objects.
We don’t know what program to write because we don’t know
how its done in our brain. (tacit knowledge not explicit)
Even if we had a good idea about how to do it, the program
might be terribly complicated.
11/07/22 3
Why Machine Learning ?
There may not be rules that are both simple and reliable.
We need to combine a very large number of weak rules.
May be the rules are changing frequently (dynamic)?
E.g. Fraud is a moving target .
The program needs to keep changing.
11/07/22 4
Why Machine Learning ?
The program produced by the learning algorithm my look very
different from a typical hand-written program.
If we do it right, the program works for new cases as well as
the ones we trained it on.
If the data changes the program can change too by training on
the new data.
Massive amount of computation are now cheaper than paying
someone to write a task-specific program.
11/07/22 5
Why Machine Learning ?
Instead of writing a program by hand for each specific
task, we collect lots of examples that specify the correct
output for a given input.
A machine learning algorithm then takes these examples
and produces a program that does the job.
11/07/22 6
What is Machine Learning ?
Machine Learning: is a field of study that gives computers the
ability to learn without being explicitly programmed. (Arthur
Samuel – 1959)
A computer program is said to learn from experience E with
respect to some class of task T and performance measure P, if
its performance at task in T, as measured by P, improves with
experience E. (Tom Mitchell – 1998)
11/07/22 7
What is Machine Learning ?
What is ML: building computational artifacts that learn over
time based on experience.
It includes:
The mathematics behind it
The science behind it (systematic and logical approach,
knowledge base on demonstrable)
The engineering behind it (the application of mathematics and
science)
The computing behind it (using computer technology)
11/07/22 8
Examples of ML Application
Some examples of tasks best solved by learning algorithms.
Recognizing patterns:
Object in real scenes
Facial identities or facial expressions
Spoken words
Recognizing anomalies:
Unusual sequences of credit card transactions
Unusual patterns of sensor readings in a nuclear power plant
Prediction:
Future stock price or currency exchange rates
Which movies will a person like?
11/07/22 9
Examples of ML Application
Some application of ML in Google:
Page ranking (RankBrain)
Spam identification in email
Speech recognition (language recognition)
Software in Cars (Autonomous and self driving cars)
Recommender system
Google voice search
Gmail inbox’s smart replay
Google photos
Google Cloud Vision API
Virtual reality etc…
11/07/22 10
ML related to this Course
The course can be:
More of theoretical :
More of practical:
Balancing the theory and the application
11/07/22 11
ML related to this Course
Some prerequisite :
Programming (python, matlab, R etc…)
Probability and Statistics;
Mathematics (Linear Algebra, Matrix, Vector, differential
calculus, and integral calculus)
Curiosity of working with data etc… (most importantly)
ML – it is all about learning from examples (data).
We take features (independent attributes) and produced labels
(dependent attribute).
11/07/22 12
Learning Path
Generally, the learning path includes:
Math skills
Programming skills
Data Engineering skills
Machine learning algorithms
Machine learning frameworks
11/07/22 13
Learning Path
Generally, the learning path includes: Math skills
11/07/22 14
Learning Path
Generally, the learning path includes: Programming skills
11/07/22 15
Learning Path
Generally, the learning path includes: Data Engineering skills
11/07/22 16
Learning Path
Generally, the learning path includes: ML algorithms
11/07/22 17
Learning Path
Generally, the learning path includes: ML Framework
11/07/22 18
Major Classes of ML Algorithms
11/07/22 19
Supervised Learning
11/07/22 20
Supervised Learning
11/07/22 21
Supervised Learning
Supervised learning: (function approximation) [labels data
well]
Input 1 2 3 4 5 6 9
Output 1 4 9 16 25 36 ?
output <- input2
Learn to predict an output when given an input vector.
E.g.: Features: age, gander, smoking, drinking etc…
Labels : having the disease , does not have the disease
11/07/22 22
Supervised Learning
Supervised Learning:
Regression Problem: numerical / continuous value.
Given some data, you assume that those values come from some
sort of function and try to find out what the function is.
It is a problem of function approximation or interpolation.
Classification Problem: nominal / discrete value.
Grouping the data into predetermined classes.
11/07/22 23
Supervised Learning
Supervised learning: making predictions using data.
Example : is a given email “spam” or “ham”.
There is an outcome; we are trying to predict.
Classification
11/07/22 24
Unsupervised Learning
Unsupervised learning :
Unsupervised (concise description) [cluster scores well]
The aim of unsupervised learning is to find clusters of
similar inputs in the data without being explicitly told that some
data points belong to one class and the other in other classes.
The algorithm has to discover this similarity by itself.
Discover a good internal representation of the input.
11/07/22 25
Unsupervised Learning
11/07/22 26
Unsupervised Learning
11/07/22 27
Unsupervised Learning
Unsupervised learning: extracting structure from data.
Example: segment grocery store shopper into clusters that exhibit
similar behaviors.
There is no “right answer”
Clustering
11/07/22 28
Reinforcement Learning
Reinforcement learning :
Reinforcement (stimulus/state, action, reward) [behavior scores
well] – reward maximization.
The algorithm searches over the state space of possible inputs and
outputs in order to maximize a reward.
Learn to select an action to maximize payoff.
11/07/22 29
Reinforcement Learning
11/07/22 30
Machine Learning Vs AI
Machine learning : is more of induction (from specific to
generalization)
Abebe is mortal, Almaz is mortal
Kebede is mortal,
Then, all humans are mortal
Artificial Intelligence: more of deduction (from general to
specific – reasoning )
A implies B
Having “A”, you can infer “B”
11/07/22 31
Machine Learning Vs AI
Machine learning can be:
Unsupervised (description) -> summaries -> Supervised (function
approximation) -> Labels
Data is the key in ML:
The difference b/n solving a problem as AI or ML person is:
As a AI person: the algorithm is central
As a ML person: the data is central (get the priority)
11/07/22 32
Machine Learning Application
Machine learning can be applied:
What are the serious of steps I need to do in order to solve some
problem?
If I tried to describe this problem in a particular way, is it
solvable?
11/07/22 33
Machine Learning
What is Machine Learning?
Machine learning is the semi-automated extraction of knowledge
from data?
Knowledge from data: Starts with a question that might be
answerable using data.
Automated extraction: A computer provides the insight.
Semi-automated: Requires many smart decisions by a human.
11/07/22 34
Machine Learning
How does ML “work”?
High-level steps of supervised learning:
First, train a machine learning model using labeled data.
“Labeled data” has been labeled with the outcome.
“ML model” learns the relationship b/n the attributes of the data and
its outcome.
Then, make predictions on new data for which the label is
unknown.
Example: segment grocery store shopper into clusters that exhibit
similar behaviors.
11/07/22 35
Machine Learning
Questions about ML?
How do I choose which attributes of my data to include in the
model?
How do I choose which model to use?
How do I optimize the model for best performance?
How do I ensure that I’m building a model that will generalize to
unseen data?
Can I estimate how well my model is likely to perform on unseen
data?
11/07/22 36
Question & Answer
11/07/22 37
Thank You !!!
11/07/22 38
