Scribd
Upload
252 views

Introduction To Machine Learning

The document discusses machine learning and its applications. It begins by providing context on the information revolution and rise of machine intelligence. It then defines machine learning as a computer program that improves its performance on tasks through experience. Examples of machine learning applications include facial recognition, prediction, and recommendation systems. The document outlines different types of machine learning like supervised learning, unsupervised learning, and reinforcement learning. It also discusses designing machine learning systems and areas machine learning has influenced like statistics, brain models, and psychology.

Uploaded by

Mustafamna Al Salam
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
252 views

Introduction To Machine Learning

The document discusses machine learning and its applications. It begins by providing context on the information revolution and rise of machine intelligence. It then defines machine learning as a computer program that improves its performance on tasks through experience. Examples of machine learning applications include facial recognition, prediction, and recommendation systems. The document outlines different types of machine learning like supervised learning, unsupervised learning, and reinforcement learning. It also discusses designing machine learning systems and areas machine learning has influenced like statistics, brain models, and psychology.

Uploaded by

Mustafamna Al Salam
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 46

*Machine Learning

Asst. Prof.
Dr. Mohammed Najm Abdullah
PREAMBLE
• We are in the midst of what is popularly called the
information revolution—a revolution which was born
shortly after the end of World War II.
• The new world was the world of machine intelligence
and automated reasoning
• It was widely believed that there were no limits to what
machines could do
• The era of thinking machines has arrived
INFORMATION SYSTEMS / INTELLIGENT SYSTEMS

INTELLIGENT
INFORMATION
SYSTEMS
REVOLUTION
REVOLUTION

INTERNET SMART CAMERAS


WORLD WIDE WEB SMART APPLIANCES
WIRELESS TELEPHONY SMART CARS
FAX SMART ELEVATORS
DIGITAL LIBRARIES SMART ROBOTS
DATA MINING INTELLIGENT MANUFACTURING
INFORMATION RETRIEVAL EXPERT SYSTEMS
… SMART SEARCH ENGINES
SMART QUALITY CONTROL
…
Measure of intelligence: MIQ (Machine Intelligence Quotient)
* Machine Learning: A Definition
Definition: A computer program is said to
learn from experience E with respect to some
class of tasks T and performance measure P,
if its performance at tasks in T, as measured
by P, improves with experience E.

4
Idea: Synthesize computer programs by learning
from representative examples of input (and
output) data.
Rationale:
1. For many problems, there is no known method for
computing the desired output from a set of inputs.
2. For other problems, computation according
to the known correct method may be too
expensive.
* What Is Machine Learning?
“Logic is not the end of wisdom, it is just the beginning” --- Spock

same time
Environment Environment

System System

Action1 Action2

Knowledge Knowledge
changed
What is Machine Learning?
1. It is very hard to write programs that solve problems like
recognizing a face.
* We don’t know what program to write because we don’t know how
our brain does it.
* Even if we had a good idea about how to do it, the program might
be horrendously complicated.
2. Instead of writing a program by hand, we collect lots of
examples that specify the correct output for a given input.
3. A machine learning algorithm then takes these examples and
produces a program that does the job.
* The program produced by the learning algorithm may look very
different from a typical hand-written program. It may contain
millions of numbers.
* If we do it right, the program works for new cases as well as the
ones we trained it on.
A classic example of a task that requires machine
learning: It is very hard to say what makes a 2
Some more examples of tasks that are best solved
by using a learning algorithm
1. Recognizing patterns:
• Facial identities or facial expressions
• Handwritten or spoken words
• Medical images
2. Generating patterns:
• Generating images or motion sequences
3. Recognizing anomalies:
• Unusual sequences of credit card transactions
• Unusual patterns of sensor readings in a nuclear power plant or
unusual sound in your car engine.
4. Prediction:
• Future stock prices or currency exchange rates
Some web-based examples of machine learning

1. The web contains a lot of data. Tasks with very big


datasets often use machine learning
• especially if the data is noisy or non-stationary.
2. Spam filtering, fraud detection:
• The enemy adapts so we must adapt too.
3. Recommendation systems:
• Lots of noisy data. Million dollar prize!
4. Information retrieval:
• Find documents or images with similar content.
5. Data Visualization:
• Display a huge database in a revealing way
Why is Machine Learning Important?
1. Some tasks cannot be defined well, except by
examples (e.g., recognizing people).
2. Relationships and correlations can be hidden
within large amounts of data. Machine
Learning/Data Mining may be able to find
these relationships.
3. Human designers often produce machines that
do not work as well as desired in the
environments in which they are used.
4. The amount of knowledge available about
certain tasks might be too large for explicit
encoding by humans (e.g., medical diagnostic).
5. Environments change over time.
6. New knowledge about tasks is constantly
being discovered by humans. It may be
difficult to continuously re-design systems “by
hand”.
Areas of Influence for Machine Learning
1. Statistics: How best to use samples drawn from unknown
probability distributions to help decide from which distribution
some new sample is drawn?
2. Brain Models: Non-linear elements with weighted inputs
(Artificial Neural Networks) have been suggested as simple
models of biological neurons.
3. Adaptive Control Theory: How to deal with controlling a
process having unknown parameters that must be estimated
during operation?
4. Psychology: How to model human performance on various
learning tasks?
5. Artificial Intelligence: How to write algorithms to
acquire the knowledge humans are able to acquire,
at least, as well as humans?
6.Evolutionary Models: How to model certain
aspects of biological evolution to improve the
performance of computer programs?

14
Designing a Learning System
• In designing a learning system, we have to deal
with (at least) the following issues:
1. Training experience
2. Target function
3. Learned function
4. Learning algorithm

Training Experience
Issues concerning the training experience:
1. Direct or indirect evidence (supervised or unsupervised).
2. Controlled or uncontrolled sequence of training examples.
3. Representatively of training data in relation to test data.
Target Function and Learned Function
• The problem of improving performance can often be
reduced to the problem of learning some particular target
function.
• In many cases we can only hope to acquire some
approximation to the ideal target function.
Learning Algorithm
In order to learn the (approximated) target function we require:
1. A set of training examples (input arguments)
2. A rule for estimating the value corresponding to each
training example (if this is not directly available)
3. An algorithm for choosing the function that best fits the
training data
Types of Machine Learning
• Rote learning – One-to-one mapping from inputs to stored
representation. “Learning by memorization.” Association-based
storage and retrieval.
• Induction – Use specific examples to reach general conclusions
• Clustering – Unsupervised identification of natural groups in
data
• Analogy – Determine correspondence between two different
representations
• Discovery – Unsupervised, specific goal not given
• Genetic algorithms – “Evolutionary” search techniques, based
on an analogy to “survival of the fittest”
• Reinforcement – Feedback (positive or negative reward) given at
the end of a sequence of steps
In other words the Types of Machine Learning may
be as follows:
• Supervised Learning
– Classification(pattern recognition)
– Regression
• Unsupervised Learning
• Reinforcement Learning
Reinforcement Learning:
Overview
 Characteristics
– Learning a Policy: A sequence of outputs
– No supervised output, but a delayed reward
– Credit assignment problem:
• Which action led me to winning the game?
 Examples
– Elevator scheduling
– Backgammon and Chess
– Robot control
Variations of Machine Learning
• Unsupervised learning: Learning without output values
(data exploration, e.g. clustering).
• Query learning: Learning where the learner can query the
environment about the output associated with a particular
input.
• Reinforcement learning: Learning where the learner has a
range of actions which it can take to attempt to move
towards states where it can expect high rewards.
• Batch vs. online learning: All training examples at once or
one at a time (with estimate and update after each
example).
Machine Learning Application
Brain -Computer Interface
Direct Neural Interface or Brain-Machine Interface

• Direct communication pathway between a brain and


an external device.

• Research on BCIs began in the


1970s at the University of
California Los Angeles
How does it work?
•Signal Acquisition
•Signal Processing
•Devices
Brain Wave Control
Brain Wave Control

◦ α (8 – 12 Hz): relaxed/reflecting
◦ β (12 – 30 Hz): alert/working
- Training
- Misjudgment

You might also like