Scribd
Upload
132 views20 pages

1 - Intro To Machine Learning

The document provides an introduction and history of machine learning, explaining that machine learning involves computer programs that automatically improve performance through experience, and discusses traditional programming versus machine learning approaches. Key aspects of machine learning covered include types of learning problems, common representations and evaluation methods, and applications across many domains such as web search, healthcare, transportation and more.

Uploaded by

tariq1982
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
132 views20 pages

1 - Intro To Machine Learning

The document provides an introduction and history of machine learning, explaining that machine learning involves computer programs that automatically improve performance through experience, and discusses traditional programming versus machine learning approaches. Key aspects of machine learning covered include types of learning problems, common representations and evaluation methods, and applications across many domains such as web search, healthcare, transportation and more.

Uploaded by

tariq1982
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 20

Introduction to Machine Learning

Dr. Muhammad Tariq Saeed


<[email protected]>

Research Centre for Modeling and Simulation (RCMS),


National University of Sciences and Technology(NUST)
Outline

History
Traditional Programing
Machine Learning
Representation
Evaluation
Optimization
Types of Learning
Machine Learning
• Herbert Alexander Simon:
“Learning is any process by
which a system improves
performance from
experience.”

• “Machine Learning is concerned


with computer programs that
automatically improve their
performance through
experience.”
. Herbert Simon
Turing Award 1975
Nobel prize in
economics 1978
Why Machine Learning??
• Develop systems that can automatically adapt and customize themselves
to individual user.
Personalized news or mail filter.
• Discover new knowledge from large databases (data mining).
Market basket analysis (e.g beer).
Medical test mining.
• Ability to mimic human and replace certain monotonous tasks which
require some intelligence.
like recognizing handwritten characters.
• Develop systems that are too difficult/expensive to construct manually
because they require specific detailed skills or knowledge tuned to a
specific task.
Why Now

• Flood of available data (especially with the advent of the internet).


• Increasing computational power.
• Growing progress in available algorithms and theory developed by the
researchers.
• Increasing support from industries.
• Machine learning can be the key to unlocking the value of corporate and
customer data and enacting decisions that keep a company ahead of the
competition.
History
• 1948: Stored program computer
• In the late 1940s work proceeded
to develop stored-program
computers that hold their
instructions (programs) in the same
memory used for data.
• The first computers of this type
began the modern computing
revolution. They were the
Manchester Small-Scale
Experimental Machine (nicknamed
'Baby') in 1948, Cambridge’s EDSAC
and the Manchester Mark 1 in
1949, and the University of
Pennsylvania’s EDVAC in 1951.
History
• 1950: computing machinery and
intelligence.
• In 1950 Alan Turing published
Computing Machinery and
Intelligence, in which he asked:
“Can machines think?” – a
question that we still wrestle
with.
• This was at a time when the first
general purpose computers had
only just been built.
Alan Turing statue at Bletchley Park
History
• 1951: First Neural network.
• Marvin Minsky and Dean
Edmonds built the first artificial
neural network – a computer-
based simulation of the way
organic brains work.
• The Stochastic Neural Analog
Reinforcement Computer
(SNARC) learned from experience
and was used to search a maze,
like a rat in a psychology
experiment. Marvin Minsky at MIT in 1968
• He was an advisor on the film
2001: A Space Odyssey.
History
• 1996: Deep Blue Beats Garry
Kasparov.
• Public awareness of AI increased
greatly when an IBM computer
named Deep Blue beat world
chess champion Garry Kasparov
in the first game of a match.
• Kasparov won the 1996 match,
but in 1997 an upgraded Deep
Blue then won a second match
3½ games to 2½.
Garry Kasparov lost his second match to a computer
History
• 2006: Backpropagation.
• One of the core techniques used
in machine learning systems is
backpropagation, used to train
deep neural networks. First
described in the 1960s as part of
control theory and adopted for
neural networks.
• In 2017 Hinton, who now works
for Google, expressed concerns
that backpropagation has
reached its limits in building Neural network image recognition via backpropagation
machine learning systems.
History
• 2014: DeepMind.
• DeepMind Technologies is a
British company founded in 2010
and acquired by Google in 2014.
• DeepMind gained prominence
when it developed a neural
network that could learn to play
video games simply by analyzing
the behavior of pixels on a
screen.

DeepMind artificial intelligence moving an animated figure


History
• 2016: AlphaGo beats Lee Sedol.
• If Deep Blue’s chess expertise was
the big AI story of the last
millennium, then AlphaGo’s
success at Go has replaced it in
popular culture.
• Developed by DeepMind
researchers, AlphaGo won its first
match against a professional in
2015, beat the world’s number
two player Lee Sedol in March
2016 and the number one player Go was considered a more difficult game than chess for AI to master

Ke Jie in 2017.
So what is Machine Learning??
• Automating automation
• Getting computers to program themselves
• Writing software is the bottleneck
• Let the data do the work instead!
Traditional Programming

Data
Computer Output
Program

Machine Learning
Data
Computer Program
Output
Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging
• Healthcare
• Transportation
• Oil and Gas
Representation
• Decision trees
• Sets of rules / Logic programs
• Instances
• Graphical models (Bayes/Markov nets)
• Neural networks
• Support vector machines
• Model ensembles
• Etc.
Evaluation
• Accuracy
• Precision and recall
• Squared error
• Likelihood
• Posterior probability
• Cost / Utility
• Margin
• Entropy
• K-L divergence
• Etc.
Optimization
• Combinatorial optimization
– E.g.: Greedy search
• Convex optimization
– E.g.: Gradient descent
• Constrained optimization
– E.g.: Linear programming
Types of Learning

• Supervised (inductive) learning


– Training data includes desired outputs
• Unsupervised learning
– Training data does not include desired outputs
• Semi-supervised learning
– Training data includes a few desired outputs
• Reinforcement learning
– Rewards from sequence of actions
ML in Practice
• Understanding domain, prior knowledge, and goals
• Data integration, selection, cleaning,
pre-processing, etc.
• Learning models
• Interpreting results
• Consolidating and deploying discovered knowledge
• Loop

You might also like