Scribd
Upload
26 views23 pages

Vikas Machine

Machine learning is the study of algorithms that improve performance on tasks through experience. It is used when human expertise does not exist, humans cannot explain their expertise, models must be customized to large amounts of data, or for tasks like predicting patterns, generating patterns, recognizing anomalies, and making predictions. Examples of machine learning applications include web search, computational biology, finance, e-commerce, space exploration, robotics, and social networks. There are different types of learning including supervised learning, unsupervised learning, semi-supervised learning, and reinforcement learning.

Uploaded by

hssumanth4
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
26 views23 pages

Vikas Machine

Machine learning is the study of algorithms that improve performance on tasks through experience. It is used when human expertise does not exist, humans cannot explain their expertise, models must be customized to large amounts of data, or for tasks like predicting patterns, generating patterns, recognizing anomalies, and making predictions. Examples of machine learning applications include web search, computational biology, finance, e-commerce, space exploration, robotics, and social networks. There are different types of learning including supervised learning, unsupervised learning, semi-supervised learning, and reinforcement learning.

Uploaded by

hssumanth4
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 23

Introduction to Machine Learning

What is Machine Learning?

“Learning is any process by which a system improves performance from


experience.”
- Herbert Simon

Definition by Tom Mitchell (1998):


Machine Learning is the study of algorithms that
• improve their performance P
• at some task T
• with experience E.
A well-defined learning task is given by <P, T, E>.
When Do We Use Machine Learning?
ML is used when:
• Human expertise does not exist (navigating on Mars)
• Humans can’t explain their expertise (speech recognition)
• Models must be customized (personalized medicine)
• Models are based on huge amounts of data (genomics)

Learning isn’t always useful:


• There is no need to “learn” to calculate payroll
Some more examples of tasks that are best
solved by using a learning algorithm
• Recognizing patterns:
– Facial identities or facial expressions
– Handwritten or spoken words
– Medical images
• Generating patterns:
– Generating images or motion sequences
• Recognizing anomalies:
– Unusual credit card transactions
– Unusual patterns of sensor readings in a nuclear power plant
• Prediction:
– Future stock prices or currency exchange rates
Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging software
• [Your favorite area]
Autonomous Cars

• Nevada made it legal for


autonomous cars to drive on
roads in June 2011
• As of 2013, four states (Nevada,
Florida, California, and
Michigan) have legalized
autonomous cars
Penn’s Autonomous
Car 
Autonomous Car Sensors
Deep Learning in the Headlines
Machine Learning in
Automatic Speech Recognition
A Typical Speech Recognition System

ML used to predict of phone states from the sound spectrogram

Deep learning has state-of-the-art results


# Hidden Layers 1 2 4 8 10 12

Word Error Rate % 16.0 12.8 11.4 10.9 11.0 11.1

Baseline GMM performance = 15.4%


[Zeiler et al. “On rectified linear units for speech
recognition” ICASSP 2013]
Impact of Deep Learning in Speech
Technology
Types of Learning

• Supervised (inductive) learning


– Given: training data + desired outputs (labels)
• Unsupervised learning
– Given: training data (without desired outputs)
• Semi-supervised learning
– Given: training data + a few desired outputs
• Reinforcement learning
– Rewards from sequence of actions
Supervised Learning: Regression

• Given (x1, y1), (x2, y2), ..., (xn, yn)


• Learn a function f (x) to predict y given x
– y is real-valued == regression
9
8
September Arctic Sea Ice Extent

7
(1,000,000 sq km)

6
5
4
3
2
1
0
1970 1990 2000 2010 2020
1980
Supervised Learning: Classification

• Given (x1, y1), (x2, y2), ..., (xn, yn)


• Learn a function f (x) to predict y given x
– y is categorical == classification
Breast Cancer (Malignant / Benign)

1(Malignant)

0(Benign)
Tumor Size

Tumor Size
Unsupervised Learning

• Given x1 , x2 , ..., x n (without labels)


• Output hidden structure behind the x’s
– E.g., clustering
Unsupervised Learning
Genomics application: group individuals by genetic similarity
Genes

Individuals
Unsupervised Learning

Organize computing clusters Social network analysis

Image credit: NASA/JPL-Caltech/E. Churchwell (Univ. of Wisconsin, Madison)

Market segmentation Astronomical data analysis


Reinforcement Learning

• Given a sequence of states and actions with


(delayed) rewards, output a policy
– Policy is a mapping from states  actions that
tells you what to do in a given state
• Examples:
– Credit assignment problem
– Game playing
– Robot in a maze
– Balance a pole on your hand
Reinforcement Learning

• Given a sequence of states and actions with


(delayed) rewards, output a policy
– Policy is a mapping from states  actions that
tells you what to do in a given state
• Examples:
– Credit assignment problem
– Game playing
– Robot in a maze
– Balance a pole on your hand
Advantages
Disadvantages
Conclusion

We have a simple overview of some techniques and algorithms in machine learning.


Furthermore, there are more and more techniques apply machine learning as a
solution. In the future, machine learning will play an important role in our daily life.

You might also like