Chapter-1

Introduction to Machine Learning

Theory:3 hrs
Practical:2hrs
Text Book Books:
1.Introduction to Machine learning by Ethem Alpaydin
2. Foundation of Machine learning by Mehryar Mohri
Reference Books:
1.Machine learning hands for developers and Technical and
Professionals by Bell,Jason
2. Pattern recognition and machine learning by Christeropher
M.Bishop
What is Machine Learning?
What is Machine Learning?
 What is Machine Learning?
• Learning:- Learning is any process by which a system
improves performance from experience
• Machine Learning : A computer program is said to learn
from experience E, with respective to some class of task T,
and performance measure p, if its performance attask in
T,as measured by p, improves with experience E.
• improve their performance P
• at some task T
• with experience E.
A well-defined learning task is given (P,T,E)
• What is Task
– Classification
– Categorization/clustering
– Problem solving / planning / control
– Prediction
– others
 What is Machine Learning?
• It is very hard to write programs that solve problems like
recognizing a face.
– We don’t know what program to write because we don’t
know how our brain does it.
– Even if we had a good idea about how to do it, the
program might be horrendously complicated.
• Instead of writing a program by hand, we collect lots of
examples that specify the correct output for a given input.
• A machine learning algorithm then takes these examples
and produces a program that does the job.
– The program produced by the learning algorithm may
look very different from a typical hand-written program. It
may contain millions of numbers.
– If we do it right, the program works for new cases as well
as the ones we trained it on.
 Why Study Machine Learning?
Developing Better Computing Systems

• Develop systems that are too difficult/expensive to construct

manually because they require specific detailed skills or
knowledge tuned to a specific task (knowledge
engineering bottleneck).
• Develop systems that can automatically adapt and
customize themselves to individual users.
– Personalized news or mail filter
– Personalized tutoring
• Discover new knowledge from large databases (data
mining).
– Market basket analysis (e.g. diapers and beer)
– Medical text mining (e.g. migraines to calcium channel blockers to
magnesium)
 When to use Machine Learning?
• Human expertise dose not exist (navigating on Mars)
• Human can’t explain their expertise (speech recognition)
• Model must be customized (personalized medicine).
• Model based on huge amount of data (data mining.

• improve their performance P

• at some task T
• with experience E.
A well-defined learning task is given (P,T,E)
 A classic example of a task that requires machine
learning: It is very hard to say what makes a 2
Some more examples of tasks that are best
solved by using a learning algorithm

• Recognizing patterns:
– Facial identities or facial expressions
– Handwritten or spoken words
– Medical images
• Generating patterns:
– Generating images or motion sequences (demo)
• Recognizing anomalies:
– Unusual sequences of credit card transactions
– Unusual patterns of sensor readings in a nuclear
power plant or unusual sound in your car engine.
• Prediction:
– Future stock prices or currency exchange rates
 Some web-based examples of machine learning

• The web contains a lot of data. Tasks with very big

datasets often use machine learning
– especially if the data is noisy or non-stationary.
• Spam filtering, fraud detection:
– The enemy adapts so we must adapt too.
• Recommendation systems:
– Lots of noisy data. Million dollar prize!
• Information retrieval:
– Find documents or images with similar content.
• Data Visualization:
– Display a huge database in a revealing way (demo)
 Data:-data is information that has been translated into a
form that is efficient for movement or processing.
• Artificial Intelligence
• Data Mining
• Probability and Statistics
• Information theory
• Numerical optimization
• Computational complexity theory
• Control theory (adaptive)
• Psychology (developmental, cognitive)
• Neurobiology
• Linguistics
• Philosophy
 Some web-based examples of machine learning

• The web contains a lot of data. Tasks with very big

datasets often use machine learning
– especially if the data is noisy or non-stationary.
• Spam filtering, fraud detection:
– The enemy adapts so we must adapt too.
• Recommendation systems:
– Lots of noisy data. Million dollar prize!
• Information retrieval:
– Find documents or images with similar content.
• Data Visualization:
– Display a huge database in a revealing way (demo)
Data- is information that has been translated into a form that is efficient
for movement or processing
Traditional programming and Machine
Learning
Learning process
Types of Machine Learning
 Supervised learning
• It is a learning function that maps input to an output based on example
input output pairs
• supervised learning Classification is seen as supervised learning from
examples.
• It is defined as input variable (X) which is predefined class (labeled
data) and output variable (Y) and use algorithm to learn mapping
function from input to output.
Y=f(X)
• Learning or train the model using training data set
• Test the model using unseen test data set to access the model
accuracy Number of correct classifications
Accuracy  ,
Total number of test cases
 Supervised learning
• The model is used to classify or to find out corresponding Y value for the
new observation X. so that given new input X you can use the model to
find out output Y.

• supervised learning are grouped in to

- Classification :- when output variable is having some category
such as disease or no disease

- Regression/ Prediction- when output variable is real value such as

weight.
Classification

• Example: Credit
scoring
• Differentiating
between low-risk
and high-risk
customers from
their income and
savings
Model

Discriminant: IF income > θ1 AND savings > θ2

THEN20low-risk ELSE high-risk
Prediction: Regression

• Example: Price of a
used car
y = wx+w0
• x : car attributes
y : price
y = g (x | θ)
g ( ) model,
θ parameters

21
 Unsupervised learning
• Unsupervised learning is a type of machine learning that
looks for previously undetected patterns in a data set with
no pre-existing labels and with a minimum of human
supervision
• The training data set is an unlabeled data set.
• In other words, the training data set contains only the input
value (X) and not the target value (Y).
• Based on the similarity between data, it tries to draw
inference from the data such as finding patterns or clusters
Unsupervised learning Example
Supervised VsUnsupervised learning
 Semi-supervised learning
• In this large amount of input data (X) only some of data is labeled.
• It combines datasets of labeled and unlabeled data for training
• Principle of semi-supervised learning is that leveraging a small amount of
labelled data through supervised learning with a larger amount of
unlabeled data through unsupervised learning can yield better accuracy
than completely supervised models in many scenarios Based on the
similarity between data,
• This techniques depend on simulated labeled/unlabeled data by splitting
a fully annotated dataset and is therefore likely to be upper-bounded by
fully supervised learning with all annotations.
 Reinforcement learning
• Reinforcement :- Occurrence of an event, in the proper relation to a
response, that tends to increase the probability that the response will
occur again in the same situation.
• Reinforcement Learning:- It is the problem faced by an agent that learns
behaviour through trial and error interaction with dynamic environment.
• It is a learning how to act in order to maximize a numerical reward.
• In this system learns from the feedback provided by environment .
• The feedback is usually in the form of reward or penalty. It is useful to
understand whether a certain action performed in a state is positive or not
• It is a technique to allow an agent to take action and interact with
environment so as to maximize the total rewards
• The sequence of most useful action is a policy that agent has to learn, so
to be able to make best decision in terms of the highest immediate and
cumulative rewards.
• This concept is based on the idea that rational agent always pursues the
objective that can increase his/ her wealth.
• This learning is particularly efficient when environment is not completely
deteminstic.
Reinforcement learning
 Reinforcement learning
• Policy:- It is a mapping from perceived states of the environment to
action to be taken when in those states .
• Reward Function:- It defines the goal in reinforcement learning problem.
It maps each perceived state of the environment to a single number,
reward, indicating the intrinsic desirability of the state
• Value Function:- Specifies what is good in the long run. The value of the
state is the total amount of reward an agent can expect to accumulate
over the future, starting from that state
 Steps for Reinforcement learning

• The agent observes an input state

• An action is determined by a decision making function (policy)
• The action is performed
• The agent receives a scalar reward or reinforcement from the
environment.
• Information about the reward given for that state/ action pair is recorded