Introduction to Machine Learning

 Arthur Samuel (1959): “Machine Learning is a field of study that

gives computers, the ability to learn without explicitly being programmed.
“Samuel wrote a Checker playing program which could learn over time. At first
it could be easily won. But over time, it learnt all the board position that would
eventually lead him to victory or loss and thus became a better chess player than
Samuel itself. This was one of the earliest attempts of defining Machine Learning
and is somewhat less formal.

 Tom Michel(1999): “A computer program is said to learn from experience E with

respect to some class of tasks T and performance measure P, if its performance at
tasks in T, as measured by P, improves with experience E.” This is a more formal
and mathematical definition. For the previous Chess program
– E is number of games.
– T is playing chess against computer.
– P is win/loss by computer.

ML is programming computers using data (past experience) to optimize a

performance criterion.
 ML relies on:
– Statistics: making inferences from sample data.
– Numerical algorithms (linear algebra, optimization): optimize criteria,
manipulate models.
– Computer science: data structures and programs that solve a ML problem
efficiently.
 A model:
– is a compressed version of a database;
– extracts knowledge from it
– Does not have perfect performance but is a useful approximation to the data.

“Machine learning enables a machine to automatically learn from data, improve

performance from experiences, and predict things without being explicitly
programmed”.
Machine learning focuses on the development of computer programs that can access
data and use it learn for themselves.
Machine Learning is a branch of artificial intelligence based on the idea that systems
can learn from data, identify patterns and make decisions with minimal human
intervention.

Traditional programming and Machine learning

 The complexity in traditional computer programming is in the code (programs that

people write). In machine learning, algorithms (programs) are in principle simple
and the complexity (structure) is in the data.
 That is, machine learning is the about the construction and study of systems that
can learn from data. This is very different than traditional computer programming.

 Traditional Programming: DATA (Input) + PROGRAM (logic), run it on

machine and get output.
 Machine Learning: DATA (Input) + Output, run it on machine during
training and the machine creates its own program (logic), which can be evaluated
while testing.
 Artificial Intelligence Vs Machine Learning Vs Deep Learning

Artificial Intelligence : The word Artificial Intelligence comprises of two words

“Artificial” and “Intelligence”. Artificial refers to something which is made by
human or non-natural thing and Intelligence means ability to understand or think.
There is a misconception that Artificial Intelligence is a system, but it is not a system
.AI is implemented in the system. There can be so many definition of AI, one
definition can be “It is the study of how to train the computers so that computers
can do things which at present human can do better. “Therefore it is an intelligence
where we want to add all the capabilities to machine that human contain.
Examples of Artificial Intelligence (AI):
Self-Driving Cars: Artificial Intelligence (AI) can be used to create a fully
autonomous car’s to travel between destinations without a human operator.
Machine Learning: Machine learning is a subset, an application of Artificial
Intelligence (AI) that offers the ability to the system to learn and improve from
experience without being programmed to that level. Machine Learning uses data to
train and find accurate results. Machine learning focuses on the development of a
computer program that accesses the data and uses it to learn from themselves.

Deep Learning: Deep Learning is a subset of Machine Learning where the artificial
neural network, the recurrent neural network comes in relation. The algorithms are
created exactly just like machine learning but it consists of many more levels of
algorithms. All these networks of the algorithm are together called as the artificial
neural network. In much simpler terms, it replicates just like the human brain as all
the neural networks are connected in the brain, exactly is the concept of deep
learning. It solves all the complex problems with the help of algorithms and its
process.
AI is a bigger concept to create intelligent machines that can simulate human
thinking capability and behavior, whereas, machine learning is an application or
subset of AI that allows machines to learn from data without being programmed
explicitly. It is a method of training algorithms such that they can learn how to make
decisions. Training in machine learning entails giving a lot of data to the algorithm
and allowing it to learn more about the processed information. Deep learning is a
subset of ML; in fact, it’s simply a technique for realizing machine learning. In other
words, DL is the next evolution of machine learning.

Artificial Intelligence Machine learning

Artificial intelligence is a Machine learning is a subset of AI
technology which enables a machine which allows a machine to
to simulate human behavior. automatically learn from past data
without programming explicitly.
The goal of AI is to make a smart The goal of ML is to allow machines
computer system like humans to to learn from data so that they can
solve complex problems. give accurate output.
 In AI, we make intelligent systems In ML, we teach machines with data
to perform any task like a human. to perform a particular task and give
an accurate result.
Machine learning and deep learning Deep learning is a main subset of
are the two main subsets of AI. machine learning.
AI has a very wide range of scope. Machine learning has a limited
scope.
AI is working to create an intelligent Machine learning is working to
system which can perform various create machines that can perform
complex tasks. only those specific tasks for which
they are trained.
AI system is concerned about Machine learning is mainly
maximizing the chances of success. concerned about accuracy and
patterns.

Types of Learning Approaches

Supervised Learning
Supervised machine learning algorithms can apply what has been learned in the past
to new data using labeled examples to predict future events. Starting from the
analysis of a known training dataset, the learning algorithm produces an inferred
function to make predictions about the output values. The system is able to provide
targets for any new input after sufficient training. The learning algorithm can also
compare its output with the correct, intended output and find errors in order to
modify the model accordingly.
In supervised learning, the goal is to learn the mapping (the rules) between a set
of inputs and outputs.
For example, the inputs could be the weather forecast, and the outputs would be the
visitors to the beach. The goal in supervised learning would be to learn the mapping
that describes the relationship between temperature and number of beach visitors.
Example labelled data is provided of past input and output pairs during the learning
process to teach the model how it should behave, hence, ‘supervised’ learning. For
the beach example, new inputs can then be fed in of forecast temperature and the
Machine learning algorithm will then output a future prediction for the number of
visitors.
Supervised learning classified into two categories of algorithms:
• Classification: A classification problem is when the output variable is a category,
such as “Red” or “blue” or “disease” and “no disease”. Machine Learning is used
to find the rules that explain how to separate the different data points.
• Regression: A regression problem is when the output variable is a real value,
such as “dollars” or “weight”. The difference between classification and
regression is that regression outputs a number rather than a class. Therefore,
regression is useful when predicting number based problems like stock market
prices, the temperature for a given day, or the probability of an event.

The output from a supervised Machine Learning model could be a category from a
finite set e.g [low, medium, high] for the number of visitors to the beach:
Input [temperature=20] -> Model -> Output = [visitors=high]
When this is the case, it’s is deciding how to classify the input, and so is known
as classification. Alternatively, the output could be a real-world scalar (output a
number):
Input [temperature=20] -> Model -> Output = [visitors=300]

When this is the case, it is known as regression.

Let's see now how you can develop a supervised learning model of this example
which help the user to determine the commute time. The first thing you requires to
create is a training set. This training set will contain the total commute time and
corresponding factors like weather, time, etc. Based on this training set, your machine
might see there's a direct relationship between the amount of rain and time you will
take to get home.

So, it ascertains that the more it rains, the longer you will be driving to get back to
your home. It might also see the connection between the time you leave work and the
time you'll be on the road.

Unsupervised Learning

 Unsupervised machine learning algorithms are used when the information used to
train is neither classified nor labeled. Unsupervised learning studies how systems
can infer a function to describe a hidden structure from unlabeled data. The system
doesn’t figure out the right output, but it explores the data and can draw inferences
from datasets to describe hidden structures from unlabeled data.
 An example of unsupervised learning in real life would be sorting different colour
coins into separate piles. Nobody taught you how to separate them, but by just
looking at their features such as colour, you can see which colour coins
are associated and cluster them into their correct groups.
 Unsupervised learning is a type of machine learning in which models are trained
using unlabeled dataset and are allowed to act on that data without any
supervision.
 The unsupervised learning algorithm can be further categorized into two types of
problems: (a) Clustering (b) Association
 The goal of unsupervised learning is to find the underlying structure of dataset,
group that data according to similarities, and represent that dataset in a
compressed format.

Clustering

Clustering is a method of grouping the objects into clusters such that objects with
most similarities remains into a group and has less or no similarities with the objects
of another group. Clustering is the act of creating groups with differing
characteristics. Clustering attempts to find various subgroups within a dataset.

Common algorithms for performing clustering include k-means and k-

medoids, hierarchical clustering, Gaussian mixture models, hidden Markov
models, self-organizing maps, fuzzy c-means clustering, and subtractive clustering.

Association

In Association Learning you want to uncover the rules that describe your data.
For example, if a person watches video, they will likely watch video B. Association
rules are perfect for examples such as this where you want to find related items.

An association rule is an unsupervised learning method which is used for finding the
relationships between variables in the large database. It determines the set of items
that occurs together in the dataset.

Reinforcement Learning
Reinforcement machine learning is a learning method that interacts with its
environment by producing actions and discovers errors or rewards. Trial and error
search and delayed reward are the most relevant characteristics of reinforcement
learning. This method allows machines and software agents to automatically
determine the ideal behavior within a specific context in order to maximize its
performance. Simple reward feedback is required for the agent to learn which action
is best; this is known as the reinforcement signal.
A Reinforcement learning algorithm, or agent, learns by interacting with its
environment. The agent receives rewards by performing correctly and penalties for
performing incorrectly. The agent learns without intervention from a human by
maximizing its reward and minimizing its penalty. It is a type of dynamic
programming that trains algorithms using a system of reward and punishment.
A Reinforcement Learning algorithm just aims to maximize its rewards by playing
the game over and over again.