Scribd
Upload
22 views20 pages

Classification by Back Propagation Iv1

Uploaded by

harikrishnahk6305
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
22 views20 pages

Classification by Back Propagation Iv1

Uploaded by

harikrishnahk6305
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 20

Classification by Back

Propagation
 Need for Backpropagation:
 Backpropagation is “backpropagation of
errors” and is very useful for training neural
networks. It’s fast, easy to implement, and
simple. Backpropagation does not require
any parameters to be set, except the
number of inputs. Backpropagation is a
flexible method because no prior knowledge
of the network is required.
Neural Network:
 Neural networks are an information
processing paradigm inspired by the human
nervous system. Just like in the human
nervous system, we have biological neurons
in the same way in neural networks we have
artificial neurons, artificial neurons are
mathematical functions derived from
biological neurons. The human brain is
estimated to have about 10 billion neurons,
each connected to an average of 10,000
other neurons. Each neuron receives a signal
through a synapse, which controls the effect
of the signconcerning on the neuron.
Backpropagation:
 Backpropagation is a widely used algorithm for training
feedforward neural networks. It computes the gradient
of the loss function with respect to the network
weights. It is very efficient, rather than naively directly
computing the gradient concerning each weight. This
efficiency makes it possible to use gradient methods to
train multi-layer networks and update weights to
minimize loss; variants such as gradient descent or
stochastic gradient descent are often used.
 The backpropagation algorithm works by computing
the gradient of the loss function with respect to each
weight via the chain rule, computing the gradient layer
by layer, and iterating backward from the last layer to
avoid redundant computation of intermediate terms in
the chain rule.
Backpropagation is an algorithm
that backpropagates the errors
from the output nodes to the
input nodes. Therefore, it is
simply referred to as the
backward propagation of errors.
It uses in the vast applications of
neural networks in data mining
like Character recognition,
Signature verification, etc.
 There are two types of backpropagation networks.
• Static backpropagation: Static backpropagation is
a network designed to map static inputs for static
outputs. These types of networks are capable of
solving static classification problems such as OCR
(Optical Character Recognition).

• Recurrent backpropagation: Recursive


backpropagation is another network used for fixed-
point learning. Activation in recurrent
backpropagation is feed-forward until a fixed value is
reached. Static backpropagation provides an instant
mapping, while recurrent backpropagation does not
provide an instant mapping.
 Advantages:

• It is simple, fast, and easy to program.

• Only numbers of the input are tuned, not any other parameter.

• It is Flexible and efficient.

• No need for users to learn any special functions.

 Disadvantages:

• It is sensitive to noisy data and irregularities. Noisy data can lead to inaccurate
results.

• Performance is highly dependent on input data.

• Spending too much time training.

• The matrix-based approach is preferred over a mini-batch.


Back Propagation
Neural Network learning
algorithm.
Thank You…

You might also like