10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

20

Backpropagation in Neural Network

Last Updated : 09 Jul, 2024

Statistics with Python Data Analysis Tutorial Python – Data visualization tutorial NumPy Pandas

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 1/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 2/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

Once we have done the calculation at the output layer, we then

propagate the error backward through the network, layer by layer.
The key calculation during the backward pass is determining the
gradients for each weight and bias in the network. This gradient is
responsible for telling us how much each weight/bias should be
adjusted to minimize the error in the next forward pass. The chain
rule is used iteratively to calculate this gradient efficiently.
In addition to gradient calculation, the activation function also plays a
crucial role in backpropagation, it works by calculating the gradients
with the help of the derivative of the activation function.

Example of Backpropagation in Machine Learning

Let us now take an example to explain backpropagation in Machine
Learning,

Assume that the neurons have the sigmoid activation function to

perform forward and backward pass on the network. And also
assume that the actual output of y is 0.5 and the learning rate is 1.
Now perform the backpropagation using backpropagation algorithm.

Read More

Similar Reads
Backpropagation in Convolutional Neural Networks
Convolutional Neural Networks (CNNs) have become the backbone of
many modern image processing systems. Their ability to learn hierarchic…
4 min read

How Does Gradient Descent and Backpropagation Work Together?

Answer: Gradient descent updates the model parameters iteratively using
gradients computed by backpropagation, which efficiently calculates the…
2 min read

How to Update Bias and Bias's Weight Using Backpropagation…

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 3/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

Answer: In backpropagation, biases are updated by applying the chain

rule to the loss function with respect to the bias parameters in each layer…
3 min read

A single neuron neural network in Python

Neural networks are the core of deep learning, a field that has practical
applications in many different areas. Today neural networks are used for…
3 min read

Effect of Bias in Neural Network

Neural Network is conceptually based on actual neuron of brain. Neurons
are the basic units of a large neural network. A single neuron passes…
3 min read

Importance of Convolutional Neural Network | ML

Convolutional Neural Network as the name suggests is a neural network
that makes use of convolution operation to classify and predict. Let's…
2 min read

Neural Network Advances

We know that our world is changing quickly but there are lot of concrete
technology advances that you might not hear a lot about in the…
3 min read

Why For loop is not preferred in Neural Network Problems?

For loop take much time for completing iterations and in ML practise we
have to optimize the time so we can use for loops. But then you must be…
2 min read

Implementation of Artificial Neural Network for AND Logic Gate wit…

Artificial Neural Network (ANN) is a computational model based on the
biological neural networks of animal brains. ANN is modeled with three…
4 min read

Implementation of Artificial Neural Network for OR Logic Gate with …

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 4/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

Artificial Neural Network (ANN) is a computational model based on the

biological neural networks of animal brains. ANN is modeled with three…
4 min read

Article Tags : Machine Learning AI-ML-DS ML-Statistics Python-PyTorch

Practice Tags : Machine Learning

Corporate & Communications Address:-

A-143, 9th Floor, Sovereign Corporate
Tower, Sector- 136, Noida, Uttar Pradesh
(201305) | Registered Address:- K 061,
Tower K, Gulshan Vivante Apartment,
Sector 137, Noida, Gautam Buddh
Nagar, Uttar Pradesh, 201305

Company Explore
About Us Job-A-Thon Hiring Challenge
Legal Hack-A-Thon
Careers GfG Weekly Contest
In Media Offline Classes (Delhi/NCR)
Contact Us DSA in JAVA/C++

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 5/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

Advertise with us Master System Design

GFG Corporate Solution Master CP
Placement Training Program GeeksforGeeks Videos
Geeks Community

Languages DSA
Python Data Structures
Java Algorithms
C++ DSA for Beginners
PHP Basic DSA Problems
GoLang DSA Roadmap
SQL DSA Interview Questions
R Language Competitive Programming
Android Tutorial

Data Science & ML Web Technologies

Data Science With Python HTML
Data Science For Beginner CSS
Machine Learning JavaScript
ML Maths TypeScript
Data Visualisation ReactJS
Pandas NextJS
NumPy NodeJs
NLP Bootstrap
Deep Learning Tailwind CSS

Python Tutorial Computer Science

Python Programming Examples GATE CS Notes
Django Tutorial Operating Systems
Python Projects Computer Network
Python Tkinter Database Management System
Web Scraping Software Engineering
OpenCV Tutorial Digital Logic Design
Python Interview Question Engineering Maths

DevOps System Design

Git High Level Design
AWS Low Level Design
Docker UML Diagrams
Kubernetes Interview Guide
Azure Design Patterns
GCP OOAD
DevOps Roadmap System Design Bootcamp
Interview Questions

School Subjects Commerce

Mathematics Accountancy
Physics Business Studies
Chemistry Economics

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 6/7
10/18/24, 5:53 PM Backpropagation in Neural Network - GeeksforGeeks

Biology Management
Social Science HR Management
English Grammar Finance
Income Tax

Databases Preparation Corner

SQL Company-Wise Recruitment Process
MYSQL Resume Templates
PostgreSQL Aptitude Preparation
PL/SQL Puzzles
MongoDB Company-Wise Preparation
Companies
Colleges

Competitive Exams More Tutorials

JEE Advanced Software Development
UGC NET Software Testing
UPSC Product Management
SSC CGL Project Management
SBI PO Linux
SBI Clerk Excel
IBPS PO All Cheat Sheets
IBPS Clerk Recent Articles

Free Online Tools Write & Earn

Typing Test Write an Article
Image Editor Improve an Article
Code Formatters Pick Topics to Write
Code Converters Share your Experiences
Currency Converter Internships
Random Number Generator
Random Password Generator

@GeeksforGeeks, Sanchhaya Education Private Limited, All rights reserved

https://www.geeksforgeeks.org/backpropagation-in-neural-network/ 7/7