Scribd
Upload
26 views

Unit 5 - Notes

Uploaded by

927623mca060
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
26 views

Unit 5 - Notes

Uploaded by

927623mca060
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Elements of a Neural Network :-

● Input Layer :- This layer accepts input features. It provides information


from the outside world to the network, no computation is performed at this
layer, nodes here just pass on the information(features) to the hidden layer.
● Hidden Layer :- Nodes of this layer are not exposed to the outer world, they
are the part of the abstraction provided by any neural network. Hidden layer
performs all sort of computation on the features entered through the input
layer and transfer the result to the output layer.
● Output Layer :- This layer bring up the information learned by the network
to the outer world.
The definition of Deep learning is that it is the branch of machine learning that is
based on artificial neural network architecture.

In a fully connected Deep neural network, there is an input layer and one or more
hidden layers connected one after the other. Each neuron receives input from the
previous layer neurons or the input layer. The output of one neuron becomes
the input to other neurons in the next layer of the network, and this process
continues until the final layer produces the output of the network

Diagrams/Notes/How it differ from ML please refer the below website:

https://www.geeksforgeeks.org/introduction-deep-learning/

Types of neural networks

The most widely used architectures in deep learning are:

✔ feedforward neural networks

✔ convolutional neural networks (CNNs)

✔ recurrent neural networks (RNNs).

Activation Function :
It decides whether a neuron should be activated or not by calculating the weighted sum and further
adding bias to it. It also the model to learn complex patterns.
 Weights: Parameters that are learned during training. They represent the strength of the
connection between neurons.

 Biases: Additional parameters that allow the model to fit the data better.

Common Activation Functions:

The below are the popular Activation Functions used in Deep Learning - - - - >

● Sigmoid: Outputs values between 0 and 1, useful for binary classification.


● ReLU (Rectified Linear Unit): Outputs the input directly if it is positive; otherwise, it
outputs zero. It is widely used due to its simplicity and effectiveness.
● Tanh: Outputs values between -1 and 1

Feed forward and Back propagation

During forward propagation, the input is fed into the neural network, and the network calculates the
output. During backward propagation, the error between the predicted output and the actual output is
calculated, and the weights and biases of each neuron are adjusted to reduce the error

Forward Propagation

● The process where input data passes through the network layer by layer to generate an output.

Backward Propagation

● The process of updating the weights and biases by propagating the error back through the
network.

You might also like