Scribd
Upload
18 views23 pages

Week 7 (ANN)

Deep learning is a subset of machine learning that utilizes artificial neural networks to enable computers to learn from data and recognize patterns, inspired by the human brain. Applications include image recognition, autonomous vehicles, and healthcare, while neural networks consist of input, hidden, and output layers that process data. Key components include activation functions, such as ReLU and sigmoid, and the backpropagation method for training the networks by minimizing prediction errors.

Uploaded by

sowmisoms0
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
18 views23 pages

Week 7 (ANN)

Deep learning is a subset of machine learning that utilizes artificial neural networks to enable computers to learn from data and recognize patterns, inspired by the human brain. Applications include image recognition, autonomous vehicles, and healthcare, while neural networks consist of input, hidden, and output layers that process data. Key components include activation functions, such as ReLU and sigmoid, and the backpropagation method for training the networks by minimizing prediction errors.

Uploaded by

sowmisoms0
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 23

Deep Learning

What is Deep Learning


• Deep learning is a type of machine learning that uses
artificial neural networks to teach computers to learn
from data and recognize patterns. It's inspired by the
human brain's ability to make complex decisions.

Deep learning can be used to automate tasks that


typically require human intelligence.
Applications
• Image Recognition
• Autonomous Vehicles
• Facial Recognition
• Healthcare
• Robotics
What is neural networks
• A neural network is a machine
learning model that mimics the
human brain's structure and
function to process data and learn
from it. Neural networks are also
known as artificial neural networks
(ANNs)
How
biological
Neuron
works
• Dendrites
• These receive information or signals from other neurons that get connected to it.

• Cell Body
• Information processing happens in a cell body. These take in all the information coming from the
different dendrites and process that information.

• Axon
• It sends the output signal to another neuron for the flow of information. Here, each of the flanges
connects to the dendrite or the hairs on the next one.
Artificial Neural
Network
• The term "Artificial neural network"
refers to a biologically inspired sub-field
of artificial intelligence modeled after the
brain. An Artificial neural network is
usually a computational network based
on biological neural networks that
construct the structure of the human
brain.
ANN – Three Types of
Layers
How an ANN replicates a
biological neuron.

• Input to a neuron - input layer


• Neuron - hidden layer
• Output to the next neuron - output
layer
The typical Artificial
Neural Network looks
something like the
given figure.
• ANN operates on something referred to as
Hidden State. These hidden states are
similar to neurons. Each of these hidden
state is a transient form which has a
probabilistic behavior. A grid of such
hidden state act as a bridge between the
How does input and the output.¶

ANN work?¶
• We have an input layer which is the data
we provide to the ANN. We have the
hidden layers, which is where the magic
happens. Lastly, we have the output layer,
which is where the finished computations
of the network are placed for us to use.¶
• When the result is out it is compared to the actual value and a back
propagation algorithm comes into play to adjust the weights of the network
linkages to better the result.

Activation Function
• An activation function in a neural network determines which neurons are
activated as information moves through the network. It uses mathematical
operations to decide if a neuron's input is important for prediction.
What Are Activation Functions?

• Activation functions are an integral building block of


neural networks that enable them to learn complex patterns in data.
They transform the input signal of a node in a neural network into an
output signal that is then passed on to the next layer.
• Without activation functions, neural networks would be restricted to
modeling only linear relationships between inputs and outputs.
Why Are Activation Functions
Essential?
• Without activation functions, neural networks would just consist of
linear operations like matrix multiplication. All layers would perform
linear transformations of the input, and no non-linearities would be
introduced.
• Most real-world data is non-linear. For example, relationships between
house prices and size, income, and purchases, etc., are non-linear.
Types of
Activation
Functions
• Linear activation
• The main use case of the linear activation function is in the
output layer of a neural network used for regression. For
regression problems where we want to predict a numerical
value, using a linear activation function in the output layer
ensures the neural network outputs a numerical value.
Sigmoid
activation

• It takes a real-valued input and


squashes it to a value between 0 and 1.
The sigmoid function has an "S"-
shaped curve that asymptotes to 0 for
large negative numbers and 1 for large
positive numbers. The outputs can be
easily interpreted as probabilities,
which makes it natural for binary
classification problems.
ReLU (rectified
linear unit)
activation
•The rectified linear unit (ReLU) or
rectifier activation
function introduces the property of
nonlinearity to a deep l

•This model and solves the


vanishing gradients issue.
• ReLU formula is : f(x) = max(0,x)
• Both the ReLU function and its derivative are monotonic. If the function
receives any negative input, it returns 0; however, if the function receives any
positive value x, it returns that value.As a result, the output has a range of 0 to
infinite.
• ReLU is the most often used activation function in neural networks, especially
CNNs, and is utilized as the default activation function.
Backpropagation

Backpropagation (short for "Backward Propagation of Errors") is a method


used to train artificial neural networks.
Its goal is to reduce the difference between the model’s predicted output and the
actual outp
It works iteratively, minimizing the cost function by adjusting weights and
biases. ut by adjusting the weights and biases in the network.

You might also like