Introduction to Deep Learning

• Deep Learning stands as a cornerstone technology, revolutionizing how

machines understand, learn, and interact with complex data.
• Deep Learning AI mimics the intricate neural networks of the human brain,
enabling computers to autonomously discover patterns and make
decisions from vast amounts of unstructured data.
• This transformative field has propelled breakthroughs across various
domains, from computer vision and natural language processing to
healthcare diagnostics and autonomous driving.
Rectified linear unit
• In a fully connected Deepneural network, there is an input layer and one or more hidden layers connected one after the
other.

• Each neuron receives input from the previous layer neurons or the input layer.

• The output of one neuron becomes the input to other neurons in the next layer of the network, and this process continues
until the final layer produces the output of the network.

• The layers of the neural network transform the input data through a series of nonlinear transformations, allowing the
network to learn complex representations of the input data

• Today Deep learning AI has become one of the most popular and visible areas of machine learning, due to its success in
a variety of applications, such as computer vision, natural language processing, and Reinforcement learning.
Deep learning AI can be used for supervised, unsupervised as well as reinforcement machine learning. it
uses a variety of ways to process these.

Supervised Machine Learning: Supervised machine learning is the machine learning technique in which
the neural network learns to make predictions or classify data based on the labeled datasets.

Here we input both input features along with the target variables.

The neural network learns to make predictions based on the cost or error that comes from the difference
between the predicted and the actual target.

This process is known as backpropagation.

Deep learning algorithms like Convolutional neural networks, Recurrent neural networks are used for
many supervised tasks like image classifications and recognization, sentiment analysis, language
translations, etc.
• Unsupervised Machine Learning: Unsupervised machine learning is the machine learning technique in which the neural
network learns to discover the patterns or to cluster the dataset based on unlabeled datasets.

• Here there are no target variables.

• Deep learning algorithms like auto encoders and generative models are used for unsupervised tasks like clustering,
dimensionality reduction, and anomaly detection.

•Reinforcement Machine Learning: Reinforcement Machine Learning is the machine learning technique in
which an agent learns to make decisions in an environment to maximize a reward signal.

• The agent interacts with the environment by taking action and observing the resulting rewards.

• Deep learning can be used to learn policies, or a set of actions, that maximizes the cumulative reward over time.

• Deep reinforcement learning algorithms like Deep Q networks DQN) and Deep Deterministic Policy Gradient
(DDPG) are used to reinforce tasks like robotics and game playing etc.
Artificial neural networks

Artificial neural networks are built on the principles of the structure and operation of human neurons.
It is also known as neural networks or neural nets.

An artificial neural network’s input layer, which is the first layer, receives input from external sources and passes it on
to the hidden layer, which is the second layer.

Each neuron in the hidden layer gets information from the neurons in the previous layer, computes the weighted total,
and then transfers it to the neurons in the next layer.

These connections are weighted, which means that the impacts of the inputs from the preceding layer are more or less
optimized by giving each input a distinct weight.

These weights are then adjusted during the training process to enhance the performance of the model.
 Difference between Machine Learning and Deep Learning :

Machine Learning Deep Learning

Apply statistical algorithms to learn the hidden patterns and Uses artificial neural network architecture to learn the hidden
relationships in the dataset. patterns and relationships in the dataset.

Requires the larger volume of dataset compared to machine

Can work on the smaller amount of dataset
learning

Better for complex task like image processing, natural language

Better for the low-label task.
processing, etc.

Takes less time to train the model. Takes more time to train the model.

A model is created by relevant features which are manually Relevant features are automatically extracted from images. It is
extracted from images to detect an object in the image. an end-to-end learning process.

More complex, it works like the black box interpretations of the

Less complex and easy to interpret the result.
result are not easy.

It can work on the CPU or requires less computing power as

It requires a high-performance computer with GPU.
compared to deep learning.
 Types of neural networks

Deep Learning models are able to automatically learn features from the data, which makes them well-suited for tasks
such as image recognition, speech recognition, and natural language processing. The most widely used architectures in
deep learning are feedforward neural networks, convolutional neural networks (CNNs), and recurrent neural networks
(RNNs).

Feedforward neural networks: are the simplest type of ANN, with a linear flow of information through the network.
FNNs have been widely used for tasks such as image classification, speech recognition, and natural language
processing.

Convolutional neural networks: are specifically for image and video recognition tasks. CNNs are able to automatically
learn features from the images, which makes them well-suited for tasks such as image classification, object detection,
and image segmentation.

Recurrent neural networks (RNNs): are a type of neural network that is able to process sequential data, such as time
series and natural language. RNNs are able to maintain an internal state that captures information about the previous
inputs, which makes them well-suited for tasks such as speech recognition, natural language processing, and language
translation.
 Deep Learning Applications:

The main applications of deep learning AI can be divided into computer vision, natural language processing (NLP),
and reinforcement learning.

1. Computer vision
The first Deep Learning applications is Computer vision. In computer vision, Deep learning AI models can enable
machines to identify and understand visual data. Some of the main applications of deep learning in computer vision
include:

•Object detection and recognition: Deep learning model can be used to identify and locate objects within images and
videos, making it possible for machines to perform tasks such as self-driving cars, surveillance, and robotics.

•Image classification: Deep learning models can be used to classify images into categories such as animals, plants,
and buildings. This is used in applications such as medical imaging, quality control, and image retrieval.

•Image segmentation: Deep learning models can be used for image segmentation into different regions, making it
possible to identify specific features within images.
2. Natural language processing (NLP):
In Deep learning applications, second application is NLP. NLP, the Deep learning model can enable machines to
understand and generate human language. Some of the main applications of deep learning in NLP include:

•Automatic Text Generation – Deep learning model can learn the corpus of text and new text like summaries,
essays can be automatically generated using these trained models.

•Language translation: Deep learning models can translate text from one language to another, making it possible
to communicate with people from different linguistic backgrounds.

•Sentiment analysis: Deep learning models can analyze the sentiment of a piece of text, making it possible to
determine whether the text is positive, negative, or neutral. This is used in applications such as customer service,
social media monitoring, and political analysis.

•Speech recognition: Deep learning models can recognize and transcribe spoken words, making it possible to
perform tasks such as speech-to-text conversion, voice search, and voice-controlled devices.
3. Reinforcement learning:
In reinforcement learning, deep learning works as training agents to take action in an environment to
maximize a reward. Some of the main applications of deep learning in reinforcement learning include:

•Game playing: Deep reinforcement learning models have been able to beat human experts at games such as
Go, Chess, and Atari.

•Robotics: Deep reinforcement learning models can be used to train robots to perform complex tasks such as
grasping objects, navigation, and manipulation.

•Control systems: Deep reinforcement learning models can be used to control complex systems such as
power grids, traffic management, and supply chain optimization.
 Challenges in Deep Learning
Deep learning has made significant advancements in various fields, but there are still some challenges that need to
be addressed. Here are some of the main challenges in deep learning:

1.Data availability: It requires large amounts of data to learn from. For using deep learning it’s a big concern to
gather as much data for training.

2.Computational Resources: For training the deep learning model, it is computationally expensive because it
requires specialized hardware like GPUs and TPUs.

3.Time-consuming: While working on sequential data depending on the computational resource it can take very
large even in days or months.

4.Interpretability: Deep learning models are complex, it works like a black box. it is very difficult to interpret the
result.

5.Overfitting: when the model is trained again and again, it becomes too specialized for the training data, leading to
overfitting and poor performance on new data.
GPU- Graphic Processing Unit
TPU- Tensor Processing Unit
 Advantages of Deep Learning:

1.High accuracy: Deep Learning algorithms can achieve state-of-the-art performance in various tasks, such as image
recognition and natural language processing.

2.Automated feature engineering: Deep Learning algorithms can automatically discover and learn relevant features
from data without the need for manual feature engineering.

3.Scalability: Deep Learning models can scale to handle large and complex datasets, and can learn from massive
amounts of data.

4.Flexibility: Deep Learning models can be applied to a wide range of tasks and can handle various types of data, such as
images, text, and speech.

5.Continual improvement: Deep Learning models can continually improve their performance as more data becomes
available.
 Disadvantages of Deep Learning:

1.High computational requirements: Deep Learning AI models require large amounts of data and
computational resources to train and optimize.

2.Requires large amounts of labeled data: Deep Learning models often require a large amount of labeled
data for training, which can be expensive and time- consuming to acquire.

3.Interpretability: Deep Learning models can be challenging to interpret, making it difficult to understand
how they make decisions.

4.Overfitting: Deep Learning models can sometimes overfit to the training data, resulting in poor
performance on new and unseen data.

5.Black-box nature: Deep Learning models are often treated as black boxes, making it difficult to
understand how they work and how they arrived at their predictions.
• Deep learning known as cybernetics in the 1940s–1960s.
With development of theories of biological learning, and implementation of first single neuron.
• Deep learning known as connectionism in the 1980s–1990s.
With backpropagation , to train a neural network with one or two hidden layer.
• Current resurgence under the name deep learning beginning in 2006.
appearing from 2016.