Lesson 1 - Introduction To Deep Learning
Lesson 1 - Introduction To Deep Learning
Artificial Intelligence (AI) came around in the middle of 1900s when scientists tried to envision
intelligent machines. Machine Learning evolved in late 1900s. This allowed scientists to train
machines for AI. In early 2000s, certain breakthroughs in multi-layered neural networks facilitated
the advent of Deep Learning. It aids in developing more complex applications, like image processing
or language modeling.
Image Source: Nvidia
Relationship between Artificial Intelligence and Deep Learning
Artificial Intelligence
Machine Learning
Deep Learning
Self driving cars Credit card fraud detection Call center agent match
Amazon Echo and Alexa Concierge robot Connie Baidu AI medical assistant
There are many aspects of Deep Learning as shown below. These will be covered in detail
in subsequent chapters of this course.
Multi-layered neural
Training of large neural
networks 2 3 networks
Multiple levels of
hierarchical representations 4
Multiple non-linear
1
transformations
Feature extraction
Drivers of Deep Learning
Availability of multi-
layered learning network
Drivers of Deep
Learning Expanded use of high-
Availability of large
performing graphics
amount of labeled data
processing units (GPU)
What?
Microsoft India collaborated
with ICRISAT (International
Crop Research Institute for the
Semi-Arid Tropics) to develop a
“Sowing App.”
What?
• Azure cloud platform was used to deploy this app, along with Artificial
What? Intelligence, Machine Learning, Big Data, and Analytics.
• The technologies that are used to power the app are:
• Cloud Machine Learning
Why? • Satellite imagery
• Advanced analytics
• Microsoft Cortana Intelligence Suite
How? • Machine Learning
• Power BI
• Climate data for the Devanakonda area of Andhra Pradesh from 1986 to
2015 was collected to predict the crop sowing period.
Deep Learning Path
The path to master Deep Learning can be divided into four phases:
Synapse
• The computational models in Deep Learning are loosely inspired by the human brain.
• The multiple layers of training are called Artificial Neural Networks (ANN).
• ANNs are processing devices (algorithms or actual hardware) that are modelled on the
neuronal structure of the mammalian cerebral cortex but on a much smaller scale.
Note: In second and third lessons, you will learn more about Artificial Neural Network, Neurons and Perceptron.
Artificial Neural Network: Definition
Neurons
• Artificial Neural Network is an interconnected group of
nodes akin to the vast network of layers of neurons in
Nodes
a brain.
Outputs
• Each circular node represents an artificial neuron and an
arrow represents a connection from the output of one
neuron to the input of another.
Neurons
Artificial Neural Network: Process
Neurons
Neurons
Artificial Neural Network: Process
• The outputs from the first layer are then passed into the
Neurons second layer to be processed.
• This continues until the final output is produced.
Nodes • The assumption is that the correct output is predefined.
• Each time data is passed through the network, the end
Inputs result is compared with the correct one, and tweaks are
made to their values until the network creates the
Outputs correct final output each time.
Types of Neural Networks
ANN
(Artificial Neural Network)
CNN DNN
(Convolutional Neural Network) (Deep Neural Network)
RNN DBN
(Recurrent Neural Network) (Deep Belief Network)
ANN
Computational DNN
Neuroscience
CNN Acoustic
Modeling
Image
Processing
DBN
RNN
Drug
Speech
Discovery
Recognition
Source: hbr.org
Case Study: DeepFace
How?
• In the example given on the left, the first layer recognizes edges.
Source: hbr.org
Introduction to Deep Learning
Topic 4: Deep Learning Platforms
CPU and GPU Specifications
The table below shows that GPUs (right column) are cheaper than
modern CPUs (middle column) for deep learning tasks. In
addition, they support a lot more cores and calculations.
Python Specifications
• Python is limited to execution on one core due to the Global Interpreter Lock (GIL).
• Multiprocessing library in Python allows distributed computation over several cores, but
most advanced desktop hardware comes only with a maximum of 8 to 16 cores.
GPU: Special Packages
Deep Learning is a subset of Machine Learning and Artificial Intelligence and makes
complex features and input-output relationships learnable.
New breakthroughs in neural networks, availability of Big Data, and low-cost high-
performance GPU chips are driving the Deep Learning revolution.
Deep Learning is useful for complex intelligence tasks like face recognition, speech
recognition, machine translation etc.
Artificial Neural Network is a computing system made up of a number of simple, highly
interconnected processing elements that process information by their dynamic state
response to external inputs. It is modeled on the inter-connected neurons in the human
brain.
Each circular node represents an artificial neuron, and an arrow represents a connection
from the output of one neuron to the input of another.
Some of the commonly used neural networks are RNN, CNN, ANN, DNN, and DBN.
GPUs are cheaper than modern CPUs now, in addition to supporting a lot more cores
and calculations.
This concludes “Introduction to Deep Learning”
The next lesson is “Perceptron.”