Scribd
Upload
623 views14 pages

Deep Learning (RCS-086) ppt-1 of Unit-1

Deep Learning [RCS-086] covers 5 units on the topic of deep learning: 1. Introduction to machine learning models like SVMs, perceptrons, and logistic regression, and introduction to neural networks including how they compute and are trained. 2. History of deep learning and modern techniques like convolutional networks, generative adversarial networks, and semisupervised learning. 3. Dimensionality reduction techniques and convolutional network architectures like AlexNet, VGG, Inception, and ResNet. 4. Optimization techniques for training deep networks and techniques for generalization. 5. Case studies and applications of deep learning like ImageNet, detection, generation, and NLP tasks.

Uploaded by

jaishree jain
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
623 views14 pages

Deep Learning (RCS-086) ppt-1 of Unit-1

Deep Learning [RCS-086] covers 5 units on the topic of deep learning: 1. Introduction to machine learning models like SVMs, perceptrons, and logistic regression, and introduction to neural networks including how they compute and are trained. 2. History of deep learning and modern techniques like convolutional networks, generative adversarial networks, and semisupervised learning. 3. Dimensionality reduction techniques and convolutional network architectures like AlexNet, VGG, Inception, and ResNet. 4. Optimization techniques for training deep networks and techniques for generalization. 5. Case studies and applications of deep learning like ImageNet, detection, generation, and NLP tasks.

Uploaded by

jaishree jain
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Deep Learning [RCS-086]

• Books:
1. Cosma Rohilla Shalizi, Advanced Data Analysis
from an Elementary Point of View, 2015.
2. Deng & Yu, Deep Learning: Methods and
Applications, Now Publishers, 2013.
3. Ian Goodfellow, Yoshua Bengio, Aaron Courville,
Deep Learning, MIT Press, 2016.
4. Michael Nielsen, Neural Networks and Deep
Learning, Determination Press, 2015.
Unit-I
INTRODUCTION : Introduction to machine learning- Linear models (SVMs and Perceptrons,
logistic regression)- Intro to Neural Nets: What a shallow network computes- Training a network:
loss functions, back propagation and stochastic gradient descent- Neural networks as universal
function approximates
Unit-II
DEEP NETWORKS : History of Deep Learning- A Probabilistic Theory of Deep Learning-
Backpropagation and regularization, batch normalization- VC Dimension and Neural Nets-Deep
Vs Shallow Networks-Convolutional Networks- Generative Adversarial Networks (GAN),
Semisupervised Learning
Unit-III
DIMENTIONALITY REDUCTION 9 Linear (PCA, LDA) and manifolds, metric learning - Auto
encoders and dimensionality reduction in networks - Introduction to Convnet - Architectures –
AlexNet, VGG, Inception, ResNet - Training a Convnet: weights initialization, batch
normalization, hyperparameter optimization
Unit-IV
OPTIMIZATION AND GENERALIZATION : Optimization in deep learning– Non-convex
optimization for deep networks- Stochastic Optimization Generalization in neural networks-
Spatial Transformer Networks- Recurrent networks, LSTM - Recurrent Neural Network Language
Models- Word-Level RNNs & Deep Reinforcement Learning - Computational & Artificial
Neuroscience
Unit-V
CASE STUDY AND APPLICATIONS : Imagenet- Detection-Audio WaveNet-Natural Language
Processing Word2Vec - Joint Detection-Bioinformatics- Face Recognition- Scene Understanding-
Gathering Image Captions

You might also like