CM412 - DL - Model Paper
CM412 - DL - Model Paper
UNIT – I
(OR)
UNIT – II
4. a) Discus Multi-Task Learning with suitable illustrations. (7 M) CO2 L2
b) Summarize several of the most prominent challenges involved in (7 M) CO2 L2
optimization for training deep models.
(OR)
UNIT – III
(OR)
UNIT – IV
(OR)
*********
CM 412
L T P I E C
CM412 DEEP LEARNING 3 - - 30 70 3
Course Objectives:
At the end of the course, the student will understand and
1. Demonstrate the major technology trends driving Deep Learning
2. Build, train and apply fully connected deep neural networks
3. Implement efficient (vectorized) neural networks
4. Analyze the key parameters and hyper parameters in a neural network's architecture
Course Outcomes:
At the end of the course, the student will be able to
CO1. Differentiate architecture of deep neural network.
CO2. Analyze the challenges in optimization of a network.
CO3. Build a convolutional neural network.
CO4. Build and train RNN and LSTMs.
Course Content:
UNIT – I 12 Hours
What is deep learning? : Introduction, Historical trends in deep learning, Artificial intelligence, machine
learning, and deep learning - Artificial intelligence, Machine learning, Learning rules and representations
from data, The “deep” in “deep learning”, Understanding how deep learning works, Why deep learning? Why
now? Challenges Motivating Deep Learning.
Deep Feed-forward Networks: Example: Learning XOR, Gradient-Based Learning, Hidden Units,
Architecture Design, Back-Propagation and Other Differentiation Algorithms, Historical Notes.
UNIT – II 12 Hours
Regularization for Deep Learning: Parameter Norm Penalties, Norm Penalties as Constrained
Optimization, Regularization and Under-Constrained Problems, Dataset Augmentation, Noise
Robustness, Semi-Supervised Learning, Multi-Task Learning, Early Stopping, Parameter Tying and
Parameter Sharing, Sparse Representations, Bagging and Other Ensemble Methods, Dropout,
Adversarial Training, Tangent Distance, Tangent Prop and Manifold Tangent Classifier.
Optimization for Training Deep Models: Pure Optimization, Challenges in Neural Network
Optimization, Basic Algorithms, Parameter Initialization Strategies, Algorithms with Adaptive
Learning Rates, Approximate Second-Order Methods, Optimization Strategies and Meta-Algorithms.
Learning Resources:
Text Books:
1. Deep Learning, Ian Goodfellow and YoshuaBengio and Aaron Courville, MIT Press, 2016.
Reference Books:
1. Francois Chollet, “Deep Learning with Python”, Second Edition, Manning Publications, 2021.
2. Deep learning: a practitioners approach, Josh Patterson and Adam Gibson, O’reilly, 2017.
3. Neural Networks and Deep Learning, Charu C Aggarwal, Springer,2018.
List of Paper Setters:
Dr. G.Anuradh
Associate Professor, Dept. of CSE,
V.R.Siddhartha Engineering College,
Vijayawada.
Mail id: [email protected]
Mobile No : 9441819173
CM: DEEP LEARNING
Dr. K.Venkata Raju
Professor, Dept. of CSE,
KL University.
Mail id: [email protected]
Mobile No:9440477917
Dr. B.Tarakeswara arao
Professor, Dept. of CSE(AI&DS),
KHIT, Guntur.
Mail id: [email protected]
Mobile No: 9441045755