LESSON PLAN

Subject Name/Subject Code: AL3451 MACHINE LEARNING Department/ Year :AI&DS/III

Regulation :R 2021 Credit: 3
UNIT I INTRODUCTION TO MACHINE LEARNING
From : To :

Session Topic to be Covered Content Duration (minutes) Mode of Teaching References

Machine Learning Introduction, Applications

Introduction to machine learning 45 Lecture with PPT Reference Book
& Usage in IoT

transposes and inner products,outer Products 20 Lecture with PPT TEXT BOOK 1

Review of Linear Algebra for Eigen values and eigen vectors. Singular vales
1 15 Lecture with VIDEO WL1
machine learning; and Singular Vectors

RECAP & DISCUSSSION 10 INTERACTIVE SESSION Problem Solving

Why machine learning is important? 20 Lecture with PPT TEXT BOOK 1

Introduction and motivation for
2
machine learning; Ingredients of Machine Learning 20 Lecture with VIDEO WL2

RECAP & DISCUSSSION 5 INTERACTIVE SESSION Application Discussion

Face Recoginition and medical diagnosis 20 Lecture with PPT TEXT BOOK 1
Examples of machine learning
3
applications google home and amazon alexa 20 Lecture with VIDEO WL3

RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

Vapnik-Chervonenkis (VC) dimension 15 Lecture with PPT TEXT BOOK 1

Vapnik-Chervonenkis (VC)
4 Vapnik-Chervonenkis (VC) dimension 25 Lecture with VIDEO WL4
dimension

RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

Probably Approximately Correct (PAC)
20 Lecture with PPT TEXT BOOK 1
learning
Probably Approximately Correct Probably Approximately Correct (PAC)
5
(PAC) learning 20 Lecture with VIDEO WL5
learning
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

population evloution and the schema theorem 15 Lecture with PPT TEXT BOOK 1

6 Hypothesis spaces,Inductive bias sample error and true error, Inductive Bias 15 Lecture with VIDEO WL6

RECAP & DISCUSSSION 15 INTERACTIVE SESSION Problem Solving

Generalization 25 Lecture with PPT TEXT BOOK 1

7 Generalization
Generalization 15 Lecture with VIDEO WL7

RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

Bias variance trade-off. 15 Lecture with PPT TEXT BOOK 1

Bias variance trade-off.
8
Bias variance trade-off. 20 Lecture with VIDEO WL8

RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

 UNIT II SUPERVISED LEARNING

From : To :

Session Topic to be Covered Content Duration (minutes) Mode of Teaching References

Linera Regression Models,Least Squares 15 Lecture with PPT TEXT BOOK 1

Linear Regression Models: Least
1 Linera Regression Models,Least Squares 25 Lecture with VIDEO WL9
squares
RECAP & DISCUSSSION 5 INTERACTIVE SESSION Problem Solving

Single and multiple regression 20 Lecture with PPT TEXT BOOK 1

single & multiple variables, Difference between simple and multiple

2 20 Lecture with VIDEO WL10
Bayesian linear regression regression
Difference between single and multiple
RECAP & DISCUSSSION 5 INTERACTIVE SESSION
regression

gradient descent 20 Lecture with PPT TEXT BOOK 1

3 gradient descent
gradient descent 20 Lecture with VIDEO WL11
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

Logistic Regression 15 Lecture with PPT TEXT BOOK 1

Linear Classification Models:
4
Discriminant function Discriminant Function 25
Lecture with VIDEO WL12
RECAP & DISCUSSSION 5INTERACTIVE SESSION Sample Project Discussion
Perceptron algorithm 20
Lecture with PPT TEXT BOOK 1
5 Perceptron algorithm Perceptron algorithm 20
Lecture with VIDEO WL13
RECAP & DISCUSSSION 5INTERACTIVE SESSION QUESTIONNAIRES
Probabilistic discriminative model 15
Lecture with PPT TEXT BOOK 1
6 Probabilistic discriminative model Probabilistic discriminative model 15
Lecture with VIDEO WL14
RECAP & DISCUSSSION 15
INTERACTIVE SESSION QUESTIONNAIRES
Logistic regression 25
Lecture with PPT TEXT BOOK 1
7 Logistic regression Logistic regression 15
Lecture with VIDEO WL15
RECAP & DISCUSSSION 5INTERACTIVE SESSION Sample Project Discussion
Probabilistic generative model 15
Lecture with PPT TEXT BOOK 1
Probabilistic generative model –
8 Naive Bayes 15
Lecture with VIDEO WL16
Naive Bayes
RECAP & DISCUSSSION 10
INTERACTIVE SESSION Sample Project Discussion
Maximum margin classifier 15
Lecture with PPT TEXT BOOK 1
Maximum margin classifier –
9 Support vector machine 15
Lecture with VIDEO WL17
Support vector machine
RECAP & DISCUSSSION 15
INTERACTIVE SESSION QUESTIONNAIRES
Decision Tree Representation 15
Lecture with PPT TEXT BOOK 1
10 Decision Tree Advantages and Disadvantages of Decision Tree 15
Lecture with VIDEO WL18
RECAP & DISCUSSSION 15
INTERACTIVE SESSION Sample Project Discussion
Application of Random forest 15 Lecture with PPT TEXT BOOK 1
11 Random Forests Advantage and Disadvantages of Random Forest 15 Lecture with VIDEO WL19
RECAP & DISCUSSSION 15 INTERACTIVE SESSION Sample Project Discussion
UNIT III ENSEMBLE TECHNIQUES AND UNSUPERVISED LEARNING
From : To :

Session Topic to be Covered Content Duration (minutes) Mode of Teaching References

Model Combination Schemes 15 Lecture with PPT REFERENCE BOOK 4

Combining multiple learners:
1 Error correction output codes 25 Lecture with VIDEO WL20
Model combination schemes
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Voting 20 Lecture with PPT REFERENCE BOOK 4
2 Voting Voting, 20 Lecture with VIDEO WL21
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Ensemble Learning 20 Lecture with PPT REFERENCE BOOK 4
3 Ensemble Learning Ensemble Learning 20 Lecture with VIDEO WL22
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
bagging 15 Lecture with PPT REFERENCE BOOK 4
4 bagging bagging 25 Lecture with VIDEO WL23
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
bagging 20 Lecture with PPT REFERENCE BOOK 4
5 boosting, stacking stacking 20 Lecture with VIDEO WL24
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Unsupervised learning: K-means 15 Lecture with PPT REFERENCE BOOK 4
6 Unsupervised learning: K-means K-means Example 15 Lecture with VIDEO WL25
RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES
Instance Based Learning: KNN 25 Lecture with PPT REFERENCE BOOK 4
7 Instance Based Learning: KNN KNN Example 15 Lecture with VIDEO WL26
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Expectation-Maximixation 15 Lecture with PPT REFERENCE BOOK 4
8 Gaussian mixture models Expectation-Maximixation 15 Lecture with VIDEO WL27
RECAP & DISCUSSSION 10 INTERACTIVE SESSION QUESTIONNAIRES
EM Algorithms 15 Lecture with PPT REFERENCE BOOK 4
9 Expectation maximization. EM Algorithms 15 Lecture with VIDEO WL28
RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES
 UNIT IV NEURAL NETWORKS
From : To :

Session Topic to be Covered Content Duration (minutes) Mode of Teaching References

Single layer Perception 15 Lecture with PPT REFERENCE BOOK 4

Multilayer perceptron, activation Multi Player Perception 25 VIDEO WL29
1
functions
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

Network training 20 Lecture with PPT REFERENCE BOOK 4

2 Network training Network training 20 Lecture with VIDEO WL30

RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

gradient descent optimization 20 Lecture with PPT REFERENCE BOOK 4

Example Solving gradient descent
3 gradient descent optimization 20 Lecture with VIDEO WL31
optimization
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

stochastic gradient descent 15 Lecture with PPT REFERENCE BOOK 4

4 stochastic gradient descent
Example stochastic gradient descent 25 Lecture with VIDEO WL32
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
error backpropagation 20 Lecture with PPT REFERENCE BOOK 4
error backpropagation, from error backpropagation, from shallow networks
5 20 Lecture with VIDEO WL33
shallow networks to deep networks
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Unit saturation 15 Lecture with PPT REFERENCE BOOK 4
Unit saturation (aka the vanishing
6 ReLU 15 Lecture with VIDEO WL34
gradient problem) -ReLU
RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES
hyperparameter tuning 25 Lecture with PPT REFERENCE BOOK 4
7 hyperparameter tuning hyperparameter tuning 15 Lecture with VIDEO WL35
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
batch normalization 15 Lecture with PPT REFERENCE BOOK 4
8 batch normalization batch normalization 15 Lecture with VIDEO WL36
RECAP & DISCUSSSION 10 INTERACTIVE SESSION QUESTIONNAIRES
regularization 15 Lecture with PPT REFERENCE BOOK 4

9 regularization, dropout. dropout 15 Lecture with VIDEO WL37

RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES

UNIT V DESIGN AND ANALYSIS OF MACHINE LEARNING EXPERIMENTS
From : To :

Session Topic to be Covered Content Duration (minutes) Mode of Teaching References

Machine learning life cycle 15 Lecture with PPT REFERENCE BOOK 4

Guidelines for machine learning
1 Guidelines for machine learning experiments 25 Lecture with VIDEO WL38
experiments
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
Cross Validation (CV) 20 Lecture with PPT REFERENCE BOOK 4
Cross Validation (CV) and
2 resampling 20 Lecture with VIDEO WL39
resampling
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
K-fold CV 20 Lecture with PPT REFERENCE BOOK 4
3 K-fold CV K-fold CV-Application 20 Lecture with VIDEO WL40
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
bootstrapping 15 Lecture with PPT REFERENCE BOOK 4
4 bootstrapping bootstrapping 25 Lecture with VIDEO WL41
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
measuring classifier performance 20 Lecture with PPT REFERENCE BOOK 4
5 measuring classifier performance measuring classifier performance 20 Lecture with VIDEO WL42
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES

assessing a single classification algorithm 15 Lecture with PPT REFERENCE BOOK 4

assessing a single classification
6 algorithm and comparing two
classification algorithms comparing two classification algorithms 15 Lecture with VIDEO WL43
RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES
t test 25 Lecture with PPT REFERENCE BOOK 4
7 t test t test example 15 Lecture with VIDEO WL44
RECAP & DISCUSSSION 5 INTERACTIVE SESSION QUESTIONNAIRES
McNemar’s test 15 Lecture with PPT REFERENCE BOOK 4
8 McNemar’s test McNemar’s test-Application 15 Lecture with VIDEO WL45
RECAP & DISCUSSSION 10 INTERACTIVE SESSION QUESTIONNAIRES
K-fold CV paired t test 15 Lecture with PPT REFERENCE BOOK 4
9 K-fold CV paired t test K-fold CV paired t test-Applications and 15 Lecture with VIDEO WL46
RECAP & DISCUSSSION 15 INTERACTIVE SESSION QUESTIONNAIRES
 WL1 Eigen values and eigen vectors. Singular vales and Singular Vectors https://youtu.be/IHO7_n7Y09s?si=FYuTIshJT9TYzI6Q
WL2 Ingredients of Machine Learning https://youtu.be/czDrUTx9gu4?si=6g5JNC4b6weLJFcH
WL3 google home and amazon alexa https://youtu.be/Dkg1ULBASNA?si=KxfqDOaK9nE-LNVt
WL4 Vapnik-Chervonenkis (VC) dimension https://youtu.be/9YkFsXcTs2w?si=Cs8nrCgXuxkl3Vk2
WL5 Probably Approximately Correct (PAC) learning https://youtu.be/T9U_AGQKatU?si=yZzDvXaUyqewdNRQ
WL6 sample error and true error, Inductive Bias https://youtu.be/me0ppU4KFwg?si=b-ZX4SfcdUcpDvLe
WL7 Generalization https://youtu.be/0rE_tUSxbSI?si=hYdSUWVN2KYD_GAQ
WL8 Bias variance trade-off. https://youtu.be/lpkSGTT8uMg?si=EQgisK4UzQZSJ6P-
WL9 Linera Regression Models,Least Squares https://www.youtube.com/watch?v=PaFPbb66DxQ
WL10 Difference between simple and multiple regression https://www.youtube.com/watch?v=NU8OIwEnEk4
WL11 gradient descent https://www.youtube.com/watch?v=sDv4f4s2SB8
WL12 Discriminant Function https://www.youtube.com/watch?v=FLyEbVawmvU
WL13 Perceptron algorithm https://www.youtube.com/watch?v=ysQun8VbUmM
WL14 Probabilistic discriminative model https://www.youtube.com/watch?v=gwa47ZzhYno
WL15 Logistic regression https://www.youtube.com/watch?v=yIYKR4sgzI8&list=PLblh5JKOoLUKxzEP5HA2d-Li7IJkHfXSe
WL16 Naive Bayes https://www.youtube.com/watch?v=O2L2Uv9pdDA
WL17 Support vector machine https://www.youtube.com/watch?v=efR1C6CvhmE
WL18 Advantages and Disadvantages of Decision Tree https://www.youtube.com/watch?v=uRlj1JMSmuQ
WL19 Advantage and Disadvantages of Random Forest https://www.youtube.com/watch?v=9bqNhq6OUUk
WL20 Error correction output codes https://www.youtube.com/watch?v=LifsYvVtVzY
WL21 Voting, https://www.youtube.com/watch?v=dD7gvbfBiyA
WL22 Ensemble Learning https://www.youtube.com/watch?v=LXc6LpFWCEQ
WL23 bagging https://www.youtube.com/watch?v=tjy0yL1rRRU
WL24 stacking https://www.youtube.com/watch?v=sBrQnqwMpvA
WL25 K-means Example https://www.youtube.com/watch?v=5FpsGnkbEpM
WL26 KNN Example https://www.youtube.com/watch?v=IPqZKn_cMts
WL27 Expectation-Maximixation https://www.youtube.com/watch?v=REypj2sy_5U
WL28 EM Algorithms https://www.youtube.com/watch?v=3oefV-AoP0E
WL29 Multi Player Perception https://www.youtube.com/watch?v=zCwEdKy2OJI
WL30 Network training https://www.youtube.com/watch?v=du5fyS44DR8
WL31 Example Solving gradient descent optimization https://www.youtube.com/watch?v=fXQXE96r4AY
WL32 Example stochastic gradient descent https://www.youtube.com/watch?v=vMh0zPT0tLI
WL33 error backpropagation, from shallow networks to deep networks https://www.youtube.com/watch?v=tUoUdOdTkRw
WL34 ReLU https://www.youtube.com/watch?v=68BZ5f7P94E
WL35 hyperparameter tuning https://www.youtube.com/watch?v=PK37PqkIOg4&list=PLfFghEzKVmjunyr8OPegxrX7y83IDuZNV
WL36 batch normalization https://www.youtube.com/watch?v=dXB-KQYkzNU
WL37 dropout https://www.youtube.com/watch?v=ARq74QuavAo
WL38 Guidelines for machine learning experiments https://www.youtube.com/watch?v=Pn_o_RsmyB0
WL39 resampling https://www.youtube.com/watch?v=fPjD_TFI66I
WL40 K-fold CV-Application https://www.youtube.com/watch?v=PF2wLKv2lsI
WL41 bootstrapping https://www.youtube.com/watch?v=5Lu1eTiX7qM
WL42 measuring classifier performance https://www.youtube.com/watch?v=bi0g9eUFhxs
WL43 comparing two classification algorithms https://www.youtube.com/watch?v=iNu_yMrAM9o
WL44 t test example https://www.youtube.com/watch?v=NF5_btOaCig
WL45 McNemar’s test-Application https://www.youtube.com/watch?v=nzznkiW8ulk
WL46 K-fold CV paired t test-Applications and Examples https://www.youtube.com/watch?v=PF2wLKv2lsI&t=47s

TEXT BOOK 1 Ethem Alpaydin, “Introduction to Machine Learning”, MIT Press, Fourth Edition, 2020.
REFERENCE BOOK 4 Ian Goodfellow, Yoshua Bengio, Aaron Courville, “Deep Learning”, MIT Press, 2016

FACULTY HOD PRINCIPAL