Course Handout (2024-25 ODD SEMESTER)

Subject Name/Code : Machine Learning(BTCS-T-PC-022) Branch/Sem/Batch :

CEN 5 SEM (A),CSE 5 SEM
(A),CSE 5 SEM (B),CSE 5 SEM
(C),CSE 5 SEM (D),CST 5 SEM
(A)
: Pradipta Kumar Pattanayak , Bimal Kumar Meher , NAYAN RANJAN PAUL , Jayashree Piri
Name of Faculty , SARTHAK PADHI
Scope & Objective -:

The objective of the course is to learn the fundamental concepts behind supervised, unsupervised & reinforcement learning,
assess & select appropriate model and use cross validation to tune their parameters.

Pre-Requisite -:

Detailed Syllabus:
Module# CO Topics Hours
Overview of supervised learning, K-nearest neighbour, Multiple
linear regression, Shrinkage methods (Ridge regression, Lasso
Module-1 CO1 11
regression), Logistic regression, Linear Discriminant Analysis,
Feature selection.
Bias, Variance, and model complexity, Bias-variance trade off,
Bayesian approach and BIC, Cross-validation, Bootstrap
Module-2 CO2 11
methods, Performance of Classification algorithms (Confusion
matrix, Precision, Recall and ROC Curve).
Generative model for discrete data (Bayesian concept learning,
Na¨ıve Bayes classifier), SVM for classification, Reproducing
Module-3 CO3 11
Kernels, SVM for regression, Regression and classification
trees, Random forest.
Clustering (K-means, spectral clustering), Feature Extraction
(Principal Component Analysis (PCA), kernel based PCA,
Module-4 CO4 Independent Component Analysis (IDA), Non-negative matrix 12
factorization), Mixture of Gaussians, Expectation Maximization
(EM) algorithm.
Boosting methods-exponential loss and AdaBoost, Numerical
Optimization via gradient boosting; Introduction to
Module-5 CO5 Reinforcement Learning, Elements of Reinforcement Learning, 11
Single State Case: K-Armed Bandit, Model-Based Learning
(Value Iteration, Policy Iteration).
Total 56 Hours

# Topic Module Chapter Course Coverage No of Classes

1 Introduction to machine learning TRUE 1

2 Overview of machine learning applications TRUE 1
3 Overview of supervised learning TRUE 1
4 k-nearest neighbour TRUE 1
Introduction to Regreassion, and Multiple
5 TRUE 1
linear regression-1
6 Multiple linear regression-2 TRUE 1
7 Ridge regression TRUE 1
8 Lasso regression TRUE 1
9 Subset selection-1 TRUE 1
10 Subset selection-2 TRUE 1
11 Linear discriminant analysis TRUE 1
12 Logistic regression-1 TRUE 1
 13 Logistic regression-2 TRUE 1
14 Bias, Variance, Model Complexity-1 TRUE 1
15 Bias, Variance, Model Complexity-2 TRUE 1
16 bias-Variance trade off, BIC TRUE 1
17 cross validation-1 TRUE 1
18 cross validation-2 TRUE 1
19 Bootstrap methods TRUE 1
20 confusion matrix TRUE 1
21 ROC curve TRUE 1
22 Doubt clearing class( For mid terem exam ) FALSE 1
23 Bayesian concept learnig TRUE 1
24 Naive Bayes Classifier TRUE 1
25 Introduction to SVM for Classification TRUE 1
26 SVM for Classification and its algorithm TRUE 1
27 Introduction to Kernels TRUE 1
28 SVM for Classification-2 TRUE 1
29 Reproducing Kernels TRUE 1
30 SVM for regression TRUE 1
31 Regression trees TRUE 1
32 Classification trees TRUE 1
33 Classification and regression trees TRUE 1
34 Random forest TRUE 1
35 Introduction to clustering, K-means TRUE 1
36 Spectral clustering-1 TRUE 1
37 Spectral clustering-2 TRUE 1
38 Principal Component Analysis (PCA)-1 TRUE 1
39 Principal Component Analysis (PCA)-2 TRUE 1
40 kernel based PCA TRUE 1
41 Independent Component Analysis (ICA)-1 TRUE 1
42 Independent Component Analysis (ICA)-2 FALSE 1
43 Non-negative Matrix Factorization-1 TRUE 1
44 Non-negative Matrix Factorization-2 TRUE 1
45 Mixture Model FALSE 1
46 Expectation Maximization (EM) algorithm TRUE 1
Boosting methods-exponential loss and
47 TRUE 1
AdaBoost-1
Boosting methods-exponential loss and
48 TRUE 1
AdaBoost-2
Numerical Optimization via gradient
49 TRUE 1
boosting
Introduction to reinforcement learning ,
50 TRUE 1
single state case
51 K-Armed Bandit TRUE 1
52 Model-Based Learning-1 TRUE 1
53 Model-Based Learning-2 FALSE 1
54 Doubt- Clearing -1 FALSE 1
55 Doubt- Clearing -2 FALSE 1
56 Doubt- Clearing -3 FALSE 1

Total no. of classes : 56

Text Book
T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning - Data Mining, Inference, and Prediction, 2nd
Edition, Springer, 2009, ,, ,
S. Haykin, Neural Networks and Learning Machines, 3rd Edition, Pearson Education, 2009, ,, ,
E. Alpaydın, Introduction to Machine Learning, 2nd Edition, Prentice Hall of India, 2010, ,, ,
Reference Book
Y. G. James, D. Witten, T. Hastie, and R. Tibshirani, An Introduction to Statistical Learning with Applications in R, 2nd Edition,
Springer, 2013, ,, ,
T. M. Mitchell, Machine Learning, 1st Edition, McGrow-Hill Education, 2013, ,, ,
C. M. Bishop, Pattern Recognition and Machine Learning, 1st Edition, Springer, 2006, ,, ,
Online Reference Material(s):

1. https://nptel.ac.in/courses/106/106/106106139/: by Dr. B. Ravindran, IIT Madras

2. https://nptel.ac.in/courses/106/105/106105152/: by Prof. S. Sarkar, IIT Kharagpur

Course Outcome:
CO1 Apply the concepts of supervised machine learning and its functionalities.
CO2 Determine most appropriate model in a specific context using model selection techniques.
CO3 Perform classification using Bayes classifier, SVM, Decision Tree, and Random Forest.
Reduce dimensionality using feature selection and apply unsupervised machine learning for solving
CO4
problems.
CO5 Apply the basic concepts of boosting methods and reinforcement learning to real life problems.

Program Outcomes Relevent to the Course:

Engineering knowledge: Apply the knowledge of mathematics, science, engineering fundamentals,
PO1
and an engineering specialization to the solution of complex engineering problems
Problem analysis: Identify, formulate, review research literature, and analyze complex engineering
PO2 problems reaching substantiated conclusions using first principles of mathematics, natural
sciences, and engineering sciences.
Design/development of solutions: Design solutions for complex engineering problems and design
PO3 system components or processes that meet the specified needs with appropriate consideration for
the public health and safety, and the cultural, societal, and environmental considerations.
Conduct investigations of complex problems: Use research-based knowledge and research methods
PO4 including design of experiments, analysis and interpretation of data, and synthesis of the
information to provide valid conclusions.
Modern tool usage: Create, select, and apply appropriate techniques, resources, and modern
PO5 engineering and IT tools including prediction and modeling to complex engineering activities with
an understanding of the limitations.
The engineer and society: Apply reasoning informed by the contextual knowledge to assess
PO6 societal, health, safety, legal and cultural issues and the consequent responsibilities relevant to the
professional engineering practice.
Environment and sustainability: Understand the impact of the professional engineering solutions in
PO7 societal and environmental contexts, and demonstrate the knowledge of, and need for sustainable
development.
Ethics: Apply ethical principles and commit to professional ethics and responsibilities and norms of
PO8
the engineering practice.
Individual and team work: Function effectively as an individual, and as a member or leader in
PO9
diverse teams, and in multidisciplinary settings.
Communication: Communicate effectively on complex engineering activities with the engineering
PO10 community and with society at large, such as, being able to comprehend and write effective reports
and design documentation, make effective presentations, and give and receive clear instructions.
Project management and finance: Demonstrate knowledge and understanding of the engineering
PO11 and management principles and apply these to one’s own work, as a member and leader in a team,
to manage projects and in multidisciplinary environments.
Life-long learning: Recognize the need for, and have the preparation and ability to engage in
PO12
independent and life-long learning in the broadest context of technological change.

Mapping of CO's to PO's: (1: Low, 2: Medium, 3: High)

PO1 PO2 PO3 PO4 PO5 PO12
CO1 3 3 3 2 1 1
CO2 3 3 3 2 1 1
CO3 3 3 3 2 1 1
CO4 3 3 3 2 1 1
CO5 3 3 3 2 1 1