Syllabus
Syllabus
Unit II: Supervised Learning: Rationale and Basics: Learning from Observations, Bias and Why
Learning Works: Computational Learning Theory, Occam's Razor Principle and Over fitting
Avoidance Heuristic Search in inductive Learning, Estimating Generalization Errors, Metrics for
assessing regression, Metris for assessing classification.
Unit III: Statistical Learning: Machine Learning and Inferential Statistical Analysis, Descriptive
Statistics in learning techniques, Bayesian Reasoning: A probabilistic approach to inference, K-
Nearest Neighbor Classifier. Discriminant functions and regression functions, Linear Regression
with Least Square Error Criterion, Logistic Regression for Classification Tasks, Fisher's Linear
Discriminant and Thresholding for Classification, Minimum Description Length Principle.
Unit IV: Support Vector Machines (SVM): Introduction, Linear Discriminant Functions for
Binary Classification, Perceptron Algorithm, Large Margin Classifier for linearly seperable data,
Linear Soft Margin Classifier for Overlapping Classes, Kernel Induced Feature Spaces,
Nonlinear Classifier, and Regression by Support vector Machines.
Learning with Neural Networks: Towards Cognitive Machine, Neuron Models, Network
Architectures, Perceptrons, Linear neuron and the Widrow-Hoff Learning Rule, The error
correction delta rule.
Unit V: Multilayer Perceptron Networks and error back propagation algorithm, Radial Basis
Functions Networks. Decision Tree Learning: Introduction, Example of classification decision
tree, measures of impurity for evaluating splits in decision trees, ID3, C4.5, and CART decision
trees, pruning the tree, strengths and weakness of decision tree approach.
Textbooks:
1. Applied Machine Learning,1st edition, M.Gopal, McGraw Hill Education,2018
2. Machine Learning: An Algorithmic Perspective, Stephen Marsland, Taylor & Francis (CRC) 1 st
Edition-2014