CS467 Machine Learning
CS467 Machine Learning
Course Plan
End
Sem.
Module Contents Hours Exam
Marks
%
Introduction to Machine Learning, Examples of Machine
Learning applications - Learning associations, Classification,
I Regression, Unsupervised Learning, Reinforcement Learning. 6 15
Supervised learning- Input representation, Hypothesis class,
Version space, Vapnik-Chervonenkis (VC) Dimension
Probably Approximately Learning (PAC), Noise, Learning
II Multiple classes, Model Selection and Generalization, 8 15
Dimensionality reduction- Subset selection, Principle
Component Analysis
FIRST INTERNAL EXAM
Classification- Cross validation and re-sampling methods- K-
fold cross validation, Boot strapping, Measuring classifier
III performance- Precision, recall, ROC curves. Bayes Theorem, 8 20
Bayesian classifier, Maximum Likelihood estimation, Density
functions, Regression
Decision Trees- Entropy, Information Gain, Tree construction,
ID3, Issues in Decision Tree learning- Avoiding Over-fitting,
Reduced Error Pruning, The problem of Missing Attributes,
IV Gain Ratio, Classification by Regression (CART), Neural 6 15
Networks- The Perceptron, Activation Functions, Training
Feed Forward Network by Back Propagation.
SECOND INTERNAL EXAM
Kernel Machines- Support Vector Machine- Optimal
Separating hyper plane, Soft-margin hyperplane, Kernel trick,
Kernel functions. Discrete Markov Processes, Hidden Markov
V models, Three basic problems of HMMs- Evaluation problem, 8 20
finding state sequence, Learning model parameters. Combining
multiple learners, Ways to achieve diversity, Model
combination schemes, Voting, Bagging, Booting
Unsupervised Learning - Clustering Methods - K-means,
VI Expectation-Maximization Algorithm, Hierarchical Clustering 6 15
Methods , Density based clustering
END SEMESTER EXAM