9/10/21, 12:42 PM Introduction to Machine Learning

Introduction to Machine Learning, Spring

2018
Course Description
Welcome to "Introduction to Machine
Learning 419(M)".

In this undergraduate-level course, you

will be introduced to the foundations of
machine learning along with a slew of
popular machine learning techniques.
This will also give you insights on how to
apply machine learning to solve a new
problem.

This course is open to any non-CSE

undergraduate student who wants to do a
minor in CSE. There are no prerequisites.

Course Info
Time: Wednesdays, Fridays, 9.30 am to 10.55 am

Venue: CC 103

Instructor: Preethi Jyothi. You can email me at pjyothi [at] cse [dot] iitb [dot] ac [dot] in

TAs:
Saurabh Garg (email: saurabhgarg [at] cse.iitb.ac.in)

Tanmay Parekh (email: tanmayb [at] cse.iitb.ac.in)

Sunandini Sanyal (email: sunandinis [at] cse.iitb.ac.in)

Anupama Vijjapu (email: anupamav [at] cse.iitb.ac.in)

Himanshu Agarwal (email: aghimanshu [at] cse.iitb.ac.in)

Aniket Muiri (email: 163050059 [at] iitb.ac.in)

Pooja Palod (email: 163050026 [at] iitb.ac.in)

Instructor office hours (in CC 221): 7 to 8 pm on Wednesdays, 5 pm to 6 pm on

Fridays

TA office hours:

Himanshu, Aniket and Pooja (3 pm to 4 pm on Wednesdays, KreSIT library)

Saurabh and Tanmay (7 to 8 pm on Thursdays, SL3 in CC building)

Sunandini and Anupama (10.45 am to 11.45 am on Mondays, KreSIT library)

Course grading

All assignments should be completed individually. No form of collaboration is allowed

unless explicitly permitted by the instructor. Anyone deviating from these standards of
academic integrity will be reported to the department's disciplinary committee.

https://www.cse.iitb.ac.in/~pjyothi/cs419_spr18/index.html 1/5
9/10/21, 12:42 PM Introduction to Machine Learning

[1] Four assignment sets (40%)

[2] Midsem exam (15%)
[3] Project (15%)
[4] Final exam (25%)
[5] Participation (5%)

Syllabus
Course syllabus includes basic classification/regression techniques such as Naive
Bayes', decision trees, SVMs, boosting/bagging and linear/logistic regression,
maximum likelihood estimates, regularization, basics of statistical learning theory,
perceptron rule/multi-layer perceptrons, backpropagation, brief introduction to deep
learning models, dimensionality reduction techniques like PCA and LDA,
unsupervised learning: k-means clustering, gaussian mixture models, selected topics
from natural/spoken language processing, computer vision, etc. [The syllabus is subject
to minor changes depending on how the course proceeds.]

Schedule
Summary
Date Title Reading
slides
Jan 5, Machine Learning:
Lecture1.pdf Chapter 1 of [SS-2017]
2018 What and why?
Jan Linear Regression
10, Lecture2.pdf Chapter 3.1,3.2.1 of [TH-2009]
(Part I)
2018
Jan
Linear Regression
12, Lecture3.pdf Notes by Cosma Shalizi
(Part II)
2018
Jan Assignment 1
16, released:
Assignment 1 -
2018 Due Jan 24, 2018
Linear
Jan
17, Classification:
- Notes by Avrim Blum
Perceptron
2018
Algorithm
Jan
19, Decision Trees Lecture5.pdf Shared via Moodle
2018
"Some cases of
Jan Guest lecture
pathology
24, by Prof. Amit -
diagnostics using
2018 Sethi
ML"
Jan
Bias Variance
31, Lecture6.pdf Notes by Andrew Ng
Tradeoff
2018

https://www.cse.iitb.ac.in/~pjyothi/cs419_spr18/index.html 2/5
9/10/21, 12:42 PM Introduction to Machine Learning

Summary
Date Title Reading
slides

Feb 2, Generalization Notes on VC dimension

errors + model Lecture7.pdf
2018 (Section 11.1)
selection
Assignment 2
Feb 7,
released:
Assignment 2 -
2018
Due Feb 16, 2018
Feb 7, MLE/MAP/Naive Peter Robinson's slides on
Lecture8.pdf
2018 Bayes MLE vs. MAP
Chapter 3 from "Machine
Feb 9,
Logistic Regression Lecture9.pdf Learning" by Tom Mitchell,
2018
September 2017.
Chapter 3.4 (everything before
Feb Eqn 3.45) of [TH-2009] and
14, Regularization Lecture10.pdf Section 3.3 from Tom
2018 Mitchell's book chapter
referred above.
Feb 16
SVMs and Kernel Andrew Moore's slides on
& 21, Lecture12.pdf
Methods SVMs
2018
Feb 28
&
Midsem practice problems
March Midsem week Lecture13.pdf
shared via Moodle
2,
2018
March Clustering, mixture
Lecture14.pdf

7 & 9, models + EM Lecture15.pdf Chapter 9 of [CB-2006]

2018 algorithm
March
Dimensionality A Tutorial on PCA by
14, -
Reduction Jonathon Shlens
2018
March Introduction to
Neural Networks and Deep
16, Neural Networks + Lecture17.pdf
Learning, Chapters 1 & 2
2018 Backpropagation
March Assignment 3
19, released:
Assignment 3 -
2018 Due March 28, 2018
March Neural Networks Notes on multi-layer NNs and
21, continued - backpropagation
2018
Guest lecture by
March
Prof. Arjun Jain:
23, Slides -
Deep Learning for
2018
Computer Vision

https://www.cse.iitb.ac.in/~pjyothi/cs419_spr18/index.html 3/5
9/10/21, 12:42 PM Introduction to Machine Learning

Date Title Summary Reading

slides

March Deep Learning for

28, Speech and Lecture19.pdf -
Language
2018
Processing
April Ensemble learning:
4, Boosting and - Chapter 14 of [CB-2006]
2018 Bagging
April Ensemble learning
6, continued - -
2018
April Hidden Markov Chapter 9 of Jurafsky &
11, Models Lecture22.pdf Martin, 2016
2018
April Assignment 4
11, released:
Assignment 4 -
2018 Due May 2, 2018
April
Sequence models Chapter 9 of Jurafsky &
13, continued - Martin, 2016
2018
April Slides from David Silver's
11, Last lecture Lecture24.pdf course on RL
2018

More reading
Topic Additional reading
Linear Regression Chapters 3.1-3.3 of [CB-2006]
Linear models for Chapter 4.1 of [CB-2006]
classification

Statistical Vapnik, V., An Overview of Statistical Learning Theory,

Learning Theory IEEE Transactions on Neural Networks, Vol. 10, pp. 988-999,
1999.
Discriminative Ng, A., On discriminative vs. generative classifiers: A
(LR) vs.
comparison of logistic regression and naive Bayes, NIPS,
Generative (NB)
2001.
models
Support Vector Christopher Burges, A Tutorial on Support Vector Machines
Machines and for Pattern Recognition, Data Mining and Knowledge
Kernel Methods Discovery, 1998.

NNs as Universal Kurt Hornik, Maxwell Stinchcombe and Halbert White,

Approximators Multilayer Feedforward Networks are Universal
Approximators, Neural Networks, 1989.

https://www.cse.iitb.ac.in/~pjyothi/cs419_spr18/index.html 4/5
9/10/21, 12:42 PM Introduction to Machine Learning

Topic Additional reading

Goodfellow, I., Bengio, Y., Courville, A., Deep Learning, Part
Deep Learning
II, MIT Press, 2016.

Resources
Most of the suggested readings will be freely available online. Here are some textbooks
to refer to:

[1] Understanding Machine Learning. Shai Shalev-Shwartz and Shai Ben-David.

Cambridge University Press. 2017. [SS-2017]
[2] The Elements of Statistical Learning. Trevor Hastie, Robert Tibshirani and
Jerome Friedman. Second Edition. 2009. [TH-2009]
[3] Foundations of Data Science. Avrim Blum, John Hopcroft and Ravindran
Kannan. January 2017. [AB-2017]
[4] Pattern Recognition and Machine Learning. Christopher Bishop. Springer.
2006. [CB-2006]

Website credit: This is based on a Jekyll template.

https://www.cse.iitb.ac.in/~pjyothi/cs419_spr18/index.html 5/5