Scribd
Upload
83 views

Who Am I?: Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya

This document introduces Indrajit Bhattacharya, a senior scientist at TCS Labs who teaches machine learning. It provides an overview of his background, including his PhD from the University of Maryland and previous position at IBM Research India. It also outlines the course on foundations of algorithms and machine learning that he teaches, including prerequisites, recommended books, evaluation methods, and course plan covering topics like probabilistic models, graphical models, and ensemble methods.

Uploaded by

abdul
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
83 views

Who Am I?: Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya

This document introduces Indrajit Bhattacharya, a senior scientist at TCS Labs who teaches machine learning. It provides an overview of his background, including his PhD from the University of Maryland and previous position at IBM Research India. It also outlines the course on foundations of algorithms and machine learning that he teaches, including prerequisites, recommended books, evaluation methods, and course plan covering topics like probabilistic models, graphical models, and ensemble methods.

Uploaded by

abdul
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 13

Who am I?

• Work in Probabilistic Machine Learning


• Like to teach 

• Feb 2017 – current: Senior Scientist, TCS Labs


• Previously at IBM Research India, IISc Bangalore

• 2006: Phd in CS, U. Maryland, College Park


• 1999: Btech in CSE, IIT KGP

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 1
What about you?

• And what would you like to get out of this course?

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 2
Logistics
• Pre-requisites
• Probability
• Linear algebra, optimization, high school calculus, …

• Recommended Books
• “Machine Learning: A Probabilistic Perspective”, Kevin Murphy
• “Pattern Recognition and Machine Learning”, Christopher Bishop
• “An Introduction to Probabilistic Graphical Models”, Michael
Jordan

• Evaluation
• Assignments
• Exam

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 3
Machine Learning:
Why and What?

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 4
How are ML problems different?
• Learning
• What does it mean?
• Abductive and inductive reasoning vs deductive reasoning
• Why do machines / programs need to learn?

• Does it “make sense” to learn to sort or to add?

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 5
Why has ML taken off?
• Data

• Computational resources, storage

• Business interest

• Toolkits

• Sound mathematical principles

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 6
Types of ML problems: Supervised Learning

• Predict response / output / label given input

• Input: d-dimensional vector. Features / attributes

• Output:
• Categorical: Binary, Multi-class, Multi-label
• Real valued: Simple regression, multiple regression
• Ordinal: Ordinal regression
• Ranking: Learning to rank
• Structured: Sequence, Tree, Graph

• Training set: both inputs and outputs available


• Test set: for evaluation; only inputs available
Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 7
Types of ML problems: Unsupervised Learning

• Also called Knowledge discovery

• No labels available
• No clear notion of training or test

• Discover “patterns” e.g. clusters in the data


• Density estimation

• Evaluation?

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 8
Types of ML Problems: Reinforcement Learning

1. A robot vehicle on Mars


2. Learning to play chess

• Direct feedback only at the end

• Possibly closer to human learning

• Not covered in this course

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 9
Concept Learning: Example

• Hidden set of
instances called
concept

• Need to predict
if a test instance
is in that set

• Given training
examples from
that set

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 10
Probabilistic Concept Learning

• What are possible concepts? (Hypothesis space)


• How likely are the training examples to come from a particular
concept? (Training likelihood)
• How likely is the test example to belong to a particular
concept? (Test Likelihood)

• Bayesian Concept Learning


• How likely is a particular concept apriori? (Prior probability)
• How is likely is a particular concept after seeing the training
data? (posterior probability)
• How likely is the test example considering all these concepts and
their posterior probabilities?

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 11
Notions in ML
• Overfitting, generalization, regularization
• Validation of learning: whether future test instances are
correctly predicted

• Curse of dimensionality
• Lots of features is not always a good idea

• Model selection
• Need to know many different ML models
• “No free lunch” theorem

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 12
Course Plan
• Module 1
• Introduction
• Machine Learning: What and why
• Probability review for Machine Learning
• Estimation and decision theory
• Simple probabilistic models for classification and regression

• Module 2
• Latent variable models
• Graphical Models: Models for complex (non-iid) data

• Module 3
• Non parametric models, Kernel methods
• Ensemble methods

Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya 13

You might also like