Machine Learning
Machine Learning
Instructor:
Dr. Muhammad Kabir
Assistant Professor
[email protected]
- 4 Programming Assignments
- 4 Homeworks
10% Quizzes
- Tentatively 5 Quizzes
45% Exams
- One midterm (15%)
- Final (30%)
10% Project
10% participation + Attendance
5% Viva (End of Semester)
Grading Policy – Tentative
Course
CS446 – Machine Learning
Homework Late Policy
- 10% per day for 5 days. No submission after 5 days (120 hours)
Missed Quiz Policy
- No make-up for quiz
Plagiarism will be strictly dealt with as per university policies (take it seriously).
Zero Tolerance for Plagiarism and Cheating.
What is this course about?
Introductory course in Machine Learning (ML) – Fundamental topics in
- Supervised learning
- Unsupervised learning
Course Objectives:
• To provide a thorough introduction to ML methods
• To build mathematical foundations of ML and provide an appreciation
for its applications
• To provide experience in the implementation and evaluation of ML
algorithms
• To develop research interest in the theory and application of ML
Is this course a right choice for you?
Undergraduate students
- Interested in pursuing AI, Deep Learning and/or Machine Learning in their
graduate school
- Interesting in pursuing a professional career focused on the development of
Machine Learning solutions
► Undergraduate students
- Linear Algebra
- Probability
- Programming
Weeks: 1,2
Components:
• Programming Assignment 1: Intro to Python, Setting up
Environment
Modules
Components:
• Programming Assignment 1: Intro to Python, Setting up
Environment
Modules
Classification
KNN
Weeks: 4,5
Components:
• Programming Assignment 2: KNN based (Using Images)
• Homework 1A
Modules
Linear Regression
Gradient Descent
Multi-variate Regression
4-
Regression Polynomial Regression
Weeks: 6,7
Components:
• Programming Assignment 3: Regression
• Homework 1B
Modules
Logistic Regression
5-
Logistic
Regression
Weeks: 7
Components:
• Programming Assignment 4: Logistic Regression
Modules
Bayes Theorem
Naive Bayes Classification
6 – Bayesian
Framework
Components:
• Programming Assignment 5: Naïve Bayes
Classifier (may be merged with Assignment 4)
• Homework 2
Modules
Perceptron Algorithm
SVM
7–
Perceptron, Neural Networks
SVM and
Neural
Network
Weeks: 10,11,12,13
Components:
• Programming Assignment 6: Neural Networks
• Homework 3
Modules
Unsupervised Learning Overview
Clustering (k-means)
8–
Clustering
Weeks: 14,15
Components:
• Homework 3
Suggested Reference Books
https://azure.microsoft.com/en-us/solutions/ai/artificial-intelligence-vs-machine-
learning/#benefits
Machine Learning Overview - Example
Classical Example: Recognize hand-written 2!
Machine Learning: Overview
Example Applications
► Medical Diagnosis
► Autonomous Driving
► Information extraction
► Computer/Machine Vision
► Finance
► Web Search
► Robotics
► Social networks
► Production Industry
► Logistics
► Waste Management
Data
Model
Algorithm f x
Final output which
enables us to make
Given to us We need to design it predictions
Machine Learning: Overview
Nature of ML Problems
1. Supervised Learning
The learning algorithm would receive a set of inputs along with the
corresponding correct outputs to train a model
Training Data
Training Data
Labeled
+ Data Modeling and
Model Augmentation
unlabeled
Data
Use labeled data to Place unlabeled data Use the model to label Fit the model again
build a model with model the unlabeled data with the combined data
Machine Learning: Overview
Typical Flow
f x
Model Model
Deployment Validation
Machine Learning: Overview
General Steps in Designing a ML Model
Machine Learning: Overview
Steps in Programming
Examples - Machine Learning: Overview
Training Data Collection
x Process or System y
Input
Observed Output
PROCESS or SYSTEM : Underlying physical or logical phenomenon which maps our input data to our observed output
• Previous Sales
• Prices Future
Process or System
• Inflation sales
• Pandemic
Market
Consumer segmentation based
Transaction Process or System on consumers’
Data spending patterns
• Income
• Credit History
Process or System Loan Approval
• Employment
• Marital Status
Machine Learning: Overview
Data Types
Tabulated Data
• Each column is a feature and adds one dimension to the data
• Number of columns define total number of features and hence data dimensionality
• Ideally, these columns should contain different information -> uncorrelated
Machine Learning: Overview
Data Types
Feature 2 Feature 2
Feature 1 Feature 1
Features are correlated Features are uncorrelated
Find all those dimensions (features) which carry very less information and discard them
Machine Learning: Overview
Data Types
Images
Heterogeneous data
9/29/2022
Chapter Reading
Chapter 1
Machine Learning - A Probabilistic Perspective
by
Kevin P. Murphy