Machine learning with pythone_syllabus
Machine learning with pythone_syllabus
1. About Course
Machine Learning is broad and fast-growing sub-field of Artificial Intelligence. This course
introduces students to the basic concepts and techniques of Machine Learning. And this
course also contains Basic of Python Programming to contain control structure,
conditional statement, function Sequence Data type and numpy that make students to
more skilled.
2. Objective of Course
Machine Learning is broad and fast-growing sub-field of Artificial Intelligence. This
course introduces students to the basic concepts and techniques of Machine Learning. The
objective of this course is to develop the skills required for Machine Learning
Technologies with use of Python to analyze data and solving ML problems like
Regression and Classification using machine learning algorithms.
After completing the module, the learner will be able to:
● Understand the basic concepts of Python language.
● Understand the basics of Machine Learning & their types.
● Understand various learning models, methods and applications
under supervised and unsupervised learning.
● Understand data preprocessing for Machine Learning.
● Solve real world problems through machine learning
implementation leading to predictions.
Numpy
1. Session 7: Numpy Fundamentals
● Numpy Theory
● Numpy array
● Matrix in numpy
● Numpy array attributes
● Array operations
● Scalar and Vector operations
● Numpy array functions
❖ Dot product
❖ Log, exp, mean, median, std, prod, min, max, trigo, variance,
ceil, floor, slicing, iteration
❖ Reshaping
Pandas
1. Session 8: Pandas Series
● What is Pandas?
● Introduction to Pandas Series
● Series Methods
● Series with Python functionalities
● Boolean Indexing on Series
● Plotting graphs on series
2. Session 9: Pandas DataFrame
● Introduction Pandas DataFrame
● Creating DataFrame and read_csv()
● DataFrame attributes and methods
● Dataframe Math Methods
● Selecting cols and rows from dataframe
● Filtering a Dataframe
● Adding new columns
● Dataframe function – astype()
Data Visualization
1) Session 10: Plotting Using Matplotlib
● Get started with Matplotlib
● Plotting simple functions, labels, legends, multiple plots
● About scatter plots
● Bar chart
● Histogram
● Pie chart
● Changing styles of plots
Linear Regression
1) Session 11: Introduction to Machine Learning
● About Machine Learning (History and Definition)
● Types of ML
❖ Supervised Machine Learning
❖ Unsupervised Machine Learning
❖ Semi supervised Machine Learning
❖ Reinforcement Learning
● Batch/Offline Machine Learning
● Disadvantages of Batch learning
● Online Machine Learning
❖ Importance
❖ When to use and how to use
❖ Learning Rate
❖ Out of core learning
❖ Disadvantages
● Batch vs Online learning
● Instance based learning
● model-based learning
● Instance vs model-based learning
● Challenges in ML
❖ Data collection
❖ Insufficient/Labelled data
❖ Non-representative data
❖ Poor quality data
❖ Irrelevant features
❖ Overfitting and Underfitting
❖ Offline learning
❖ Cost
● Machine Learning Development Life-cycle
2) Session 12: Simple Linear regression
● Introduction and Types of Linear Regression
● Simple Linear Regression
● Intuition of simple linear regression
● Code example
● How to find m and b?
● Simple Linear Regression model code from scratch
● Regression Metrics
❖ MAE
❖ MSE
❖ RMSE
❖ R2 score
❖ Adjusted R2 score
3) Session 13: Multiple Linear Regression
● Introduction to Multiple Linear Regression (MLR)
● Code of MLR
● Mathematical Formulation of MLR
● Error function of MLR
● Minimizing error
● Error function continued
● Code from scratch
Feature Selection
1) Session 14: feature Selection Part 1
● What is Feature Selection?
● Why to do Feature Selection?
● Types of Feature Selection
● Filter based Feature Selection
❖ Duplicate Features
❖ Variance Threshold
❖ Correlation
❖ ANOVA
❖ Chi-Square
❖ Advantages and Disadvantages
2) Session 15: Feature Selection Part 2
● Wrapper method
● Types of wrapper method
● Exhaustive Feature Selection/Best Subset Selection
● Sequential Backward Selection/Elimination
● Sequential Forward Selection
● Advantages and Disadvantages
3) Session on Feature Selection part 3
● Recursive Feature Elimination
● Advantages and Disadvantages
4) PCA
● Dimensionality reduction
● Scikit Learn’s PCA class
● PCA variance Ratio
● Randomized PCA
● Incrimental PCA
● PCA on MNIST dataset
● Code with example
Regularization
1) Session 16: Regularization Part 1 | Bias-Variance Tradeoff
● Why we need to study Bias and Variance
● Expected Value and Variance
● Bias and Variance Mathematically
2) Session on Regularization Part 1 | What is Regularization
● Bias Variance Decomposition
● Diagram
● Analogy
● Code Example
● What is Regularization?
● When to use Regularization?
3) Ridge Regression Part 1
● Types of Regularization
● Geometric Intuition
● Sklearn Implementation
4) Session 16 : Lasso Regression
● Intuition
● Code example
● Lasso regression key points
5) Why Lasso Regression creates Sparsity?
6) ElasticNet Regression
● Intuition
● Code example
K Nearest Neighbors
1) Session 17: K nearest Neighbors Part 1
● KNN intuition
● Code Example
● How to select K?
● Decision Surface
● Overfitting and Underfitting in KNN
● Limitations of KNN
2) Classification Metrics Part 1
● Accuracy
● Accuracy of multi-classification problems
● How much accuracy is good?
● Problem with accuracy
● Confusion matrix
● Confusion matrix of multi-classification problems
● When accuracy is misleading
3) Classification Metrics Part 2
● Precision
● Recall
● F1 score
● Multi class Precision and Recall
● Multi class F1 score
Decision Trees
1. Session 22: Decision Tree
● Introduction
● Intuition behind DT
● Terminology in Decision Tree
● The CART Algorithm - Classification
● Splitting Categorical Features
● Splitting Numerical Features
● Understanding Gini Impurity?
● Geometric Intuition of DT
Session 26 : DNN:
● MLP and Backpropagation
● Regression MLP
● Implementing MLP with Keras
● Fine tuning NN hyperparameters
● Activation function
● Batch normalization
● Monte Carlo droupout
● Tensor Flow’s API
● Dataset with Keras
● Deep Computer Vision using CNN
—-----------------------------------------------------------------------