New Microsoft Word Document
New Microsoft Word Document
Introduction to Artificial Intelligence, Machine Learning, Deep Learning Types of Machine Learning,
Application of Machine Learning.
2. Linear Algebra:
Scalar, Vector, Matrix, Matrix Operation, Norms, Probability, Joint Distribution, Bayes Theorem,
Expectation, Co-variance.
Simple Linear Regression, Multiple Linear Regression, Least square gradient descent, Linear
Classification, and Logistic Regression.
Representing concepts as decision trees. Recursive induction of decision trees. Picking the best
splitting attribute: entropy and information gain. Searching for simple trees and computational
complexity. Overfitting, noisy data, and pruning.
5. Ensemble Learning:
Neurons and biological motivation. Linear threshold units. Perceptrons: representational limitation
and gradient descent training. Multilayer networks and backpropagation. Hidden layers and
constructing intermediate, distributed representations. Overfitting, learning network structure,
recurrent networks.
Maximum margin linear separators. Quadratic programming solution to finding maximum margin
separators. Kernels for learning non-linear functions.
8. Bayesian Learning:
Probability theory and Bayes rule. Naive Bayes learning algorithm. Parameter smoothing. Generative
vs. discriminative training. Logistic regression. Bayes nets and Markov nets for representing
dependencies.