Scribd
Upload
24 views

Introduction To Machine Learning

Machine learning is a branch of artificial intelligence concerned with algorithms that can learn from empirical data to predict future outcomes. It works by collecting examples that specify the correct output for a given input, then using a learning algorithm to produce a program that can determine the correct output for new cases. Machine learning algorithms have three main components - representation, evaluation, and optimization. The document then discusses different types of machine learning including supervised, unsupervised, and reinforcement learning.

Uploaded by

BHANU PRATAP SINGH
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
24 views

Introduction To Machine Learning

Machine learning is a branch of artificial intelligence concerned with algorithms that can learn from empirical data to predict future outcomes. It works by collecting examples that specify the correct output for a given input, then using a learning algorithm to produce a program that can determine the correct output for new cases. Machine learning algorithms have three main components - representation, evaluation, and optimization. The document then discusses different types of machine learning including supervised, unsupervised, and reinforcement learning.

Uploaded by

BHANU PRATAP SINGH
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Machine Learning

Introduction to machine learning


Introduction to machine learning

Definitions
• A branch of AI concerned with the design and development of
algorithms that allow computers to evolve behaviors based on
empirical data

• A branch of AI concerns the construction and study of


systems that can learn from data

• ML is about predicting the future based on past


Introduction to machine learning cont..

• It is hard to write all kinds of program like face recognition

• Instead of writing a program by hand , we collect lots of


example that specify the correct output for a given inputs

• A machine learning algorithms then takes these example and


produces a program that does the job.

• The program will work for new or unseen cases as well


Introduction to machine learning cont..

• Learning system model

Testing

Input Learning
Samples Method
Training
System
Introduction to machine learning cont..

• Traditional Programming

Data Output
Computer
Program

Machine Learning

Data Program
Computer
Output
Introduction to machine learning cont..

Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging
• [Your favorite area]
What is ML ?
• Tens of thousands of machine learning algorithms

• Hundreds new every year

• Every machine learning algorithm has three components:


– Representation
– Evaluation
– Optimization
Representation

• Decision trees
• Sets of rules / Logic programs
• Instances
• Graphical models (Bayes/Markov nets)
• Neural networks
• Support vector machines
• Model ensembles
• Etc.
Evaluation

• Accuracy
• Precision and recall
• Squared error
• Likelihood
• Posterior probability
• Cost / Utility
• Margin
• Entropy
• K-L divergence
• Etc.
Optimization

• Combinatorial optimization
– E.g.: Greedy search

• Convex optimization
– E.g.: Gradient descent

• Constrained optimization
– E.g.: Linear programming
Types of Learning
• Supervised (inductive) learning
– Training data includes desired outputs

• Unsupervised learning
– Training data does not include desired outputs

• Semi-supervised learning
– Training data includes a few desired outputs

• Reinforcement learning
– Rewards from sequence of actions
Supervised (inductive) learning

• Training data includes desired output


What we will cover ?
• Supervised learning

– Decision tree induction

– Instance-based learning(K- nearest neighbour)

– Bayesian learning( naive baye’s classifier)

– Linear regression model


– Logistic regression

– Support vector machines


– Random forest algorithm

– Neural networks
What we will cover
• Unsupervised learning

– Clustering
– Partitioning based methods
• K- means
• hierarchical
– Probabilistic
– Association rule mining
– Apriori
– FP-Growth
– Gaussian mixture model
– Dimensionality reduction

You might also like