Scribd
Upload
24 views

Introduction To Machine Learning

Machine learning is a branch of artificial intelligence concerned with algorithms that can learn from empirical data to predict future outcomes. It works by collecting examples that specify the correct output for a given input, then using a learning algorithm to produce a program that can determine the correct output for new cases. Machine learning algorithms have three main components - representation, evaluation, and optimization. The document then discusses different types of machine learning including supervised, unsupervised, and reinforcement learning.

Uploaded by

BHANU PRATAP SINGH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
24 views

Introduction To Machine Learning

Machine learning is a branch of artificial intelligence concerned with algorithms that can learn from empirical data to predict future outcomes. It works by collecting examples that specify the correct output for a given input, then using a learning algorithm to produce a program that can determine the correct output for new cases. Machine learning algorithms have three main components - representation, evaluation, and optimization. The document then discusses different types of machine learning including supervised, unsupervised, and reinforcement learning.

Uploaded by

BHANU PRATAP SINGH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Machine Learning

Introduction to machine learning


Introduction to machine learning

Definitions
• A branch of AI concerned with the design and development of
algorithms that allow computers to evolve behaviors based on
empirical data

• A branch of AI concerns the construction and study of


systems that can learn from data

• ML is about predicting the future based on past


Introduction to machine learning cont..

• It is hard to write all kinds of program like face recognition

• Instead of writing a program by hand , we collect lots of


example that specify the correct output for a given inputs

• A machine learning algorithms then takes these example and


produces a program that does the job.

• The program will work for new or unseen cases as well


Introduction to machine learning cont..

• Learning system model

Testing

Input Learning
Samples Method
Training
System
Introduction to machine learning cont..

• Traditional Programming

Data Output
Computer
Program

Machine Learning

Data Program
Computer
Output
Introduction to machine learning cont..

Sample Applications
• Web search
• Computational biology
• Finance
• E-commerce
• Space exploration
• Robotics
• Information extraction
• Social networks
• Debugging
• [Your favorite area]
What is ML ?
• Tens of thousands of machine learning algorithms

• Hundreds new every year

• Every machine learning algorithm has three components:


– Representation
– Evaluation
– Optimization
Representation

• Decision trees
• Sets of rules / Logic programs
• Instances
• Graphical models (Bayes/Markov nets)
• Neural networks
• Support vector machines
• Model ensembles
• Etc.
Evaluation

• Accuracy
• Precision and recall
• Squared error
• Likelihood
• Posterior probability
• Cost / Utility
• Margin
• Entropy
• K-L divergence
• Etc.
Optimization

• Combinatorial optimization
– E.g.: Greedy search

• Convex optimization
– E.g.: Gradient descent

• Constrained optimization
– E.g.: Linear programming
Types of Learning
• Supervised (inductive) learning
– Training data includes desired outputs

• Unsupervised learning
– Training data does not include desired outputs

• Semi-supervised learning
– Training data includes a few desired outputs

• Reinforcement learning
– Rewards from sequence of actions
Supervised (inductive) learning

• Training data includes desired output


What we will cover ?
• Supervised learning

– Decision tree induction

– Instance-based learning(K- nearest neighbour)

– Bayesian learning( naive baye’s classifier)

– Linear regression model


– Logistic regression

– Support vector machines


– Random forest algorithm

– Neural networks
What we will cover
• Unsupervised learning

– Clustering
– Partitioning based methods
• K- means
• hierarchical
– Probabilistic
– Association rule mining
– Apriori
– FP-Growth
– Gaussian mixture model
– Dimensionality reduction

You might also like