Artificial Intelligence and Machine learning

Subject Code : 21CS54

By Savitha Nagaraju
AIML Dept, ATME
Introduction to Machine Learning
Module 2

Savitha Nagaraju
Assistant Professor
AIML Department, ATME College
Machine Learning , Data Science, Data Mining and Data Analytics
Data Science is an “Umbrella” term that encompasses many fields. Machine Learning starts with data.
Data Science and Machine Learning are interlinked. Data Science deals with gathering of data for analysis.

Data
Analytics
Data
Mining

Big Data

Data
Mining
Machine Learning , Data Science, Data Mining and Data Analytics
Big Data
Data Science concerns about collection of data. Big Data is a field of data science that deals with
data’s following characteristics:
Volume: Huge amount of data is generated by big companies
like Facebook, Twitter, You Tube.
Machine Learning , Data Science, Data Mining and Data Analytics
Big Data
Data Science concerns about collection of data. Big Data is a field of data science that deals with
data’s following characteristics:
Variety: Data is available in variety of forms like images,
videos and in different formats.
Machine Learning , Data Science, Data Mining and Data Analytics
Big Data
Data Science concerns about collection of data. Big Data is a field of data science that deals with
data’s following characteristics:
Velocity: It refers to the speed at which the data is generated and processed.
Machine Learning , Data Science, Data Mining and Data Analytics

Data Mining

Data mining aims to extract the hidden patterns that are in the data,
whereas, machine learning aims to use it for prediction.
Machine Learning , Data Science, Data Mining and Data Analytics
Data Analytics

Aims to extract useful knowledge from crude data.

There are different types of analytics. Predictive analytics is used for
making predictions. Machine Learning is closely related to this branch
of analytics and shares almost all algorithms.
 Machine Learning , Data Science, Data Mining and Data Analytics
Pattern Recognition

It is an engineering field. It uses machine learning algorithms to

extract features for pattern analysis and pattern classification.
One can view pattern recognition as a specific application of
machine learning.
Machine Learning , Data Science, Data Mining and Data Analytics

Data Data
Mining Analytics

Machine
Learning

Pattern Big
Recognition Data
Machine Learning , Data Science, Data Mining and Data Analytics
Statistics is a branch of mathematics that has solid theoretical foundation regarding statistical learning.
Like machine learning(ML), it can learn from data.

• Statistical methods looks for regularity in data called patterns.

• Statistics sets a hypothesis and performs experiments to verify and validate the hypothesis
in order to find relationships among data.
• Statistics requires knowledge of the statistical procedures and the guidance of a good statistician.
• Machine Learning comparatively , has less assumptions and requires less statistical knowledge.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

Machine
Learning

Supervised Unsupervised Semi-supervised Reinforcement

Learning Learning Learning Learning

Cluster Association Dimension

Classification Regression
Analysis Mining Reduction
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

• Labelled and Unlabelled Data

Data is represented in the form of a table. Data also can be referred to as a data point, sample, or an example.
Each row of the table represents a data point.Features are attributes or characteristics of an object.
Columns of the table are attributes. Out of all attributes, one attributes is important and is called a label.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Labelled Data
Example, Iris flower dataset

Iris Vesicolor Iris Verginica

Iris Setosa
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Labelled Data
Example, Iris flower dataset
The dataset has 50 samples of Iris- with four attributes, length and width of sepals and petals.
The target variable is called class. There are three classes-Iris Setosa, Iris Virginica, and Iris Versicolor.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
A dataset need not be always numbers. It can be images or video frames. Deep neural networks can handle
images with labels
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Data that is not associated with labels are called unlabelled data.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Supervised Learning

Supervised algorithms use labelled dataset.

Supervised learning provides labelled data so that the model is constructed and generates test data.

Supervised Learning has two methods:

1. Classification
2. Regression
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Classification
• Classification is a supervised learning method.
• The input attributes of the classification algorithms are called independent variables.
• The target attribute is called label or dependent variable.
• The relationship between the input and target variable is represented in the form of structure
which is called classification model.
• The focus of classification is to predict the ‘label’ that is in a discrete form.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
In classification, the learning takes place in two stages.
During the first stage, called the training stage, the learning algorithm takes a labelled dataset and starts learning.
In the second stage, the constructed model is tested with test or unknown sample and assigned a label.

Classification Models
(based on implementation methods)

Probabilistic Distance Soft Computing

Decision Trees
methods measures methods
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

Classification
Models

Generative Discriminative
models models
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

Generative Models
Deals with process of data generation and its distribution. Probabilistic models are examples of generative models.

Discriminative Models
Discriminative models do not care about the generation of data. Instead, they simply concentrate
on classifying the given data
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

Some of the key algorithms of classification are:

• Decision Tree
• Random Forest
• Support Vector Machines
• Naïve Bayes
• Artificial Neural Network and Deep Learning networks like CNN.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Regression Models
• The regression model takes input x and generates a model in the form of a fitted line of the form y=f(x).
• Here, x is the independent variable that may be one or more attributes and y is dependent variable.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Regression Models
Regression Models predict continuous variables like price.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Regression Models
Linear regression takes the training set and tries to fit it with a line
product sales=0.66* Week + 0.54
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Regression Models
The main difference is that regression models predict continuous variables such as product price,
while classification concentrates on assigning labels such as class.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Unsupervised Learning
This process of self-instruction is based on the concept of trial and error.

The program is supplied with objects, but no labels are defined. The algorithm
itself observes the patterns based on the principles of grouping. Grouping is done in ways
that similar objects form the same group

Example of unsupervised algorithms:

• Cluster Analysis
• Dimensionality Reduction Algorithms
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning

Some of the key clustering algorithms are:

• K-means algorithm
• Hierarchical algorithms
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Dimensionality Reduction
Dimensionality reduction algorithms are examples of supervised algorithms.
It takes higher dimension data as input and outputs the data in lower dimension by taking advantage of
the variance of the data.
It is a task of reducing the dataset with few features without losing the generality.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Semi-supervised Learning
There are circumstances where the dataset has huge collection of unlabelled data and some labelled data.
Labelling is a costly process and difficult to perform by the humans.
Semi-supervised algorithms use unlabelled data by assigning a pseudo-label.
Then, the labelled and pseudo-labelled dataset can be combined.
Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Reinforcement Learning
Reinforcement learning mimics human beings. Like human beings use ears and eyes
to perceive the world and take actions, reinforcement learning allows the agent to interact
with the environment to get rewards.
The agent can be human, animal, robot, or any independent program.
The rewards enable the agent to gain experience.

The agent aims to maximize rewards.

Machine Learning , Data Science, Data Mining and Data Analytics
Types of Machine Learning
Reinforcement Learning

The reward can be positive or negative(Punishment). When the rewards are more, the behaviour gets reinforced and
Learning becomes possible.

Goal

Grid Game

Danger
Machine Learning , Data Science, Data Mining and Data Analytics
Challenges of Machine Learning

• Ill posed problems-problems whose specifications are not clear.

Input(x1,x2) Output(y)
1,1 1
2,1 2
3,1 3
4,1 4
5,1 5
Machine Learning , Data Science, Data Mining and Data Analytics
Challenges of Machine Learning

• Huge Data
This is primary requirement of machine learning. Availability of a quality data is a challenge.
Input(x1,x2)
A quality data means Output(y)
it should be large and should not have data problems such as missing data or incorrect data.
• High Computation power
With the availability of big data, the computational resource requirement is also increased. Systems with GPU and TPU
Are required to execute machine learning algorithms.

• Complexity of Algorithms
The selection of algorithms, describing the algorithms application of algorithms to solve machine learning task,
and comparison of algorithms have become necessary for machine learning or data scientist now.
Machine Learning , Data Science, Data Mining and Data Analytics
Challenges of Machine Learning

• Bias/Variance
Variance is the error of the model. This leads to bias and variance trade-off.
A model that fitsInput(x1,x2)
the training data correctly butOutput(y)
fails for test data, is called overfitting.
The reverse problem is underfitting, where the model fails for training data but has good generalization.
Machine Learning , Data Science, Data Mining and Data Analytics
Machine Learning Process

Understand the Understand the

business data

Data
preprocessing

Modelling

Model Model
evaluation deployment
Machine Learning , Data Science, Data Mining and Data Analytics
Machine Learning Applications
Machine Learning , Data Science, Data Mining and Data Analytics
Machine Learning Applications