APEX INSTITUTE OF TECHNOLOGY

DEPARTMENT OF COMPUTER SCIENCE & ENGINEERING

MACHINE LEARNING (22CSH-286)

Faculty: Prof. (Dr.) Madan Lal Saini(E13485)

Lecture – 5
Encoding of Data DISCOVER . LEARN . EMPOWER
1
Machine Learning: Course Objectives
COURSE OBJECTIVES
The Course aims to:
1. Understand and apply various data handling and visualization techniques.
2. Understand about some basic learning algorithms and techniques and their
applications, as well as general questions related to analysing and handling large data
sets.
3. To develop skills of supervised and unsupervised learning techniques and
implementation of these to solve real life problems.
4. To develop basic knowledge on the machine techniques to build an intellectual
machine for making decisions behalf of humans.
5. To develop skills for selecting an algorithm and model parameters and apply them for
designing optimized machine learning applications.

2
COURSE OUTCOMES

On completion of this course, the students shall be able to:-

CO1 Describe and apply various data pre-processing and visualization techniques on dataset.

Understand about some basic learning on algorithms and analysing their applications, as
CO2
well as general questions related to analysing and handling large data sets.

Describe machine learning techniques to build an intellectual machine for making

CO3
decisions on behalf of humans.

Develop supervised and unsupervised learning techniques and implementation of these to

CO4
solve real life problems.

Analyse the performance of machine learning model and apply optimization techniques to
CO5
improve the performance of the model.

3
 Unit-1 Syllabus

Unit-1 Data Pre-processing Techniques

Data Pre- Data Frame Basics, CSV File, Libraries for Pre-processing, Handling
Processing Missing data, Encoding Categorical data, Feature Scaling, Handling Time
Series data.

Feature Extraction Dimensionality Reduction: Feature Selection Techniques, Feature

Extraction Techniques; Data Transformation, Data Normalization.

Data Visualization Different types of plots, Plotting fundamentals using Matplotlib, Plotting
fundamentals using Seaborn.

4
 SUGGESTIVE READINGS
TEXT BOOKS:
• T1: Tom.M.Mitchell, “Machine Learning”, McGraw Hill, International Edition, 2018
• T2: Ethern Alpaydin, “Introduction to Machine Learning”. Eastern Economy Edition, Prentice Hall of
India, 2015.
• T3: Andreas C. Miller, Sarah Guido, “Introduction to Machine Learning with Python”, O’REILLY
(2018).

REFERENCE BOOKS:
• R1 Sebastian Raschka, Vahid Mirjalili, “Python Machine Learning”, Packt Publisher (2019)
• R2 Aurélien Géron, “Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow”, Wiley,
2nd Edition, 2022
• R3 Christopher Bishop, “Pattern Recognition and Machine Learning”, Illustrated Edition, Springer,
2016.

5
Index
• Categorical Data
• Encoding
• Categorical Encoding
• Types of Categorical Encoding
• Label Encoding
• One-Hot Encoding
• Ordinal Encoding

By: Prof. (Dr.) Vineet Mehan 6

Categorical Data
• Examples:
• The city where a person lives: Delhi, Mumbai, Ahmedabad, Bangalore,
etc.
• The department a person works in: Finance, Human resources, IT,
Production.
• The highest degree a person has: High school, Diploma, Bachelors,
Masters, PhD.
• The grades of a student: A+, A, B+, B, B- etc.

By: Prof. (Dr.) Vineet Mehan 7

Categorical Data
• Data that is represented as ‘strings’ or ‘categories’ and are finite in
number is called Categorical Data.

• When your data has categories represented by strings, it will be

difficult to use them to train machine learning models.

• Why?

• Machine learning models often accepts numeric data.

By: Prof. (Dr.) Vineet Mehan 8
Categorical Data
• How to train a ML model for Categorical Data?

• Transform it.

• How to transform?

• Transform it using Encoding.

By: Prof. (Dr.) Vineet Mehan 9

Encoding
• Encoding means to convert data into a particular form.

• Encoding Categorical data is a technique to convert categorical entry

in a dataset to a numerical data.

• Various types of encoding are:

1. Label Encoding
2. One-hot Encoding
3. Ordinal Encoding
By: Prof. (Dr.) Vineet Mehan 10
1. Label Encoding
• In Label Encoding, we need to replace the categorical value using a
numerical value.

• Ranging  0-the total number of classes minus one.

• For instance, if the value of the categorical variable has six different
classes, we will use 0, 1, 2, 3, 4, and 5.

By: Prof. (Dr.) Vineet Mehan 11

1. Label Encoding
State Confirmed Deaths Recovered
Maharashtra 284281 11194 158140
Tamil Nadu 156369 2236 107416
Delhi 118645 3545 97693
Karnataka 51422 2089 19729
Gujarat 45481 2089 32103
Uttar Pradesh 43441 1046 26675

Covid-19 cases in India across states

By: Prof. (Dr.) Vineet Mehan 12

1. Label Encoding
State (Nominal Scale) State (Label Encoding)
Maharashtra 3
Tamil Nadu 4
Delhi 0
Karnataka 2
Gujarat 1
Uttar Pradesh 5

By: Prof. (Dr.) Vineet Mehan 13

Program We have created a dictionary 'data' and transformed it into a
Data Frame with the help of the DataFrame() function of
pandas.
• import pandas as pd
• my_data = {
• "Gender" : ['F', 'M', 'M', 'F', 'M', 'F', 'M', 'F', 'F', 'M'],
• "Name" : ['Shweta', 'Rohit', 'Abhay', 'Surbhi', 'Amit', 'Sara', 'Vicky', '
Mehak', 'Sita', 'Saurabh']
• }
• blk = pd.DataFrame(my_data)
• print("Geniune Data Frame:\n")
• print(blk)
By: Prof. (Dr.) Vineet Mehan 14
Output
Gender Name
0 F Shweta
1 M Rohit
2 M Abhay
3 F Surbhi
4 M Amit
5 F Sara
6 M Vicky
7 F Mehak
8 F Sita
9 M Saurabh

By: Prof. (Dr.) Vineet Mehan 15

By: Prof. (Dr.) Vineet Mehan 16
Program
• import pandas as pd import pandas and preprocessing modules of the scikit-learn library.
• from sklearn import preprocessing
• my_data = {
• "Gender" : ['F', 'M', 'M', 'F', 'M', 'F', 'M', 'F', 'F', 'M'],
• "Name" : ['Shweta', 'Rohit', 'Abhay', 'Surbhi', 'Amit', 'Sara', 'Vicky', 'Mehak', 'Sita', 'Saurabh']
• }
• blk = pd.DataFrame(my_data)
fit_transform() method in order to add label encoder
• my_label = preprocessing.LabelEncoder() functionality pointed by the object to the data variable.
•
• blk[ 'Gender' ]= my_label.fit_transform(blk[ 'Gender' ])
• print(blk[ 'Gender' ].unique())
• print("Data Frame after Label Encoding:\n")
• print( blk )
By: Prof. (Dr.) Vineet Mehan 17
Output
Gender Name
0 0 Shweta
1 1 Rohit
2 1 Abhay
3 0 Surbhi
4 1 Amit
5 0 Sara
6 1 Vicky
7 0 Mehak
8 0 Sita
9 1 Saurabh

By: Prof. (Dr.) Vineet Mehan 18

By: Prof. (Dr.) Vineet Mehan 19
2. One-hot Encoding
• Each category is mapped with a binary variable.

• Suppose we have a dataset with a category animal, having different

animals like Dog, Cat, Sheep, Cow, Lion.

By: Prof. (Dr.) Vineet Mehan 20

Program
• import pandas as pd

• #create DataFrame
• df = pd.DataFrame({'team': ['A', 'A', 'B', 'B', 'B', 'B', 'C', 'C'],
• 'points': [25, 12, 15, 14, 19, 23, 25, 29]})

• #view DataFrame
• print(df)

By: Prof. (Dr.) Vineet Mehan 21

Output
team points
0 A 25
1 A 12
2 B 15
3 B 14
4 B 19
5 B 23
6 C 25
7 C 29

By: Prof. (Dr.) Vineet Mehan 22

Program
• import pandas as pd

• #create DataFrame
• df = pd.DataFrame({'team': ['A', 'A', 'B', 'B', 'B', 'B', 'C', 'C'],
• 'points': [25, 12, 15, 14, 19, 23, 25, 29]})

• from sklearn.preprocessing import OneHotEncoder

• #creating instance of one-hot-encoder

• encoder = OneHotEncoder(handle_unknown='ignore')
By: Prof. (Dr.) Vineet Mehan 23
Program
• #perform one-hot encoding on 'team' column
• encoder_df =
pd.DataFrame(encoder.fit_transform(df[['team']]).toarray())

• #merge one-hot encoded columns back with original DataFrame

• final_df = df.join(encoder_df)

• #view final df
• print(final_df)
By: Prof. (Dr.) Vineet Mehan 24
Output
team points 0 1 2
0 A 25 1.0 0.0 0.0
1 A 12 1.0 0.0 0.0
2 B 15 0.0 1.0 0.0
3 B 14 0.0 1.0 0.0
4 B 19 0.0 1.0 0.0
5 B 23 0.0 1.0 0.0
6 C 25 0.0 0.0 1.0
7 C 29 0.0 0.0 1.0

By: Prof. (Dr.) Vineet Mehan 25

Drop the original Column Team
• #drop 'team' column
• final_df.drop('team', axis=1, inplace=True)

• #view final df
• print(final_df)

By: Prof. (Dr.) Vineet Mehan 26

Final Output
points 0 1 2
0 25 1.0 0.0 0.0
1 12 1.0 0.0 0.0
2 15 0.0 1.0 0.0
3 14 0.0 1.0 0.0
4 19 0.0 1.0 0.0
5 23 0.0 1.0 0.0
6 25 0.0 0.0 1.0
7 29 0.0 0.0 1.0

By: Prof. (Dr.) Vineet Mehan 27

3. Ordinal Encoding
• Ordinal Encoding is similar to Label Encoding where we take a list of
categories and convert them into integers.

• However, unlike Label Encoding, we preserve and order.

• For example, if we are encoding rankings of 1st place, 2nd place, etc,
there is an inherit order.

By: Prof. (Dr.) Vineet Mehan 28

Program
• # example of a ordinal encoding
• from numpy import asarray
• from sklearn.preprocessing import OrdinalEncoder

• # define data
• data = asarray([['red'], ['green'], ['blue']])
• print(data)

By: Prof. (Dr.) Vineet Mehan 29

Program
• # define ordinal encoding
• encoder = OrdinalEncoder()

• # transform data
• result = encoder.fit_transform(data)
• print(result)

By: Prof. (Dr.) Vineet Mehan 30

Output
[['red']
['green']
['blue']]
[[2.]
[1.]
[0.]]

By: Prof. (Dr.) Vineet Mehan 31

Summary
• Categorical Data

• Encoding

• Categorical Encoding

• Types of Categorical Encoding

32
Task
• Apply the ordinal encoding technique on a suitable dataset and get
the required result. (BT-Level3)

By: Prof. (Dr.) Vineet Mehan 33

 References
Book:
• Ethern Alpaydin, “Introduction to Machine Learning”. Eastern Economy Edition, Prentice Hall of
India, 2015.
• Andreas C. Miller, Sarah Guido, “Introduction to Machine Learning with Python”, O’REILLY
(2018).
Research Paper:
• Bi, Qifang, et al. "What is machine learning? A primer for the epidemiologist." American journal of
epidemiology 188.12 (2019): 2222-2239.
• Jordan, Michael I., and Tom M. Mitchell. "Machine learning: Trends, perspectives, and
prospects." Science 349.6245 (2015): 255-260.
Websites:
• https://www.geeksforgeeks.org/machine-learning/
• https://www.javatpoint.com/machine-learning
Videos:
• https://www.youtube.com/playlist?list=PLIg1dOXc_acbdJo-AE5RXpIM_rvwrerwR 34
 THANK YOU

For queries
Email: [email protected]