Department of AIML
PAI Practile file
NAME: Shivam
BRANCH: CSE(AI-ML)
SEM: 6TH
ROLL NO: 23242
Shivam (23242)
Department of CSE AIML
Certificate
Certified that this Practical entitled “Big Data Lab” submitted by Shivam (23242), student
of Computer Science & Engineering Department, Dronacharya College of
Engineering, Gurgaon in the partial fulfillment of the requirement for the award
Bachelor’s of Technology (Branch) Degree of MDU, Rohtak, is a record of student own
study carried under my supervision & guidance.
Shivam (23242)
Sr. Practical Name Signature
No.
1. Introduction of various python libraries used for
machine
learning.
2. Write a program to perform data pre-processing
techniques for effective machine learning.
3. Write a program to apply different feature encoding
schemes on the given dataset.
4. Write a program to apply filter feature selection
techniques
5.
6.
7.
8.
9.
10.
Shivam (23242)
PROGRAM 1: Introduction of various python libraries used for machine learning.
Code:
[1]: pandas as pd import numpy as np
import
[2]: # reading data
data=pd.read_csv("data.csv")
[3]: data
[3]: Country Age Salary Purchased
0 France 44.0 72000.0 No
1 Spain 27.0 48000.0 Yes
2 Germany 30.0 54000.0 No
3 Spain 38.0 61000.0 No
4 Germany 40.0 NaN Yes
5 France 35.0 58000.0 Yes
6 Spain NaN 52000.0 No
7 France 48.0 79000.0 Yes
8 Germany 50.0 83000.0 No
9 France 37.0 67000.0 Yes
[4]: student_data = {"Name":['Prateek','Ronak','Geetanshu','Naman','Ankit'], "exam_no":[18,25,45,34,36],
"Result":['pass','fail','pass','pass','fail']}
df = pd.DataFrame(student_data) df
[4] : Name exam_no Result
0 Prateek 18 pass
1 Ronak 25 fail
2 Geetanshu 45 pass
3 Naman 34 pass
4 Ankit 36 fail
[6]: # access data with the help of label
[6] : df.loc[2,['Name']]
Name Geetanshu
Name: 2, dtype:
object
Shivam (23242)
[7]: df.iloc[2,0]
[7] : 'Geetanshu'
[]:
PROGRAM 2: Write a program to perform data pre-processing techniques for effective
machine learning
Shivam (23242)
[1]:# import pandas
import pandas as pd
[47]:#read csv file
df=pd.read_csv('data.csv')
[30]:# print first 5 elements
df.head()
[30]: Country Age Salary Purchased
0 France 44.0 72000.0 No
1 Spain 27.0 48000.0 Yes
2 Germany 30.0 54000.0 No
3 Spain 38.0 61000.0 No
4 Germany 40.0 NaN Yes
[6]:# import numpy
import numpy as np
[7]:# import StringIO
from io import StringIO
[31]:# check for the null value
df.isnull()
[31]: Country Age Salary Purchased
0 False False False False
1 False False False False
2 False False False False
3 False False False False
4 False False True False
5 False False False False
6 False True False False
7 False False False False
8 False False False False
9 False False False False
Shivam (23242)
[59]: # assign 10 in place of null value df["Age"].fillna(10, inplace = True) df["Salary"].fillna(10, inplace =
True)
[60]: # print updates dataset
df
[60]: Country Age Salary Purchased
0 France 44.0 72000.0 No
1 Spain 27.0 48000.0 Yes
2 Germany 30.0 54000.0 No
3 Spain 38.0 61000.0 No
4 Germany 40.0 10.0 Yes
5 France 35.0 58000.0 Yes
6 Spain 10.0 52000.0 No
7 France 48.0 79000.0 Yes
8 Germany 50.0 83000.0 No
9 France 37.0 67000.0 Yes
[34]: # check for null value after updation
df.isnull().sum()
[34]: Country 0
Age 0
Salary 0
Purchased 0
dtype: int64
[35]: # import SimpleImputer from sklearn
from sklearn.impute import SimpleImputer
[36]: # set model attributes
imr = SimpleImputer(strategy="constant",fill_value= 10 )
[37]: # Fit the data into the model
imr = imr.fit(df.values)
[54]: imputed_data = imr.transform(df.values)
[55]: # print data after transormed
imputed_data
[55]: array([['France', 44.0, 72000.0, 'No'],
['Spain', 27.0, 48000.0, 'Yes'],
['Germany', 30.0, 54000.0, 'No'],
['Spain', 38.0, 61000.0, 'No'],
['Germany', 40.0, 10, 'Yes'],
Shivam(23242)
['France', 35.0, 58000.0, 'Yes'],
['Spain', 10, 52000.0, 'No'],
['France', 48.0, 79000.0, 'Yes'],
['Germany', 50.0, 83000.0, 'No'],
['France', 37.0, 67000.0, 'Yes']], dtype=object)
Shivam(23242)
PROGRAM 3: Write a program to apply different feature encoding schemes on the given dataset.
[57]: #df.describe()
[57]: Age Salary
count 9.000000 9.000000
mean 38.777778 63777.777778
std 7.693793 12265.579662
min 27.000000 48000.000000
25% 35.000000 54000.000000
50% 38.000000 61000.000000
75% 44.000000 72000.000000
max 50.000000 83000.000000
[42]: # import and apply LabelEncoder to the data from sklearn.preprocessing import
LabelEncoder df_le= df
class_le = LabelEncoder()
df_le['Country'] = class_le.fit_transform(df_le['Country'].values) df_le
[42]: Country Age Salary Purchased
0 0 44.0 72000.0 No
1 2 27.0 48000.0 Yes
2 1 30.0 54000.0 No
3 2 38.0 61000.0 No
4 1 40.0 10.0 Yes
5 0 35.0 58000.0 Yes
6 2 10.0 52000.0 No
7 0 48.0 79000.0 Yes
8 1 50.0 83000.0 No
9 0 37.0 67000.0 Yes
[48]: df
[48]: Country Age Salary Purchased
0 France 44.0 72000.0 No
1 Spain 27.0 48000.0 Yes
Shivam(23242)
2 Germany 30.0 54000.0 No
3 Spain 38.0 61000.0 No
4 Germany 40.0 NaN Yes
5 France 35.0 58000.0 Yes
6 Spain NaN 52000.0 No
7 France 48.0 79000.0 Yes
8 Germany 50.0 83000.0 No
9 France 37.0 67000.0 Yes
[61]: df_new=pd.get_dummies(df)
[62]: df_new
[62]: Age Salary Country_France Country_Germany Country_Spain \
0 44.0 72000.0 1 0 0
1 27.0 48000.0 0 0 1
2 30.0 54000.0 0 1 0
3 38.0 61000.0 0 0 1
4 40.0 10.0 0 1 0
5 35.0 58000.0 1 0 0
6 10.0 52000.0 0 0 1
7 48.0 79000.0 1 0 0
8 50.0 83000.0 0 1 0
9 37.0 67000.0 1 0 0
Purchased_No Purchased_Yes
0 1 0
1 0 1
2 1 0
3 1 0
4 0 1
5 0 1
6 1 0
7 0 1
8 1 0
9 0 1
[63]: df_le['Country']
[63]: 0 0
1 2
2 1
3 2
4 1
5 0
Shivam(23242)
6 2
Shivam(23242)
7 0
8 1
9 0
Shivam(23242)
PROGRAM 4: Write a program to apply filter feature selection techniques.
Shivam(23242)
Shivam(23242)
Shivam(23242)
Shivam(23242)
