Scribd
Upload
3 views

notebook - text classification

Uploaded by

golgothgolgoth039
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
3 views

notebook - text classification

Uploaded by

golgothgolgoth039
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 7

text-classification

August 6, 2024

0.1 OBJECTIVE
Text Classification:
Build a text classification model to classify an email as spam or not without using llms or any
transformer based model but use a machine learning classification algorithm after vectorising the
text data. Submit your code along with a document explaining what approach you took and why?
Attached is spam.csv file containing data for this

[1]: # Importing required libraries


import pandas as pd
from sklearn.preprocessing import LabelEncoder
import seaborn as sns
from nltk.corpus import stopwords
import string
from sklearn.model_selection import train_test_split
from sklearn.feature_extraction.text import TfidfVectorizer
from imblearn.over_sampling import SMOTE

from sklearn.linear_model import LogisticRegression


from sklearn.naive_bayes import MultinomialNB
from sklearn.naive_bayes import BernoulliNB
from sklearn.svm import SVC
from sklearn.neighbors import KNeighborsClassifier
from sklearn.tree import DecisionTreeClassifier

import joblib

from sklearn.metrics import classification_report

0.2 Data Explorartion


[2]: #Loading the dataset
df = pd.read_csv('/kaggle/input/spam-csv/spam.csv')
df

[2]: label text


0 ham Go until jurong point, crazy.. Available only …
1 ham Ok lar… Joking wif u oni…

1
2 spam Free entry in 2 a wkly comp to win FA Cup fina…
3 ham U dun say so early hor… U c already then say…
4 ham Nah I don't think he goes to usf, he lives aro…
… … …
5567 spam This is the 2nd time we have tried 2 contact u…
5568 ham Will Ì_ b going to esplanade fr home?
5569 ham Pity, * was in mood for that. So…any other s…
5570 ham The guy did some bitching but I acted like i'd…
5571 ham Rofl. Its true to its name

[5572 rows x 2 columns]

[3]: df.info()

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 5572 entries, 0 to 5571
Data columns (total 2 columns):
# Column Non-Null Count Dtype
--- ------ -------------- -----
0 label 5572 non-null object
1 text 5572 non-null object
dtypes: object(2)
memory usage: 87.2+ KB

[4]: df.describe(include='object')

[4]: label text


count 5572 5572
unique 2 5158
top ham Sorry, I'll call later
freq 4825 30

0.3 Data Visualization


[5]: #Visualzing the class labels
sns.countplot(df,x='label')
print(df['label'].value_counts())

label
ham 4825
spam 747
Name: count, dtype: int64

2
0.4 Data Cleaning
[6]: def clean_text(mail):
#Remove the punctuation
without_punctuation = ''.join(char for char in mail if char not in string.
↪punctuation)

#Remove the stopwords


result = ' '.join(word for word in without_punctuation.split() if word.
↪lower() not in set(stopwords.words('english')))

return result

df['text'] = df['text'].apply(clean_text)
df['text']

[6]: 0 Go jurong point crazy Available bugis n great …


1 Ok lar Joking wif u oni
2 Free entry 2 wkly comp win FA Cup final tkts 2…
3 U dun say early hor U c already say
4 Nah dont think goes usf lives around though

3
…
5567 2nd time tried 2 contact u U å£750 Pound prize…
5568 Ì b going esplanade fr home
5569 Pity mood Soany suggestions
5570 guy bitching acted like id interested buying s…
5571 Rofl true name
Name: text, Length: 5572, dtype: object

0.5 Feature Encoding


[7]: # Ecoding the label feature
saved_encoder = {}
label_encoder = LabelEncoder()
label_encoder.fit(df['label'])
saved_encoder[df['label'].name] = label_encoder
df['label'] = label_encoder.transform(df['label'])

print([(index, label) for index, label in enumerate(label_encoder.classes_)])


df

[(0, 'ham'), (1, 'spam')]

[7]: label text


0 0 Go jurong point crazy Available bugis n great …
1 0 Ok lar Joking wif u oni
2 1 Free entry 2 wkly comp win FA Cup final tkts 2…
3 0 U dun say early hor U c already say
4 0 Nah dont think goes usf lives around though
… … …
5567 1 2nd time tried 2 contact u U å£750 Pound prize…
5568 0 Ì b going esplanade fr home
5569 0 Pity mood Soany suggestions
5570 0 guy bitching acted like id interested buying s…
5571 0 Rofl true name

[5572 rows x 2 columns]

0.6 Spliting the Data, Vectorizing and Resampling


[8]: X = df['text']
y = df['label']

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.33,␣


↪random_state=42)

vectorizer = TfidfVectorizer()
X_train = vectorizer.fit_transform(X_train)

4
X_test = vectorizer.transform(X_test)

#Since there is class imbalance between Spam vs Ham, resampling using SMOTE
smote = SMOTE(random_state=42)
X_train_resampled, y_train_resampled = smote.fit_resample(X_train, y_train)

0.7 Model Training, Saving and Evaluation


[9]: algorithms = ␣
↪[LogisticRegression(),MultinomialNB(),SVC(),BernoulliNB(),KNeighborsClassifier(),DecisionTre

for algorithm in algorithms:


model = algorithm
model.fit(X_train_resampled,y_train_resampled)
joblib.dump(model,'model_'+ f'{model}' + '.pkl')

print(f'classification report for {str(algorithm)}')


print(classification_report(algorithm.predict(X_test),y_test))
print('\n')

classification report for LogisticRegression()


precision recall f1-score support

0 0.99 0.98 0.99 1593


1 0.90 0.92 0.91 246

accuracy 0.98 1839


macro avg 0.94 0.95 0.95 1839
weighted avg 0.98 0.98 0.98 1839

classification report for MultinomialNB()


precision recall f1-score support

0 0.97 0.99 0.98 1559


1 0.94 0.84 0.89 280

accuracy 0.97 1839


macro avg 0.95 0.92 0.93 1839
weighted avg 0.97 0.97 0.97 1839

classification report for SVC()


precision recall f1-score support

5
0 1.00 0.98 0.99 1623
1 0.84 0.98 0.91 216

accuracy 0.98 1839


macro avg 0.92 0.98 0.95 1839
weighted avg 0.98 0.98 0.98 1839

classification report for BernoulliNB()


precision recall f1-score support

0 1.00 0.98 0.99 1624


1 0.85 1.00 0.92 215

accuracy 0.98 1839


macro avg 0.93 0.99 0.95 1839
weighted avg 0.98 0.98 0.98 1839

classification report for KNeighborsClassifier()


precision recall f1-score support

0 1.00 0.95 0.97 1670


1 0.65 0.98 0.78 169

accuracy 0.95 1839


macro avg 0.83 0.96 0.88 1839
weighted avg 0.97 0.95 0.95 1839

classification report for DecisionTreeClassifier()


precision recall f1-score support

0 0.97 0.97 0.97 1596


1 0.79 0.82 0.81 243

accuracy 0.95 1839


macro avg 0.88 0.90 0.89 1839
weighted avg 0.95 0.95 0.95 1839

6
0.7.1 BEST PERFORMING MODEL
BernoulliNB is the best performing since it has a better performance in terms of both
recall and F1-score.

You might also like