Scribd
Upload
20 views5 pages

SMA4

The document outlines an experiment on Exploratory Data Analysis (EDA) and visualization of social media data, specifically using Twitter data. It discusses the use of the TextBlob library for sentiment analysis and the creation of Word Clouds for visual representation of data. The conclusion emphasizes the importance of EDA in cleaning and making data meaningful.

Uploaded by

mgade3012
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
20 views5 pages

SMA4

The document outlines an experiment on Exploratory Data Analysis (EDA) and visualization of social media data, specifically using Twitter data. It discusses the use of the TextBlob library for sentiment analysis and the creation of Word Clouds for visual representation of data. The conclusion emphasizes the importance of EDA in cleaning and making data meaningful.

Uploaded by

mgade3012
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 5

DEPARTMENT OF ARTIFICIAL INTELLIGENCE

& DATA SCIENCE

Subject: Social Media Analytics Course Code: CSDOL8023


Semester: VIII Course: AI & DS
Laboratory No: 302 Name of Subject Teacher: Prof. Gitanjali Korgaonkar
Name of Student: Meghana Gade Roll Id: VU2S2223002

Experiment no: 4
Aim: Exploratory Data Analysis and visualization of Social Media Data for business.

Theory:

Exploratory data analysis (EDA) is used by data scientists to analyze and investigate data sets and summarize their main
characteristics, often employing data visualization methods. It helps determine how best to manipulate data sources to get
the answers you need, making it easier for data scientists to discover patterns, spot anomalies, test a hypothesis, or check
assumptions.

TextBlob is a Python (2 and 3) library for processing textual data. It provides a simple API for diving into common
natural language processing (NLP) tasks such as part-of-speech tagging, noun phrase extraction, sentiment analysis,
classification, translation, and more.

Word Clouds came out to be a game-changer visualization technique for understanding and determining patterns and
evolving trends. Whether to discover the political agendas of aspiring election candidates of a country or to analyze the
customer reviews on the recently launched product, one can get a visual representation by plotting the Word Cloud.

1. Twitter Data Cleaning, Preprocessing and Exploratory Data Analysis:

df1=df1.drop_duplicates("renderedContent") df1.shape
df1.head df1.date.value_counts()
#Heat Map for missing Values plt.figure(figsize=(17, 5))
sns.heatmap(df1.isnull(), cbar=True, yticklabels=False) plt.xlabel("Column_Name", size=14, weight="bold")
plt.title("Places of missing values in column",size=17) plt.show()

import plotly.graph_objects as go
Top_Location_Of_tweet= df1['place'].value_counts().head (10) print(Top_Location_Of_tweet)

def get_subjectivity(text):
return TextBlob(text).sentiment.subjectivity def get_polarity(text):
return TextBlob(text).sentiment.polarity

df1['subjectivity']=df1[ 'renderedContent'].apply(get_subjectivity)
df1[ 'polarity' ]=df1[ 'renderedContent'].apply(get_polarity) df1.head()

2. Sentiment Analysis

df1['textblob_score'] =df1[ 'renderedContent'].apply(lambda x: TextBlob(x).sentiment.polarity) neutral_threshold=0.05


df1['textblob_sentiment']=df1[ 'textblob_score'].apply(lambda c:'positive' if c >= neutral_threshold
else ('Negative' if c <= -(neutral_threshold) else 'Neutral' ) )

textblob_df = df1[['renderedContent','textblob_sentiment','likeCount']] textblob_df


textblob_df["textblob_sentiment"].value_counts() textblob_df["textblob_sentiment"].value_counts().plot.barh(title,
Analysis',color='orange' , width=.4, figsize=(12,8),stacked = True) = 'Sentiment

df_positive=textblob_df[textblob_df['textblob_sentiment']=='positive' ]
df_very_positive=df_positive[df_positive['likeCount']>0] df_very_positive.head()
df_negative=textblob_df[textblob_df['textblob_sentiment']=='Negative' ] df_negative
df_neutral=textblob_df[textblob_df['textblob_sentiment']=='Neutral' ] df_neutral

3. Visualization by creating a Word Cloud

from wordcloud import WordCloud, STOPWORDS from PIL import Image


#Creating the text variable
positive_tw="".join(t for t in df_very_positive.renderedContent)
#Creating word_cloud with text as argument in .generate() rtpthod
word_cloud1=WordCloud (collocations=False, background_color='white'). generate (positive_tw)
# Display the generated Word Cloud plt.imshow(word_cloud1,interpolation='bilinear) plt.axis('off')
plt.show()

#Creating the text variable


negative_tw="".join (t for t in df_negative.rendered Content) #Creating word_cloud with text as argument in.generate()
rtpthod
word_cloud2=WordCloud(collocations=False,background_color='white').generate(negative_tw) # Display the generated
Word Cloud
plt.imshow(word_cloud2,interpolation='bilinear') plt.axis('off')
plt.show()

#Creating the text variable


neutral_tw="".join(tfor tindf_neutral.renderedContent)
#Creating word_cloud with text as argument in. generate() rtpthod
word_cloud2=WordCloud(collocations=False,background_color='white').generate(neutral_tw) # Display the generated Word Cloud
plt.imshow(word_cloud2,interpolation='bilinear') plt.axis('off')
plt.show()
Conclusion:

Exploratory data analysis helps to get data which is cleaned and meaningful. Twitter data is explored using textblob
package and visualization by using wordcloud package of python.

R1 R2 R3
DOP DOS Conduction File Record Viva Voice Total Signature
5 Marks 5 Marks 5 Marks 15 Marks
R1 R2 R3
DOP DOS Conduction File Record Viva Voice Total Signature
5 Marks 5 Marks 5 Marks 15 Marks

You might also like