Scribd
Upload
21 views

Text Analysis Based On Natural Language Processing NLP

Uploaded by

trisha.vijay
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
21 views

Text Analysis Based On Natural Language Processing NLP

Uploaded by

trisha.vijay
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 10

Text Analysis Based On

Natural Language
Processing (NLP)
In the modern era of information explosion, there is enormous information including
thousands and millions of texts loaded on the Internet of over 1.2 million terabytes.
There are no accurate statistics on the size of texts within this huge amount of data.

Given the multiplicity of websites on the Internet and the spread of social networking
services like Twitter, for example, it is stated that about 6000 tweets are posted per
second in the year 2019. This work aims to analyze these texts through resorting to
artificial intelligence to help solve this problem.

by Trisha Vijayekkumaran
Introduction to Natural Language

Human Communication
The term natural language refers to languages used for human-human interactions, such as Arabic, English, and French. These
languages are called natural because they evolved naturally within societies. For example, English developed over years without
planned rules or words.

Constructed Languages
In contrast, constructed languages are planned, artificial, or invented. Their terms and linguistic characteristics are established
before use. Programming languages like Java and Python are examples. Other constructed languages, like Lojban, aim to
improve human communication by eliminating ambiguity.

Natural Language Processing (NLP)


Natural Language Processing (NLP) is a field that explores interactions between computers and natural languages. It originated
as a branch of artificial intelligence, focusing on understanding and generating natural language. NLP has close ties to
computational linguistics, which focuses on the theoretical aspects of natural language processing.
Related Work in NLP
Sentiment Analysis Parts of Speech Taggers

The sentiment analyzer (Jeonghee et al., 2003) works by As for the part of speech taggers, there are currently a
extracting sentiments about given topic. Sentiment analysis number of programs for European languages, whereas
consists of a topic specific feature term extraction, research is still being conducted on taggers for other
sentiment extraction, and association by relationship languages like Arabic, Sanskrit, and Hindi . They can
analysis. Sentiment Analysis utilizes two linguistic resources efficiently tag and classify words into nouns, adjectives, and
for the analysis: the sentiment lexicon and the sentiment verbs. Most procedures for parts of speech work efficiently
pattern database. It analyses the documents for positive on European languages, but not with Asian or Middle-
and negative words and tries to give ratings on scale -5 to Eastern languages.
+5.
Applications of NLP

Machine Learning Chatbots


NLP techniques are used in machine learning to Chatbots are computer programs that can simulate
develop algorithms that can understand and process conversation with humans. NLP is used to enable
natural language. These algorithms can be used for chatbots to understand and respond to natural
tasks such as text classification, sentiment analysis, language input.
and machine translation.

Search Engines Voice Assistants


Search engines use NLP to understand the meaning of Voice assistants, such as Siri and Alexa, use NLP to
search queries and return relevant results. NLP is also understand spoken language and respond to user
used to improve the ranking of search results. requests.
Information Extraction

Extracting Data from Language Stock Market Applications


Information extraction is the process of extracting data from In the stock market, news about a particular company's
language. This data is then converted into abstract data, shares is relied upon. Information is extracted from the news,
which can be easily stored. This process is used in many the new share price and company name are verified, and
applications, such as stock trading. then the extracted information is stored in a database.
Question Answering
Siri Application
One of the most important applications used and available on the
iOS system is the Siri application. In this application, the questions
are answered in an integrated natural language. In other words, the
answer is formulated in an integrated manner.

Integrated Answer
For example, if the question is (Where is the Children's Hospital?), the
answer will be (The Children's Hospital is on the left side, near the
gas station). This shows how Siri can understand and respond to
natural language questions in a way that is both informative and
helpful.
3) Machine Translation

Language Differences Grammatical Variations


Machine translation aims to translate between languages, for For instance, Arabic has three verb cases (past, present, and
example, from Arabic to English. It is considered one of the imperative), while English has several, including simple past,
most challenging applications in language processing due to past continuous, present simple, and present continuous.
the differences in grammatical and morphological structures This complexity makes translation difficult. The translation
between languages. Some terms may not have direct of a topic by two language experts may differ in wording, but
translations, leading to potential confusion. the content remains the same.
Lexical Ambiguity

Word Meaning Word Sense Disambiguation


This level focuses on the word and its Deconstructing the meaning of words is a
context within the sentence. For example, crucial topic in natural language
the word "beauty" in Arabic has two processing. This is known as Word Sense
meanings: beauty and camels, depending Disambiguation (WSD), which aims to
on the sentence context. The same applies determine the correct meaning of a word
to English, where words like "desk" can based on its context.
have multiple meanings.
V. The Advantages And Disadvantages Of NLP
1 Advantages of NLP 2 Disadvantages of NLP
NLP offers several advantages, including extensive Despite its benefits, NLP also has limitations. One
analysis, objective and accurate results, and cost challenge is the potential loss of context, which can
reduction through simplified operations. NLP also lead to inaccurate interpretations. NLP models can
enhances customer satisfaction by providing also be unpredictable and prone to errors, especially
personalized experiences and insights. Additionally, when dealing with complex language structures.
NLP helps businesses understand both private and Furthermore, NLP models often have limited
public markets, leading to better decision-making. functionality and are designed for specific tasks,
making them less versatile.

3 Development Time
Developing new NLP models requires significant time and effort to achieve high performance. The complexity of
language and the need for large datasets make it challenging to create models that can handle diverse language
variations and nuances.
VI. CONCLUSION
In conclusion, natural language processing (NLP) offers powerful
capabilities for analyzing and understanding text, but also has limitations
that must be considered. While NLP can provide extensive analysis,
objective results, and cost savings, it can also struggle with context loss
and unpredictable errors.

You might also like