Scribd
Upload
706 views

Chapter 10: Natural Language Processing: Components of NLP

Natural language processing (NLP) refers to AI techniques that allow computers to understand and interpret human language. NLP involves making computers perform useful tasks with natural languages like English through speech or text. There are two main components: natural language understanding which analyzes language, and natural language generation which produces language. The general steps in NLP are lexical analysis, syntactic analysis, semantic analysis, discourse integration, and pragmatic analysis to interpret language at different levels.

Uploaded by

Manish Shrestha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
706 views

Chapter 10: Natural Language Processing: Components of NLP

Natural language processing (NLP) refers to AI techniques that allow computers to understand and interpret human language. NLP involves making computers perform useful tasks with natural languages like English through speech or text. There are two main components: natural language understanding which analyzes language, and natural language generation which produces language. The general steps in NLP are lexical analysis, syntactic analysis, semantic analysis, discourse integration, and pragmatic analysis to interpret language at different levels.

Uploaded by

Manish Shrestha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

CHAPTER 10: NATURAL LANGUAGE PROCESSING

Natural Language Processing (NLP) refers to AI method of communicating with an


intelligent systems using a natural language such as English.
Processing of Natural Language is required when you want an intelligent system
like robot to perform as per your instructions, when you want to hear decision from
a dialogue based clinical expert system, etc.
The field of NLP involves making computers to perform useful tasks with the
natural languages humans use. The input and output of an NLP system can be −

 Speech
 Written Text
Components of NLP
There are two components of NLP as given −
Natural Language Understanding (NLU)
Understanding involves the following tasks −

 Mapping the given input in natural language into useful representations.


 Analyzing different aspects of the language.
Natural Language Generation (NLG)
It is the process of producing meaningful phrases and sentences in the form of
natural language from some internal representation.
It involves −
 Text planning − It includes retrieving the relevant content from knowledge
base.
 Sentence planning − It includes choosing required words, forming
meaningful phrases, setting tone of the sentence.
 Text Realization − It is mapping sentence plan into sentence structure.
**The NLU is harder than NLG.
Steps in NLP
There are general five steps −
 Lexical Analysis − It involves identifying and analyzing the structure of
words. Lexicon of a language means the collection of words and phrases in
a language. Lexical analysis is dividing the whole chunk of txt into
paragraphs, sentences, and words.
 Syntactic Analysis (Parsing) − It involves analysis of words in the sentence
for grammar and arranging words in a manner that shows the relationship
among the words. The sentence such as “The school goes to boy” is rejected
by English syntactic analyzer.
 Semantic Analysis − It draws the exact meaning or the dictionary meaning
from the text. The text is checked for meaningfulness. It is done by mapping
syntactic structures and objects in the task domain. The semantic analyzer
disregards sentence such as “hot ice-cream”.
 Discourse Integration − The meaning of any sentence depends upon the
meaning of the sentence just before it. In addition, it also brings about the
meaning of immediately succeeding sentence.
 Pragmatic Analysis − During this, what was said is re-interpreted on what it
actually meant. It involves deriving those aspects of language which require
real world knowledge.

You might also like