Scribd
Upload
9 views42 pages

Introduction To NLP

Uploaded by

sania.shaikh9202
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
9 views42 pages

Introduction To NLP

Uploaded by

sania.shaikh9202
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 42

Prof.

Sachin Narkhede
Knowledge in Language Processing

Knowledge used in NLP includes:


Linguistic Knowledge: Rules and structures of
language.
World Knowledge: Information about the
world to understand context.
Statistical Knowledge: Probabilistic models
derived from large datasets.
Ambiguity in Natural Language

Ambiguity is a significant challenge in NLP, arising at various levels:


Lexical Ambiguity: Words with multiple meanings.
Syntactic Ambiguity: Sentences with multiple valid structures.
Semantic Ambiguity: Sentences with multiple interpretations.
Pragmatic Ambiguity: Context-dependent meanings.
1. Lexical Ambiguity

Lexical means relating to words of a language. During Lexical


analysis given paragraphs are broken down into words or tokens.
Each token has got specific meaning. There can be instances
where a single word can be interpreted in multiple ways. The
ambiguity that is caused by the word alone rather than the context
is known as Lexical Ambiguity.

Example: “Give me the bat!”

In the above sentence, it is unclear whether bat refers to a


nocturnal animal bat or a cricket bat. Just by looking at the word it
does not provide enough information about the meaning hence
we need to know the context in which it is used.
2. Syntactic Ambiguity/ Structural ambiguity

Syntactic meaning refers to the grammatical structure and rules


that define how words should be combined to form sentences and
phrases. A sentence can be interpreted in more than one way due
to its structure or syntax such ambiguity is referred to as Syntactic
Ambiguity.

Example 1: “Old men and women”


The above sentence can have two possible meanings:
All old men and young women.
All old men and old women.

Example 2: “John saw the boy with telescope. “


In the above case, two possible meanings are
John saw the boy through his telescope.
John saw the boy who was holding the telescope.
3. Semantic Ambiguity

Semantics is nothing but “Meaning”. The semantics of a word or


phrase refers to the way it is typically understood or interpreted by
people. Syntax describes the rules by which words can be
combined into sentences, while semantics describes what they
mean.
Semantic Ambiguity occurs when a sentence has more than one
interpretation or meaning.

Example 1: “Seema loves her mother and Sriya does too.”


The interpretations can be Sriya loves Seema’s mother or Sriya
likes her mother.
5. Pragmatic ambiguity

Pragmatics focuses on the real-time usage of language like what the speaker
wants to convey and how the listener infers it. Situational context, the
individuals’ mental states, the preceding dialogue, and other elements play a
major role in understanding what the speaker is trying to say and how the
listeners perceive it.
Challenges of NLP

Complexity of Human Language: Nuances, idioms, and


irregularities.

Ambiguity and Context: Understanding intended meanings.

Resource Limitations: Availability of annotated data.

Multilinguality: Handling multiple languages and dialects.

Dynamic Nature of Language: Evolving vocabulary and usage.


Applications of NLP

Machine Translation: Translating text between languages.

Speech Recognition: Converting speech to text.

Chatbots and Virtual Assistants: Automating customer service.

Sentiment Analysis: Understanding opinions in text.

Text Summarization: Creating concise summaries of documents.

Information Extraction: Retrieving specific data from text.

Question Answering: Responding to user queries with accurate answers.

You might also like