Module-1
1.Explain the Challenges in NLP?
2.Explain various state of NLP?
3.Explain the generic NLP system and the ambiguities of NLP?
Module 2
Explain regular expressions in NLP?
What is a language model write a short note on N Gram Language Model?
Language model
A language model in natural language processing (NLP) is a statistical model
that predicts the probability of a word sequence in a sentence based on the
previous words. Language models are a fundamental component of NLP
because they allow machines to understand, generate, and analyze human
language.
1. Define with example.1.Tokenization 2.Stemming 3.Lemmatization
Lemmatization
1. Explain how N-gram model is used in spelling correction?
Module 3
.What is POS Tagging? Discuss Various Challenges to perform POS tagging.
challenges of POS tagging
Ambiguity: Words can have multiple meanings (e.g., "book" as a noun or verb), making it
hard to decide on the correct tag.
Context Sensitivity: The meaning of a word often depends on its surrounding words,
which affects its tag.
New Words: Unknown or rare words (out-of-vocabulary) can be difficult to tag correctly.
Complex Sentences: Sentences with unusual or complicated structures can confuse
taggers.
Different Domains: Models trained on one type of text (like news) might struggle with
another (like social media).
Multilingual Issues: Different languages have unique grammar rules, making cross-
language tagging difficult.
Noisy Data: Spelling errors, slang, or informal writing can lead to incorrect tags.
2.What is Parsing? Explain Top-down & Bottom-up approach of parsing with suitable
examples.
Bottom parsing
example
Discuss Various Approaches to perform POS tagging.