AIS421

NLP Applications

Lecture 1: Introduction

Spring 2024

1
Agenda
Course Objectives

Grading Distribution

Introduction to LLMs

Examples of NLP Applications

Topics to be covered

2
 Course Objectives

• Exploring State-of-the-Art NLP Techniques.

• Developing skills in advanced NLP models.
• Exploring different NLP applications.
• Applying Domain-Specific NLP Applications.
• Learning more about evaluation metrics specific to NLP tasks.
• Writing and publishing NLP Scientific Papers.

3
 Grading Distribution

• Final Exam: 30%

• Mid-Term: 20%
Bonus
• Quizzes: 10%
• Shared Task: +5 marks (Awarded to the top 3 teams)
• Lab Work: 10%
• Publishing Paper: +10 marks (IEEE, Scopus)
• Project: 20%
• Paper Drafting: 10%

4
 Introduction to LLMs

• Large Language Models (LLMs) are a class of artificial intelligence models designed to
understand and generate human-like text based on vast amounts of pre-existing data.

• LLMs are characterized by their ability to capture intricate linguistic patterns, nuances,
and semantic relationships embedded within extensive text corpora.

• These models leverage deep learning techniques, particularly transformer architectures,

to process and generate natural language.

5
 Introduction to LLMs

• Scale: LLMs trained on massive datasets capture linguistic patterns and nuances, due to
exposure to billions or trillions of words.

• Complexity: These models are highly complex with millions or billions of parameters,
adjusted during training to minimize prediction errors.

• Pre-training and Fine-tuning: LLMs undergo pre-training on diverse text data to capture
general language knowledge, followed by fine-tuning on specific tasks or domains using
labeled data for improved accuracy.
6
 Introduction to LLMs

• Natural Language Understanding (NLU): Proficient in comprehending human language,

LLMs extract meaning, context, and intent from textual inputs for tasks like sentiment
analysis, named entity recognition, and text classification.

• Natural Language Generation (NLG): LLMs generate human-like text based on input
prompts, producing coherent and contextually relevant responses, summaries, or articles. This
capability finds applications in language translation, text summarization, chatbots, and content
generation.

7
 Introduction to LLMs

 Source: A Survey of Large Language Models https://arxiv.org/abs/2303.18223 8

 Introduction to LLMs

 Source: A Survey of Large Language Models https://arxiv.org/abs/2303.18223 9

 Introduction to LLMs

 Source: Large Language Models: A Survey https://arxiv.org/abs/2402.06196 10

 Introduction to LLMs

 Source: Large Language Models: A Survey https://arxiv.org/abs/2402.06196 11

 Introduction to LLMs

 Source: Large Language Models: A Survey https://arxiv.org/abs/2402.06196 12

 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 13
 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 14
 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 15
 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 16
 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 17
 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/7zFPm/llm-use-cases-and-tasks 18
 Introduction to LLMs

 Source: GPT-4 Technical Report https://arxiv.org/abs/2303.08774 19

 Introduction to LLMs

 Source: GPT-4 Technical Report https://arxiv.org/abs/2303.08774 20

 Introduction to LLMs

 Source: GPT-4 Technical Report https://arxiv.org/abs/2303.08774 21

 Introduction to LLMs

 Source: GPT-4 Technical Report https://arxiv.org/abs/2303.08774 22

 Introduction to LLMs

 Source: https://www.coursera.org/learn/generative-ai-with-llms/lecture/21Nwn/generative-ai-project-lifecycle 23
 Examples of NLP Applications

Information Retrieval and Extraction

• Text summarization
• Named Entity Recognition (NER)
• Information extraction from documents
• Question-Answering systems
• Keyword extraction

24
 Examples of NLP Applications

Sentiment Analysis and Opinion Mining

• Sentiment classification of product reviews
• Social media sentiment analysis
• Opinion mining from customer feedback
• Political sentiment analysis

25
 Examples of NLP Applications

Machine Translation and Language Generation

• Neural Machine Translation (NMT)
• Text-to-speech synthesis
• Language generation for chatbots
• Multilingual document translation

26
 Examples of NLP Applications

Text Classification and Categorization

• Spam email detection
• Topic classification of news articles
• Intent detection in chatbots
• Document classification in legal or medical domains

27
 Examples of NLP Applications

Education and E-Learning Applications

• Short answer grading
• Automated essay scoring
• Questions generation
• Plagiarism detection
• Adaptive learning platforms using NLP-based assessment

28
 Examples of NLP Applications

Legal Applications
• Legal document analysis for contract management
• Classification and clustering of legal cases
• Predictive justice
• Legal case summarization and analysis

29
 Examples of NLP Applications

Financial and Business NLP

• Sentiment analysis for stock market prediction
• Financial news event detection
• Business intelligence through NLP-driven analytics

30
 Examples of NLP Applications

Healthcare Management and Patient Support

• Patient record analysis for disease prediction
• Automated medical diagnosis from patient symptoms
• Personalized healthcare recommendations based on patient history

31
 Examples of NLP Applications

Academic Research and Scientific Discovery

• Scientific paper summarization and recommendation
• Literature review automation for researchers
• Automated hypothesis generation and testing

32
 Topics to be Covered

• Reviewing Important NLP concepts (1 Lecture)

• LLMs (3 Lectures)
– Prompt Engineering
– Finetuning
– Vector Databases and RAG Model

• NLP Applications and Case Studies (5 lectures)

• Project requirements, Shared task, Paper drafting (1 lecture)

33
AIS421

NLP Applications

Lecture 1: Introduction

Spring 2024

34