NLP

INTRODUCTION
• Natural Language Processing, or NLP, is the sub-
field of AI that is focused on enabling computers
to understand and process human languages.
• But how do computers do that?
• How do they understand what we say in our
language?
Applications of Natural Language Processing
1) Automatic Summarization:
• Information overload is a real problem when we need to access a
specific, important piece of information from a huge knowledge base.
• Automatic summarization is relevant not only for summarizing the
meaning of documents and information, but also to understand the
emotional meanings within the information, such as in collecting data
from social media.
 Applications of Natural Language Processing
2) Sentiment Analysis:
• The goal of sentiment analysis is to identify sentiment among several posts
or even in the same post where emotion is not always explicitly expressed.
• Companies use Natural Language Processing applications, such as sentiment
analysis, to identify opinions and sentiment online to help them understand
what customers think about their products and services.
• (i.e., “I love the new iPhone” and, a few lines later “But sometimes it doesn’t
work well” where the person is still talking about the iPhone).
• Sentiment analysis understands sentiment in context to help better
understand what’s behind an expressed opinion, which can be extremely
relevant in understanding and driving purchasing decisions.
Applications of Natural Language Processing
3) Text classification:
• Text classification makes it possible to assign predefined categories to
a document and organize it to help you find the information you need
or simplify some activities.
• For example, an application of text categorization is spam filtering in
email.
Applications of Natural Language Processing
4) Virtual Assistants:
• Nowadays Google Assistant, Cortana, Siri, Alexa, etc have become an
integral part of our lives. Not only can we talk to them but they also
have the abilities to make our lives easier.
• By accessing our data, they can help us in keeping notes of our tasks,
make calls for us, send messages and a lot more.
• With the help of speech recognition, these assistants can not only
detect our speech but can also make sense out of it.
Natural Language Processing: Getting Started
Revisiting the AI Project Cycle
• Let us try to understand how we can develop a project in Natural Language
processing with the help of an example.
The Scenario
The world is competitive nowadays. People face competition in even the tiniest
tasks and are expected to give their best at every point in time. When people are
unable to meet these expectations, they get stressed and could even go into
depression. We get to hear a lot of cases where people are depressed due to
reasons like peer pressure, studies, family issues, relationships, etc. and they
eventually get into something that is bad for them as well as for others. So, to
overcome this, cognitive behavioral therapy (CBT) is considered to be one of the
best methods to address stress as it is easy to implement on people and also gives
good results. This therapy includes understanding the behavior and mindset of a
person in their normal life. With the help of CBT, therapists help people overcome
their stress and live a happy life.
Cognitive Behavioural Therapy
1. Problem Scoping
• CBT is a technique used by most therapists to cure patients out of
stress and depression. But it has been observed that people do not
wish to seek the help of a psychiatrist willingly. They try to avoid such
interactions as much as possible. Thus, there is a need to bridge the
gap between a person who needs help and the psychiatrist. Let us
look at various factors around this problem through the 4Ws problem
canvas.
2. Data Acquisition
• To understand the sentiments of people, we need to collect
their conversational data so the machine can interpret the
words that they use and understand their meaning.
• Such data can be collected from various means:
1. Surveys
2. Observing the therapist’s sessions
3. Databases available on the internet
4. Interviews, etc.
 3. Data Exploration
• Once the textual data has been collected, it needs
to be processed and cleaned so that an easier
version can be sent to the machine.
• The text is normalized through various steps and is
lowered to minimum vocabulary.
• Machine does not require grammatically correct
statements but the essence of it.
4. Modelling

• Once the text has been normalized, it is then fed to an

NLP based AI model.

• Depending upon the type of chatbot we try to make,

there are a lot of AI models available.
5. Evaluation
• The model trained is then evaluated and the accuracy for
the same is generated on the basis of the relevance of
the answers which the machine gives to the user’s
responses.

• To understand the efficiency of the model, the suggested

answers by the chatbot are compared to the actual
answers.
Chatbots
• One of the most common applications of Natural Language Processing is a
chatbot.
• Let us try some of the chatbots and see how they work.
• • Mitsuku Bot*
• https://www.pandorabots.com/mitsuku/
•
• • CleverBot*
• https://www.cleverbot.com/
•

• • Jabberwacky*
• • Jabberwacky* http://www.jabberwacky.com/
•
• • Haptik*
• https://haptik.ai/contact-us
 • Rose*
http://ec2-54-215-197-164.us-west-1.compute.amazonaws.com/speech.php

• Ochatbot*
https://www.ometrics.com/blog/list-of-fun-chatbots/

Let us discuss!
• Which chatbot did you try? Name any one.
• What is the purpose of this chatbot?
• How was the interaction with the chatbot?
• Did the chat feel like talking to a human or a robot? Why do you think so?
• Do you feel that the chatbot has a certain personality?
Conclusion
• As you interact with more and more chatbots, you would
realize that some of them are scripted or in other words are
traditional chatbots while others were AI-powered and had
more knowledge.
• There are 2 types of chatbots around us:
1) Script-bot
2) Smart-bot.
Let us understand what each of them mean in detail:
• Examples of script bot may include the bots which are deployed in
the customer care section of various companies. Their job is to
answer some basic queries that they are coded for and connect them
to human executives once they are unable to handle the
conversation.

• All the assistants like Google Assistant, Alexa, Cortana, Siri, etc. can be
taken as smart bots as not only can they handle the conversations but
can also manage to do other tasks which makes them smarter.