Project Report on Virtual Assistant

Group Member:

BE19F06F001 - Suraj Bafna

BE19F06F014 - Shreyans Dugad
 Index
Serial No. Topic
1. Introduction.
2. Literature survey.
3. System Development.
4. Use Case Diagram.
5. Test Case.
6. Conclusion.
 Introduction

In today’s era almost all tasks are digitalize. We have Smartphone in hands and it is nothing
less than having world at your finger tips. These days we aren’t even using fingers. We just
speak of the task and it is done. There exist systems where we can say Text Dad, “I’ll be late
today.” And the text is sent. That is the task of a Virtual Assistant.

It also supports specialized task such as booking a flight, or finding cheapest book online
from various e-commerce sites and then providing an interface to book an order are helping
automate search, discovery and online order operations.

Virtual Assistants are software programs that help you ease your day to day tasks, such as
showing weather report, creating reminders, making shopping lists etc. They can take
commands via text (online chat bots) or by voice. Voice based intelligent assistants need an
invoking word or wake word to activate the listener, followed by the command. For my
project the wake word is JIA. We have so many virtual assistants, such as Apple’s Siri,
Amazon’s Alexa and Microsoft’s Cortana. For this project, wake word was chosen JIA. This
system is designed to be used efficiently on desktops. Personal assistant software improves
user productivity by managing routine tasks of the user and by providing information from
online sources to the user. JIA is effortless to use. Call the wake word ‘JIA’ followed by the
command. And within seconds, it gets executed. Voice searches have dominated over text
search. Web searches conducted via mobile devices have only just overtaken those carried
out using a computer and the analysts are already predicting that 50% of searches will be via
voice by 2020.Virtual assistants are turning out to be smarter than ever. Allow your
intelligent assistant to make email work for you. Detect intent, pick out important
information, automate processes, and deliver personalized responses. This project was
started on the premise that there is sufficient amount of openly available data and
information on the web that can be utilized to build a virtual assistant that has access to
making intelligent decisions for routine user activities.
 Literature Survey

A computer primarily based approach for performing a command via a voice consumer
interface on a subset of objects. The subset is selected from a fixed of items, each having an
object type at least one tag gable field is associated with the object type and has a
corresponding value. The set of objects is saved in the laptop memory. An utterance is
acquired from the person and consists of a command, an object type choice,a tag-gable field
selection, and a price for the tag gable discipline. Responsive to the utterance, at least one
item is retrieved from the set of gadgets, the item of the sort selected through the user and
having a price within the tag gable area selection that matches the tag gable field fee
obtained from the user the command is done on the item. The object includes textual
content that’s converted to voice output . They envisioned that someday computers will
recognize natural language and count on what we need, whilst and where we need it, and
proactively whole responsibilities on our behalf. However, speech recognition and machine
getting to know have persevered to be refined, and based records served through packages
and content providers have emerged. We agree with that as computer systems turn out to
be smaller and greater ubiquitous [e.g., wearable’s and Internet of Things (IoT) . The
recognizer is designed to change a verbal articulation from the individual into an alternate
method of data (e.g., text). A hand held individual colleague including a voice-recognizer and
a characteristic dialect processor is disclosed. This snippet of data can be a plan for the day,
data in the individual’s logbook or data from the individual’s address book, Such as a
telephone number .The Most well known utilization of iPhone is “SIRI” which causes the end
client to impart end client versatile with voice and it additionally reacts to the voice charges
of the client. It is named as Personal Assistant with Voice Recognition Intelligence, which
takes the client contribution to type of voice or content and process it and returns the yield
in different structures like activity to be performed or the item is directed to the end client.
Furthermore, this proposed framework can change the method for communications
between end client and the cell phones . Open Data is currently gathering consideration for
imaginative administration creation, predominantly in the zone of government, bio science,
and shrewd venture. Be that as it may, to advance its application more for purchaser
administrations, a web crawler for Open Data to realize what sort of information is there
would be of assistance. This paper presents a voice colleague which utilizes Open Data as its
learning source. It is highlighted by change of precision as per the client criticisms, and
obtaining of unregistered information by the client support. We additionally demonstrate an
application to help for a fieldwork and affirm its viability . The paper gives a diagram of the
VPA applications, and the normal highlights and future patterns. The paper proposes also a
bound together choice model in light of a quantitative appraisal of the significance of the
solicitations and the accessibility of the client. Virtual Personal Assistant (VPA) is the up and
coming age of bearer administrations for portable clients. VPA is accepted to be the smart
advancement of administrations to take care of the regularly expanding demand by the
portable experts for portability and network. The VPA controls the phone calls, deals with
the individual exercises through logbook,192 A. S. Tulshan and S. N. Dhage
empowers the client to get to his undertaking administrator by means of voice inter-faces,
and incorporates every one of the elements of Unifilled Messaging. The Virtual Personal
Assistant (VPA) will empower the client to productively handle expanding interest of phone
calls, messages, gatherings and different exercises .In any case, a great many people don’t
utilize them consistently. Past research has examined the encounters of continuous IPA
clients. Utilizing subjective techniques we investigate the experience of rare clients:
individuals who have attempted IPAs, yet pick not to utilize them consistently. Obviously
occasional clients share a portion of the encounters of successive clients, e.g. dissatisfaction
at confinements on completely sans hands collaboration. Critical purposes of difference and
beforehand unidentified concerns likewise develop. Humanness of IPAs started correlations
with human associates, comparing their restrictions. In particular, critical concerns rose
around security, adaptation, information permanency and straight forwardness. Drawing on
these discoveries we talk about key difficulties, including: outlining for interrupt ability; re-
examination of the human similitude; issues of trust and information proprietor-ship.
Tending to these difficulties may prompt more across the board IPA utilize. As virtual
assistants move toward becoming more intelligent and the IVA bio-logical community of
administrations and gadgets extends, there’s a developing need to comprehend the security
and protection dangers from this rising innovation. A few late occurrences feature
noteworthy vulnerabilities in IVAs. Better demonstrative testing can uncover such
vulnerabilities and prompt more reliable frameworks. It enables the objective clients to
connect with PCs and web based administrations with a wide cluster of usefulness in light of
different web administrations and social media. There are four standard parts of the system;
the voice recognition module, the natural language processing module, conversational agent
and the content extraction module. The current screen per client writing computer
programs are not fitting for getting to Internet in perspective of the base help they give for
web content and the non attendance of voice affirmation. The Virtual Right hand
programming open in the market are not especially given everything and unfit to utilize it
similarly. Some may confront issue now too .This paper presents a usability of four Virtual
assistant voice-based and contextual text (Google assistant, Coratan, Siri, Alexa) [10].
Cortana can likewise read your messages, track your area, watch your perusing history,
check your contact list, watch out for your date-book, and set up this information together
to propose valuable data,on the off chance that you enable it. You can likewise type your
inquiries or solicitation, in the event that you want to not stand up uproarious. It is only
desktop based virtual assistant. Siri: Siri has been an integral part of iOS since the dispatch
of iOS5 of every 2011. It began with the nuts and bolts, for example, climate and
informing,yet has extended significantly from that point forward to help all the more
outsider mix with MacOS. While Siri’s jokes are unbelievable, the virtual aide is getting more
able consistently. Presently, you can request that it call individuals, send messages, plan
gatherings, dispatch applications and recreations, and play music, answer questions, setup
dates, and give climate conjectures. Google Assistant: Google Assistant (which has
consolidated capacities from the more seasoned Google now, as now is being eliminated) is
unique in relation to Cortana and Siri. Survey on Virtual Assistant: Google Assistant, Siri,
Cortana, Alexa 193.
The significantly conversational VA is capable at interpreting essential vernacular
understanding the importance behind unobtrusively complex request like, “What should we
have for dinner?”It can in like manner see up to six unmistakable voices for couples and
families, each voice settling to different logbook events and slants, great position amazing to
Assistant and impeccable in a condition where everyone uses the voice helper on a singular
gadget. Alexa: While sharing different features similarly as various VAs, Alexa is in its own
one of a kind class. Amazon’s voice partner isn’t centred on portable or PC purposes, but
instead for the independent Amazon Echo speaker and a set number of Amazon Fire
gadgets, with a more prominent focus on entire house administration and administrations as
opposed to PC situated errands. Each business visionary, side trickster and multitasking
proficient out there would love to have a virtual assistant right hand to go up against a
portion of the dull every day errands that accompany existing in the advanced time. Similarly
as with any developing innovation, in any case, it can be hard to isolate the build up from the
certainties. There are four noteworthy players seeking consideration: Amazon (Alexa), Apple
(Siri), (Google Assistant) and Microsoft (Cortana).I invested hours testing each of the four
assistants by making inquiries and giving charges that numerous business clients would
utilize [15]. Amid the testing procedure, I noticed the accomplishment of the AI’s reaction to
me, and in addition different components a planned users may think about, for example,
simplicity of setup, general capacity to perceive my voice and relevant comprehension.
About each cell phone and PC available today has a brilliant right hand caught inside, similar
to an accommodating phantom however how might they stack up against each other? While
it may seem like Siri, Cortana, and the mysterious Google Assistant are in general just
assortments of the same virtual partners, they each have their own specific
unconventionality’s, imperfections, and characteristics. So which one’s best for clients? All
things considered, that isn’t a basic request to answer, as they’re like the point that it's hard
to take a gander at them without plunging significant into their capacities. Along these lines,
we should start on this virtual right hand connection.
 System Development

Software Used:

Speech Recognition module:

The system uses Google’s online speech recognition system for converting speech input to
text. The speech input Users can obtain texts from the special corpora organized on the
computer network server at the information centre from the microphone is temporarily
stored in the system which is then sent to Google cloud for speech recognition. The
equivalent text is then received and fed to the central processor.

Python Backend:

The python backend gets the output from the speech recognition module and then identifies
whether the command or the speech output is an API Call and Context Extraction. The
output is then sent back to the python backend to give the required output to the user.

API calls:

API stands for Application Programming Interface. An API is a software intermediary that
allows two applications to talk to each other. In other words, an API is a messenger that
delivers your request to the provider that you’re requesting it from and then delivers the
response back to you.

Content Extraction:

Context extraction (CE) is the task of automatically extracting structured information from
unstructured and/or semi-structured machine-readable documents. In most cases, this
activity concerns processing human language texts using natural language processing (NLP).
Recent activities in multimedia document processing like automatic annotation and content
extraction out of images/audio/video could be seen as context extraction TEST RESULTS.

Text-to-speech module:

Text-to-Speech (TTS) refers to the ability of computers to read text aloud. A TTS Engine
converts written text to a phonemic representation, then converts the phonemic
representation to waveform that can be output as sound. TTS engines with different
languages, dialects and specialized vocabularies are available through third-party publishers.
 USE CASE DIAGRAM

In this project there is only one user. The user queries command to the system. System then
interprets it and fetches answer. The response is sent back to the user.
 Test Case
Test Case 1

Test Title: Response Time

Test ID: T1
Test Priority: High
Test Objective: To make sure that the system respond back time is efficient.
Description: Time is very critical in a voice based system. As we are not typing inputs, we are
speaking them. The system must also reply in a moment. User must get instant response of
the query made.

Test Case 2

Test Title: Accuracy

Test ID: T2
Test Priority: High
Test Objective: To assure that answers retrieved by system are accurate as per gathered
data.
Description: A virtual assistant system is mainly used to get precise answers to any question
asked. Getting answer in a moment is of no use if the answer is not correct. Accuracy is of
utmost importance in a virtual assistant system.

Test Case 3

Test Title: Approximation

Test ID: T3
Test priority: Moderate
Test Objective: To check approximate answers about calculations.
Description: There are times when mathematical calculation requires approximate value. For
example, if someone asks for value of PI the system must respond with approximate value
and not the accurate value. Getting exact value in such cases is undesirable. Note: There
might include a few more test cases and these test cases are also subject to change with the
final software development.
 Conclusion

In this paper “Virtual Assistant” we discussed the design and implementation of Digital
Assistance. The modular nature of this project makes it more flexible and easy to add
additional features without disturbing current system functionalities.

It not only works on human commands but also give responses to the user based on the
query being asked or the words spoken by the user such as opening tasks and operations. It
is greeting the user the way the user feels more comfortable and feels free to interact with
the voice assistant. The application should also eliminate any kind of unnecessary manual
work required in the user life of performing every task. The entire system works on the
verbal input rather than the next one.