Volume 8, Issue 11, November – 2023 International Journal of Innovative Science and Research Technology

ISSN No:-2456-2165

Jarvis: Virtual Voice Command Desktop Assistant

Uttam Adha Shayna Singh Chanchal
Student Student Student
Chandigarh University Chandigarh University Chandigarh University
Chandigarh, India Chandigarh, India Chandigarh, India

Ishika Tinna Ashish Kumar

Student Er., Associate Professor
Chandigarh University Chandigarh University
Chandigarh, India Chandigarh, India

Abstract:- Earlier As everyone is aware, technology and  Launch any application or tool.
artificial intelligence play a huge role in daily life. AI-
driven voice assistants have merged with technology to These are only a few examples; we will complete a great
become a necessary component of our everyday life. With deal more work in compliance with our specifications.
a personal virtual assistant namely JARVIS, a user can
ask questions and issue commands in the same way they We have developed a Voice Assistant that works with
would with a human. Some simple actions can even be Linux and Windows. Our voice assistant is a computer-based
performed with a voice command, such as opening device that uses Python libraries and modules. Although this
programmers, playing music, searching Wikipedia assistant is merely a basic model capable of performing all of
without opening a browser, and opening apps. To the previously mentioned basic tasks, modern generation,
improve its usability and functionality, the assistant while true in for better results, it still needs to be combined in
integrates technologies including speech recognition. some ways with gadget expertise and the internet of things
(IoT). The version was created using Python modules and
Keywords:- Voice Assistant, Voice recognition, Python libraries, and it was taught using device learning.
Library, Jarvis AI, Chatbot.
A. Project Objective
I. INTRODUCTION The project aims to develop and deploy a voice-activated
computer virtual assistant to boost user productivity and
In the present moment, machines are transforming engagement. By smoothly incorporating voice commands into
everything that a human being can do. The performance laptop operations, the aim is to provide a hands-free, intuitive
exchange is one of the main reasons. The idea of a digital experience that enables users to carry out tasks, obtain
assistant consequently surfaced. An AI assistant can identify information, and control their computers far more efficiently
specific orders from a user and utilise that information to and effortlessly.
remove background noise and provide relevant information.
Despite being entirely computer-based, AI-powered assistants B. Identification of problem
have recently been incorporated into a wide range of gadgets. The primary problem here is that there aren't many
voice-activated virtual assistants made just for PCs. As
Some, like Alexa, were developed especially for stand- technology develops, the traditional laptop has transformed
alone devices. Given how quickly times are changing, it is into a center for work, communication, and information
more crucial than ever to teach our machines via deep access. Meanwhile, users find it difficult to efficiently handle
learning, machine learning, and neural networks. Voice a range of tasks while utilizing their laptop's capabilities. It is
Assistant has made it possible for us to converse with our now feasible to identify a key issue: there are currently no
machines. These days, voice assistants are used by all major voice controlled virtual assistants that can seamlessly
corporations to enable voice interaction between their clients integrate into the laptop environment and expedite user
and their gadgets. We're therefore moving on to the next stage interactions.
of development with the Voice Assistant, enabling us to have
conversations with our device. C. Project Scope
A Jarvis virtual desktop assistant project can cover a
These are some of the most crucial jobs that a voice wide range of functionality, making it an effective and
assistant may aid you with: adaptable instrument. The following is a list of possible
 Reading the newspaper; features for a virtual desktop assistant that looks like Jarvis:
 Getting emails with updates  NLP, or natural language processing, and voice
 Perform an online search; recognition: Use leading-edge voice recognition software
 Watch or listen to a video. to decipher spoken instructions.[5]
 Putting a reminder and an alarm on

IJISRT23NOV1778 www.ijisrt.com 1675

Volume 8, Issue 11, November – 2023 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
It can be used to understand and reply to natural popular software, email clients, project management tools,
language inquiries. collaboration software, cloud storage services, and more.
This makes it simpler for people to handle their digital
 Automata monotonous tasks including file management, tasks and activities.
system tasks, volume settings change, and system  Text and Voice Interaction: To make things easier for
endeavors.[2] users, allow text- and voice-based interactions. Provide a
strong natural language processing system so that users
II. LITRATURE REVIEW can easily interact with the virtual assistant by texting or
speaking with it. This method makes sure that users can
It looks at how virtual assistants have changed over communicate with Jarvis in a way that best meets their
time, covering everything from the advent of voice needs at any given time by acknowledging the variety of
recognition technology to the difficulties presented by user preferences and the various contexts in which the
linguistic diversity and accents. Security lapses and data virtual assistant may be utilized.
collection are two other privacy issues that are covered, along
with some noteworthy cases.[2] III. DESIGN FLOW/PROCESS

The necessity of tackling these past issues is A. Selection of Specification/Features

emphasized in the section's conclusion in order to develop  Essential Features: Features that are necessary for the
future virtual assistants and incorporate them into our daily virtual desktop assistant's basic operation.
lives.
 Desirable Features: Not absolutely necessary
improvements that would significantly improve the user
A. Existing Solutions
experience
The foundation for more sophisticated systems such as
the Assistant from Google, Alexa, made by Amazon, and Siri  Optional Features: Extra features that could be included if
by Apple was established by early virtual assistants like time and funding allow.
Clippy and Microsoft's Office Assistant. the techniques and  User Interface (UI): Creates an intuitive graphical user
inventions used to get around the difficulties virtual assistants interface.
face. It addresses the following crucial topics:  Security: To safeguard sensitive data, strong security
• Voice Recognition Technological Advancements: This measures are put in place.
article explores how these developments have led to a notable  Voice Recognition: Voice commands can be used by
increase in virtual assistant accuracy. The ability to handle users to communicate with the system.
various dialects and accents posed a significant challenge for
voice recognition technology. Early virtual assistants had  Task Automation: Boost productivity by automating
trouble understanding a wide range of language variations. tedious tasks.
Yet, Methods such as deep learning models, and more  Natural Language Processing: Facilitates comprehension
especially the use of RNNs and convolutional neural network and replying to natural language inquiries by the system
models (CNNs), have shown remarkable success in handling
accents and dialects. [2][3]

• Natural Language Understanding: Examines how NLP

models have evolved and how they can help virtual assistants
comprehend context, intent, and user sentiment more fully.
Sentiment analysis, context-aware algorithms, and neural
network-based techniques are all examined in this.[5]

B. Goals/Objective
To advance the virtual assistant industry, it is imperative
to establish well-defined goals and objectives. The main aims
and objectives are described in this section. They could
consist of:
 Increased Productivity: Help users be more productive by
helping with scheduling and document management tasks.
Jarvis can be spoken to to find particular files, folders, or
documents on a user's computer or cloud storage account,
and research. Provide functionalities that streamline the
user's workflow by enabling the virtual assistant to
effectively handle calendars, reminders, and document
organizations.
 Seamless Integration: Make the virtual assistant's Fig 1 Use Case Diagram
compatibility with desktop programs and services even
better. Jarvis improves user experience by integrating with

IJISRT23NOV1778 www.ijisrt.com 1676

Volume 8, Issue 11, November – 2023 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
IV. IMPLEMENTATION PLAN/ METHODOLOGY D. Calls to Systems
When computer software requests a service from the
The following is the implementation plan for our operating system's kernel while it is running, this is known as
product-selling online auction website: a system call. Examples of this opening files folder or any
file from any location, opening applications like notepad or
 Define requirements: Considering the virtual desktop word in which we can write or delete the text, and getting
assistant’s functionality, design, and performance, specify information about system or battery percentage. System calls
what is required. serve as the conduit between a task and the computer’s
operating system.
 Select technology stack: Decide which programming
language, application, and additional system are needed E. Text to speech
for the technology stack of the application. Machines that possess TTS (text-to-speech) capability
can read content loudly. Written text is converted into
 Develop GUI: Use PyQT5 designer to create the GUI for alphabetical transcription, which is then converted into waves
the application. that can be produced as sound by a TTS Engine. [4]

 Develop Application: The Jarvis application will be made V. RESULT

in Python.
Natural language processing, or NLP, is a technique
 Test Application: Verify that the application has utilized by speech recognition software to break down
undergone extensive testing to ascertain its dependability, content into comprehensible chunks, transform them into
security, and user-friendliness. computer-readable forms, and then analyze the individual
components. The software then makes decisions based on
 Launch Application: After the application has been speech patterns and programming. After figuring out what
launched, users can access it freely. Make sure you have a the users said, it turns the conversation into text, which is
plan in place for handling any issues that may arise then saved in a variable. Because our voice assistance is text-
during launch. dependent, the command is sent in the form of a text, which
looks up similar text written as functions. If the text matches,
You can create a reliable and useful Jarvis virtual the function is performed; if not, an exception is addressed.
desktop application that satisfies user needs by adhering to
this implementation plan. A. GUI Design:

A. Understanding of Communication
The system uses python library for speech recognition
system to convert speech to text. The verbal expression
Using the microphone, user can provide tasks from the
distance to the computer. The microphone then send task to
cross check from queries to perform tasks in computer.[4]

B. Python Programming
The Python language takes the output from the voice
recognition python module to determine if the speech or
command output is an API call, a system call, or a context
extraction. The output is then sent back to the Python code to
provide the user with the desired results. Context extraction,
or CE, is the process of removing structured data from
materials that can be read by machines.
Fig 2 Home Page
C.Context Extraction
Including this context extraction for obtaining proper This is the front-end portion of the project's GUI, which
data from materials that are accessible to machines is called consists of some background GIFs, Run and Stop button and
context extraction, or CE. are either partially or fully one output box using PyQt5. In this context, A complete set
structured. This activity usually requires analyzing texts of Python bindings for Qt v5 is called PyQt5. It can be used
utilizing natural language processing in human language as an alternative application development language to Python
(NLP). TEST RESULTS for context extraction are revealed and is implemented as more than 35 extension modules.
by recent efforts in the processing documents in multimedia,
such as automatic annotation and content extraction from
images, audio, and video.

IJISRT23NOV1778 www.ijisrt.com 1677

Volume 8, Issue 11, November – 2023 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
VI. CONCLUSION AND FUTURE WORK

In this paper, we covered the use of Python for Jarvis's

voice commands for Windows. Jarvis's conversation aid has
made life easier for humans. For this project, we're using
computational intelligence technology, so Jarvis voice
assistance works with all Windows versions. Jarvis's
speaking assistance can do all the duties of other assistance,
including some special ones, just like the search engine,
screenshots, application open, typing, windows switch,
locking, sleeping, and shutting down devices with our voice
input. We know that Jarvis' vocal help will last forever.

Future work will entail creating a feature that facilitates

making payments when purchasing online and ensuring that
Fig 3 Home Page [Command and Response] voice assistance functions on all Python versions running on
Linux and Windows similar.

ACKNOWLEDGEMENT

We want to sincerely thank our supervisor, Er. Ashish

Kumar, an associate professor at Chandigarh University in
India, for all of her hard work and dedication in seeing this
project through to completion. We sincerely appreciate all of
your advice and help as we completed the project.

REFERENCES

[1]. R. Sangpal, T. Gawand, S. Vaykar and N. Madhavi,

"JARVIS: An interpretation of AIML with integration
of gTTS and Python," 2019 2nd International
Conference on Intelligent Computing, Instrumentation
Fig 4 Home Page [Response] and Control Technologies (ICICICT), Kannur, India,
2019, pp. 486-489, doi:
B. Code Implementation 10.1109/ICICICT46008.2019.8993344.
[2]. P. Dalal, T. Sharma, Y. Garg, P. Gambhir and Y.
Khandelwal, "“JARVIS” - AI Voice Assistant," 2023
1st International Conference on Innovations in High
Speed Communication and Signal Processing (IHCSP),
BHOPAL, India, 2023, pp. 273-280, doi:
10.1109/IHCSP56702.2023.10127134.
[3]. Yang, D., Zhou, M., and Huang, J., January 2007.
Knowledge Extraction from Online Discussion Forums
for Chatbots. IJCAI, Volume 7, pages 423–428.
[4]. M. Gupta, R. Kumar and H. Sardalia, "Voice Assistant
Technology: The Case of Jarvis AI," 2023 4th
International Conference for Emerging Technology
(INCET), Belgaum, India, 2023, pp. 1-5, doi:
10.1109/INCET57972.2023.10170362.
[5]. L.K. Fryer and R. Carpenter. (2006). Bots as tools for
Fig 5 Code using Python language. learning languages. Tech and Language Learning.

IJISRT23NOV1778 www.ijisrt.com 1678