JIS College of Engineering
Department of Computer Science and Engineering
____________________________________________________
PROJECT ON: Virtual Assistant Using Python
(Project Submitted in partial fulfilment of the requirements for the Degree of Bachelor of Technology in the field
of Computer Science and Engineering.)
Title of the Project Virtual Assistant Using Python
Academic Year 2018 – 2022
Semester / Year 7th Semester / 4rd Year
Name of the Students ANKIT BHARTI Roll No 123190703202
ARITRA DEY 123190703207
SOMNATH MAITY 123190703218
TANMOY KUMAR PAUL 123180703109
TANMOY NATH 123180703110
Name of the Supervisor Dr. Bikramjit Sarkar
JIS College of Engineering
Dept. of Computer Science and Engineering
Index
1. Certificate
2. Acknowledgement
3. Abstract
4. Introduction
5. Objective
6. Methodology of Virtual Assistant Using Python
7. Source Code
8. Future Scope
9. References
CERTIFICATE
This is to certify that Aritra Dey (123190703207), Tanmoy Nath (123180703110),
Somnath Maity(123190703218),Tanmoy Kumar Paul(123180703109),Ankit Bharati
(123190703202) has completed his/her/their project entitled Android Based Secure
Messenger System under the guidance of Dr. Bikramjit Sarkar in partial fulfilment of the
requirements for the award of the Bachelor of Technology in Computer Science and
Engineering from JIS college of Engineering (An Autonomous Institute) is an authentic
record of their own work carried out during the academic year 2021-22 and to the best of our
knowledge, this work has not been submitted elsewhere as part of the process of obtaining a
degree, diploma, fellowship or any other similar title.
________________________
Signature of the Supervisor
JIS College of Engineering
Dept. of Computer Science and Engineering
ACKNOWLEDGEMENT
The analysis of the project work wishes to express our gratitude to Dr. Bikramjit Sarkar
for allowing the degree attitude and providing effective guidance in development of this
project work. Her conscription of the topic and all the helpful hints, she provided,
contributed greatly to successful development of this work, without being pedagogic and
overbearing influence.
We also express our sincere gratitude to Dr. Dharmpal Singh, Head of the Department of
Computer Science and Engineering of JIS College of Engineering and all the respected
faculty members of Department of CSE for giving the scope of successfully carrying out the
project work.
Date: 28.05.2020
Aritra Dey
B. TECH in Computer Science and Engineering
3rd Year/ 5th Semester
University Roll no.-- 123190703207
….…………………………………………………………
Tanmoy Nath
B.TECH in Computer Science and Engineering
3rd Year/ 5th Semester
University Roll no.-- 123180703110
………………….………………………………….
Somnath Maity
B.TECH in Computer Science and Engineering
3rd Year/ 5th Semester
University Roll no.-- 123190703218
…………………………………….……………………
Tanmoy Kumar Paul
B.TECH in Computer Science and Engineering
3rd Year/ 5th Semester
University Roll no.-- 123180703109
……………………….………………………………….
Ankit Bharati
B.TECH in Computer Science and Engineering
3rd Year/ 5th Semester
University Roll no.-- 123190703202
….…………………………………………………………
ABSTRACT
In this modern era, day to day life became smarter and interlinked with technology. We already
know some voice assistance like google, Siri. etc. Now in our voice assistance system, it can act
as a basic medical prescriber, daily schedule reminder, note writer, calculator and a search tool.
This project works on voice input and give output through voice and displays the text on the
screen. The main agenda of our voice assistance makes people smart and give instant and
computed results. The voice assistance takes the voice input through our microphone (Bluetooth
and wired microphone) and it converts our voice into computer understandable language gives the
required solutions and answers which are asked by the user. This assistance connects with the
world wide web to provide results that the user has questioned. Natural Language Processing
algorithm helps computer machines to engage in communication using natural human language
in many forms.
INTRODUCTION
Today the development of artificial intelligence (AI) systems that can organize a natural human-
machine interaction (through voice, communication, gestures, facial expressions, etc.) are gaining
in popularity. One of the most studied and popular was the direction of interaction, based on the
understanding of the machine by the machine of the natural human language. It is no longer a
human who learns to communicate with a machine, but a machine learns to communicate with a
human, exploring his actions, habits, behaviour and trying to become his personalized assistant.
Virtual assistants are software programs that help you ease your day to day tasks, such as
showing weather reports, creating remainders, making shopping lists etc. They can take
commands via text (online chatbots) or by voice. Voice-based intelligent assistants need an
invoking word or wake word to activate the listener, followed by the command. We have so many
virtual assistants, such as Apple’s Siri, Amazon’s Alexa and Microsoft’s Cortana.
This system is designed to be used efficiently on desktops. Personal assistants software
improves user productivity by managing routine tasks of the user and by providing information
from an online source to the user.
This project was started on the premise that there is a sufficient amount of openly available data
and information on the web that can be utilized to build a virtual assistant that has access to
making intelligent decisions for routine user activities.
OBJECTIVE (proposed work)
The work started with analysing the audio commands given by the user through the microphone.
This can be anything like getting any information, operating a computer’s internal files, etc. This is
an empirical qualitative study, based on reading above mentioned literature and testing their
examples. Tests are made by programming according to books and online resources, with the
explicit goal to find best practices and a more advanced understanding of Voice Assistant.
Workflow
The above figure shows the workflow of the basic process of the voice assistant. Speech
recognition is used to convert the speech input to text. This text is then fed to the central
processor which determines the nature of the command and calls the relevant script for
execution.
But the complexities don’t stop there. Even with hundreds of hours of input, other factors can play
a huge role in whether or not the software can understand you. Background noise can easily throw
a speech recognition device off track. This is because it does not inherently have the ability to
distinguish the ambient sounds it “hears” of a dog barking or a helicopter flying overhead, from
your voice. Engineers have to program that ability into the device; they conduct data collection of
these ambient sounds and “tell” the device to filter them out. Another factor is the way humans
naturally shift the pitch of their voice to accommodate for noisy environments; speech recognition
systems can be sensitive to these pitch changes.
Methodology of Virtual Assistant Using Python
Detailed Workflow
Speech Recognition module:
The system uses Google’s online speech recognition system for converting speech input to text.
The speech input Users can obtain texts from the special corpora organized on the computer
network server at the information centre from the microphone is temporarily stored in the system
which is then sent to Google cloud for speech recognition. The equivalent text is then received and
fed to the central processor.
Python Backend:
The python backend gets the output from the speech recognition module and then identifies
whether the command or the speech output is an API Call and Context Extraction. The output is
then sent back to the python backend to give the required output to the user.
API calls:
API stands for Application Programming Interface. An API is a software intermediary that allows
two applications to talk to each other. In other words, an API is a messenger that delivers your
request to the provider that you’re requesting it from and then delivers the response back to you.
Content Extraction:
Context extraction (CE) is the task of automatically extracting structured information from
unstructured and/or semi-structured machine-readable documents. In most cases, this activity
concerns processing human language texts using natural language processing (NLP). Recent
activities in multimedia document processing like automatic annotation and content extraction
out of images/audio/video could be seen as context extraction TEST RESULTS.
Text-to-speech module:
Text-to-Speech (TTS) refers to the ability of computers to read text aloud. A TTS Engine converts written
text to a phonemic representation, then converts the phonemic representation to waveforms that can be
output as sound. TTS engines with different languages, dialects and specialized vocabularies are available
through third-party publishers.
Other modules:
The others modules that are used in this project are:
1. Datetime
2. Webbrowser
3. Wikipedia
4. OS
5. Pyjokes
6. Random
Source code
import pyttsx3 #pip install pyttsx3
import speech_recognition as sr #pip install speechRecognition
import datetime
import wikipedia #pip install wikipedia
import webbrowser
import os
import pyjokes
import pywhatkit as py
import random
from requests import get
engine = pyttsx3.init('sapi5')
voices = engine.getProperty('voices')
# print(voices[1].id)
engine.setProperty('voice', voices[1].id)
def speak(audio):
engine.say(audio)
engine.runAndWait()
def wishMe():
hour = int(datetime.datetime.now().hour)
if hour>=0 and hour<12:
speak("Good Morning!")
elif hour>=12 and hour<18:
speak("Good Afternoon!")
else:
speak("Good Evening!")
speak("hello sir , I am Friday . how may i help you?")
def takeCommand(): #It takes microphone input from the user and returns string
output
r = sr.Recognizer()
with sr.Microphone() as source:
print("Listening...")
r.pause_threshold = 1
audio = r.listen(source)
try:
print("Recognizing...")
query = r.recognize_google(audio, language='en-in')
print(f"User said: {query}\n")
except Exception as e:
# print(e)
speak("Say that again please...")
return "None"
return query
if __name__ == "__main__":
a = ("sir, anything else?")
string = str( )
wishMe()
while True:
# if 1:
query = takeCommand().lower()
# Logic for executing tasks based on query
if 'who is' in query:
speak('Searching Wikipedia...')
query = query.replace("wikipedia", "")
results = wikipedia.summary(query, sentences=2)
speak("According to Wikipedia")
print(results)
speak(results)
speak (a)
elif 'open youtube' in query:
webbrowser.open("youtube.com")
speak (a)
elif 'open chrome' in query:
webbrowser.open("chrome")
speak (a)
elif 'who are you' in query:
speak('i am Friday , your virtual assistant sir!')
speak (a)
elif 'music' in query:
music_dir = 'F:\\Songs'
songs = os.listdir(music_dir)
rd = random.choice(songs)
os.startfile(os.path.join(music_dir, rd))
speak (a)
elif 'the time' in query:
strTime = datetime.datetime.now().strftime("%H:%M:%S")
speak(f"Sir, the time is {strTime}")
speak (a)
elif 'open vs code' in query:
Path = "C:\\Users\\pault\\AppData\\Local\\Programs\\Microsoft VS Code\\
Code.exe"
os.startfile(Path)
speak (a)
elif 'joke' in query:
speak(pyjokes.get_joke())
speak (a)
elif 'play' in query:
song = query.replace('play', '')
#speak('playing ' + song)
py.playonyt(song)
speak (a)
elif 'edge' in query:
path = "C:\\Program Files (x86)\\Microsoft\\Edge\\Application\\msedge.exe"
os.startfile(path)
speak (a)
elif 'whatsapp' in query:
path = "C:\\Users\\pault\\AppData\\Local\\WhatsApp\\WhatsApp.exe"
os.startfile(path)
speak (a)
elif 'terminal' in query:
path = "C:\\WINDOWS\\system32\\cmd.exe"
os.startfile(path)
speak (a)
elif 'vlc' in query:
path = "C:\\Program Files\\VideoLAN\\VLC\\vlc.exe"
os.startfile(path)
speak (a)
elif 'geek' in query:
webbrowser.open("www.geekforgeeks.com")
speak (a)
elif 'torrent' in query:
path = "D:\\torrent"
os.startfile(path)
speak (a)
elif 'movie' in query:
path = "D:\\torrent\\GvK\\GvK.mp4"
os.startfile(path)
speak (a)
elif 'ip' in query:
ip = get('https://api.ipify.org').text
speak(f"your ip address is {ip}")
speak (a)
elif 'open google' in query:
speak("sir, what should i search on google")
cm = takeCommand().lower()
webbrowser.open(f"{cm}")
speak (a)
elif 'no thanks' in query:
speak("thanks for using me. have a good day!!!")
exit()
Future Scope
1. In this project we have implemented the basic Virtual Assistant using Python. In future we
can add many additional tasks like sending message or sending email etc.
2. We can implement this with GUI and make it fully voice controlled.
3. Then we can integrate with Windows application or Mobile application.
4. Additionally, in future add some Healthcare features can be added with this.
5. Therefore, the search behaviour can be changed in future.
6. In future, it can be used in solving maths and various types of problem with the help of
Artificial Intelligence.
Conclusion
In this project “Virtual Assistant Using Python” we discussed the design and implementation
of Digital Assistance. The project is built using open source software modules and the help of
Visual Studio.
It not only works on human commands but also give responses to the user based on the
query being asked or the words spoken by the user such as opening tasks and operations. It is
greeting the user the way the user feels more comfortable and feels free to interact with the
voice assistant. The application should also eliminate any kind of unnecessary manual work
required in the user life of performing every task. The entire system works on the verbal input
rather than the next one.
REFERENCES
www.google.com
www.youtube.com
https://techcrunch.com
R. Belvin, R. Burns, and C. Hein, “Development of the HRL route navigation dialogue system,”
in Proceedings of ACL-HLT, 2001
V. Zue, S. Seneff, J. R. Glass, J. Polifroni, C. Pao, T.J.Hazen,and L.Hetherington, “JUPITER: A
Telephone Based Conversational Interface for Weather Information,” IEEE Transactions on
Speech and Audio Processing, vol. 8, no. 1, pp. 85–96, 2000.
M. Kolss, D. Bernreuther, M. Paulik, S. St¨ucker, S. Vogel, and A. Waibel, “Open Domain
Speech Recognition & Translation: Lectures and Speeches,” in Proceedings of ICASSP, 2006.
Sadun, E., &Sande, S. (2014). Talking to Siri: Mastering the Language of Apple’s Intelligent
Assistant.
THANK YOU
