International Journal of Innovative Technology and Exploring Engineering (IJITEE)

ISSN: 2278-3075, Volume-8 Issue-10, August 2019

Smart Python Coding through Voice Recognition

M. A. Jawale, A. B. Pawar, D. N. Kyatanavar

 user will able to program or code Through voice without

Abstract: In today’s world, many artificial intelligence using the keyboard and will able to compile and
applications developed using programming languages like execute The code through voice instructions of user. In this
Python, R and so on. Each language comes with its own paper we chosen Python as programming language because
programming structure and syntactical forms. Programmers are of following reasons: Case Sensitivity, Strongly Typed,
broadly classified into three categories namely, novice users, Object-Oriented, Dynamic one.
knowledge intermittent and expert one. For novice users, it is
always a challenge to write a code without typographic errors
though users know theoretical knowledge of Programming
II. AIM, SCOPE AND OBJECTIVES
language, its structure and syntax as well as logic of program.
Therefore, this paper explores use of voice recognition technique A. Aim
in the field of programming, specifically for writing program Aim of this system is to make development of Python
with Python programming language. In experimental analysis, it program easy and interesting and allow anyone to develop a
found helpful for new Python programmers and provide new program with minimal programming knowledge.
learning curve for programmers wherein beginner can
experience hassle free program writing. This paper adds new B. Scope
way of creating interest in beginners for judging their coding The goal of this system is to provide an easy platform for the
paradigm understanding and explore one of the area for user users to develop a Python program easily, to create more
experience field for better programming Integrated
interest of user in programming, to reduce the use of
Development Environment Development (IDE).
resources, and minimize the human efforts and reduce the
Keywords: Artificial Intelligence, Learning, User Experience,
Voice Recognition.
time.
C. Objectives
I. INTRODUCTION Based on findings and requirement, Following objectives are
Programming involves human efforts, hardware and due to set for this work.
manual typing through keyboard, there are many chances to Proposed System will provide the facility of developing a
meet an error while typing. As programming is important for code through voice instructions. System will be able to save
students and innovation, as manual typing is time, Python the recognized code by voice instructions. System
consuming there is a need for an advanced system, which will provide the compile the developed code through voice
would reduce programmer’s effort and promote smart work. instructions. System will be able to compare the keywords
The system, which we are going to develop, is easier than this with database. It will provide the way to get the recognized
manual typing of code. We are going to recognize the voice of keywords on the editor. It will provide the facility to execute
user through the microphone and those keywords will be the developed code through voice instructions.
matched with the stored keywords if they are matched then
that will be displayed on editor and that is the code or III. SYSTEM MODEL
programme in a specific language, which can be further The system, which is available now days is Google Assistant,
compiled and executed through the voice instructions of user. but this system recognize the voice and performs an
In the first phase of proposed system, we made use database operation. The system, which we are going to develop, will
for the keywords comparison and further in the support the specific operation that is developing a computer
second phase, we will be going from machine learning program through the voice of user, which recognized by the
concept in which the next keyword will be recognized by
system. Keywords will identified as Key in voice input and
using the previous keyword by using the machine learning will mapped to prepared dictionary database of stored
algorithm and will be printed on the editor will be compiled keywords. If it found in this set, it will displayed in user
and executed through user voice instructions. workspace for further processing otherwise an error message
Existing systems like Google assistant recognizes the voice will give to user with prompting for correct voice input.
and will perform the Operate according to the After this operation, we will be having the code, which can be
voice instructions, but in our system we are further compiled and executed through user’s instructions.
developing The same approach for programming purpose
The specific words as if compile and run will recognized by
the system then system will go for the compilation and
Revised Manuscript Received on August 12, 2019. execution of code.
* Correspondence Author
Dr. M. A. Jawale, Information Technology Department, Sanjivani COE,
Kopargaon & SPPU,Pune, Kopargaon, India.
Dr. A. B. Pawar, Computer Engineering Dept., Sanjivani COE, Kopargaon
& SPPU,Pune, Kopargaon, India
Dr.D.N.Kyatanavar, Sanjivani COE, Kopargaon & SPPU, Pune,
Kopargaon, India

Published By:
Retrieval Number J12070881019/2019©BEIESP
Blue Eyes Intelligence Engineering
DOI: 10.35940/ijitee.J1207.0881019
3283 & Sciences Publication
 Smart Python Coding through Voice Recognition

The proposed system consist of following modules: Similarly, Fig 1.3 represents behavioral view of the
 User Workspace Designing. system, which modelled with UML Use Case diagram for
 Voice Recognition. better understanding.
 Matching Keywords and Print on Editor.
 Compile And Execute The Code.

User Workspace Designing

In this module, we are designing an editor or notepad on

which recognized keywords will printed. The printed code
can be compiled and executed through user voice
instructions.

Voice Recognition

In this module the proposed system will recognize the voice

of user through the microphone and print that keywords on
terminal and then on editor. Fig 1.3 Behavioral Representation of System

Matching Keywords and Print on Editor IV. RESULT ANALYSIS

The recognized keywords can compared with the keywords, A. Implementation Details
which stored in database and if the comparison returns zero
The said system implemented using following hardware and
value then the recognized keyword will printed on editor.
software requirements for initial results generation.
Compile and Execute the Code Hardware Requirements are: Processor –Core i3, Bus speed
- 2.5 GT/s DMI, Hard disk - 160 GB, Memory size – 4 GB
The printed code can compiled and executed through the RAM, Microphone and main interface of system is developed
voice instructions of user. with Software Requirements including PHP, MySQL
The entire system architecture and its workflow is shown in 5.7.11, JQuery, HTML, CSS and JavaScript.
following figure 1.1 and 1.2 respectively. B. Testing Environment
The developed system tested with Window 7.0 and above as
well as on Linux 14.4 and above.
C. Result Discussion
The developed system has given an interface where in the
beginning user will select Create Program option and will
start creation of program through voice, as each field in
developed user interface is voice enabled as shown in Figure
1.4.

Fig 1.1 Proposed System Architecture

Fig 1.4 User Interface of System

Using this interface, user can enter the program details

with the help of voice. The details
Fig 1.2 Proposed System Workflow
as per voice input of user will be

Published By:
Retrieval Number J12070881019/2019©BEIESP Blue Eyes Intelligence Engineering
DOI: 10.35940/ijitee.J1207.0881019 & Sciences Publication
3284
 International Journal of Innovative Technology and Exploring Engineering (IJITEE)
ISSN: 2278-3075, Volume-8 Issue-10, August 2019

fetched from database and made available to user as shown in 2. Tiecheng Yu. The Development State of the Voice Identification
[J]. The Development Communication World. 2005, pp.56-59
figure 1.5. 3. Zhiling Jiang. The System of Data Multiprogramming Collection
and Transmission Using Lingyang Single chip Computer [J],
Sichuan University of Science and Technology, 2005, pp.69-72
4. Speaking in code: how to program by voice, July 2018, Available
on: https://www.nature.com/articles/d41586-018-05588-x.
5. N. A. Nafis, Md. S. Hossain, “Speech to Text Conversion in
Real-time”, vol. 17, no. 2, pp. 271-277, Aug. 2015, ISSN
2351-8014.
6. Mario Konecki, Robert Kudeli¢, Danijel Rado²evi¢, “Challenges
of the blind programmers”, Available on:
https://bib.irb.hr/datoteka/484794.Challenges_of_the_blind_progr
ammers.pdf, 2010.
7. D. Yu, L. Deng, "Automatic Speech Recognition" in A Deep
Learning Approach II, London: Springer-Verlag, 2015.
8. F. Aguayo, "Blind learners programming through audio" in ACM
CHI '05 extended abstracts on Human factors in computing systems,
Portland, OR, USA, pp. 1769-1772, 2015.
9. Mike Pultz, 2011, [online] Available:
http://mikepultz.com/2011/03/accessing-google-speech-api-chrom
e-Ll.
10. James R. Evans, Wayne A. Tjoland and Lloyd G. Allred,
“Achieving a Hands-Free Computer Interface Using Voice
Recognition and Speech Synthesis”, IEEE AES Systems Magazine,
Fig 1.5 Program Details available on Screen January 2000, pp.14-16

Once, it is done and user clicks start code button from

given interface, system extracts contents through database AUTHORS PROFILE
intelligently and make it available to user as shown in figure
1.6 which look like completely as code written in Python Dr. Madhuri A. Jawale currently working as a Professor
and Head of Information Technology Department of
programming language. Sanjivani College of Engineering, Kopargaon. She received
the Bachelors and Masters in Computer Engineering from
Sanjivani College of Engineering, Kopargaon and Bharati
Vidyapeeth College of Engineering, Pune in 2001 and 2009
Photo
respectively. She also completed her PhD in Computer Science and
Engineering in 2015. Her research interests include Information Security, Data
Structures and Algorithms, Sentiment Analysis and Machine Learning.

Dr. Anil B. Pawar currently working as an Associate

Professor in the Computer Engineering Department of
Sanjivani College of Engineering, Kopargaon. He received
the Bachelors in Information Technology and Masters in
Computer Science and Engineering from Sanjivani College
Fig 1.6 Program Details available on Screen of Engineering, Kopargaon and Govt. College of
Engineering, Aurangabad in 2005 and 2010 respectively. He also completed
his PhD in Computer Science and Engineering in 2015. His research interests
V. CONCLUSION include Information Security, Artificial Intelligence, IoT and Machine
Learning.
We addressed the problem of user while developing a Dr. Devendra N. Kyatanavar currently working as a
computer program. Developing a computer program is not an Principal of Sanjivani College of Engineering, Kopargaon.
easy task it needs hardware resources which user have to He received the Bachelors and Masters in Electronics
Engineering from Karnataka University Dharawar and
handle. While continuous typing the code there may be Shivaji University, Kolhapur in 1984 and 1991
possibility of injuries to the fingers of the user. To avoid the respectively. He also completed his PhD in Electronics Engineering in 2009.
problems we are designing a system in which the computer His research interests include Embedded Systems, Information Security,
Artificial Intelligence and Machine Learning.
program can developed through the voice. The voice will
recognized by the system and that recognized words or word
will be compared with the stored keywords in the database
and if they are matched then that will be printed on editor and
after this again by recognizing the specific keywords the
program will be compiled and executed. This system will be
easy to use, it reduce human efforts and the use of hardware
resources. It would be surely useful for blind as well as novice
plus knowledge intermittent users.

REFERENCES
1. C. Andre, B. Jon “An automatic speech recognition system based
on the scene analysis account of auditory perception”,
Department of Computer Science, University of Shield, 211
Portobello Street, Shield S1 4DP, United Kingdom, 7 November
2006.

Published By:
Retrieval Number J12070881019/2019©BEIESP
Blue Eyes Intelligence Engineering
DOI: 10.35940/ijitee.J1207.0881019
3285 & Sciences Publication