International Journal of Trend in Scientific Research and Development (IJTSRD)

Volume 7 Issue 2, March-April 2023 Available Online: www.ijtsrd.com e-ISSN: 2456 – 6470

Hand Gesture Vocalizer

Venkat P. Patil, Suyash Mali, Girish Ghadi, Chintamani Satpute, Amey Deshmukh
Department of Electronics and Telecommunication Engineering,
Smt. Indira Gandhi College of Engineering, Navi Mumbai, Maharashtra, India

ABSTRACT How to cite this paper: Venkat P. Patil |

Digital voice over is a social project aimed at improving the ability of Suyash Mali | Girish Ghadi | Chintamani
speaking and hearing by enabling people to communicate better with Satpute | Amey Deshmukh "Hand
the public. There are approximately 9.1 billion deaf and hard of Gesture Vocalizer"
Published in
hearing people worldwide. They encounter many problems while
International Journal
trying to communicate with the society in daily life. Deaf and speech-
of Trend in
impaired people often use language to communicate but have Scientific Research
difficulty communicating with people who do not understand the and Development
language. (ijtsrd), ISSN: 2456- IJTSRD55157

Sign language uses sign language patterns i.e., body language, 6470, Volume-7 |
Issue-2, April 2023, pp.766-769, URL:
gestures and movements of arms and fingers etc. to convey
www.ijtsrd.com/papers/ijtsrd55157.pdf
information about people. relies on. This project was designed to
meet the need to create electronic devices that can translate sign Copyright © 2023 by author (s) and
language into speech to facilitate communication between the deaf International Journal of Trend in
and dumb and the public. Scientific Research and Development
Journal. This is an
KEYWORDS: Digital Vocalizer, Flex Sensor, Sign Language, Open Access article
Gestures, Arduino Nano distributed under the
terms of the Creative Commons
Attribution License (CC BY 4.0)
(http://creativecommons.org/licenses/by/4.0)

I. INTRODUCTION
Sign language is a language that uses communication message to the public. It translates sign language
and body language to convey meaning, rather than words into text or speech. There are many deaf and
saying sound patterns out loud. This can include hand dumb people all over the world. All of them face the
gestures, gestures, and movements of the hands, arms, problem of communicating with others. By using sign
or body, and facial expressions to convey the language, they can reach more individuals with their
speaker's thoughts. As long as there has been a deaf message. It converts their sign language
community, the lessons have come together. communication into spoken language. Numerous
Languages are also used by people who can hear but individuals throughout the globe are deaf or mute.
cannot speak. Even if they use grammar in a They cannot find out how to communicate. Our work
conversational way, it has no place. is part of a larger effort to eliminate this
A lot of people utilise sign language to communicate communication barrier by developing a glove
when they just have auditory skills. Written endowed with sensors that can interpret sign language
languages, in contrast to spoken ones, employ space hand movements and convert them into written and
for grammatical purposes. Sign languages share the spoken language.
same linguistic capabilities and traits as spoken A large part of the Indian population suffers from a
languages. There are hundreds of different sign speech impediment. Also, communicating in a
languages used by deaf people all over the world. language is not an easy task. This problem needs a
While some sign languages have legal recognition, better solution that can help speech impaired people
others do not. communicate easily. For this reason, the
Deaf people use sign language to communicate with communication gap is reduced for the speech
themselves and with ordinary people. It is difficult for impaired. This article offers an insight to help bridge
people to understand these words. While they can or at least reduce the gap between current research
express their message in writing, they cannot convey methods in this field that focus heavily on the
it to the readers. Languages help convey their imaging process. But in this article, use the cheaper

@ IJTSRD | Unique Paper ID – IJTSRD55157 | Volume – 7 | Issue – 2 | March-April 2023 Page 766
 International Journal of Trend in Scientific Research and Development @ www.ijtsrd.com eISSN: 2456-6470
and easier method. The idea is to make a glove that Abhinandan Das [4], Flexibility sensors and
people with poor speech can wear, which will be used gyroscope sensors for finger and hand movements,
to convert sign language into speech and text. Our respectively. It uses a flex sensor on each finger with a
model uses Arduino Nano as a microcontroller related gyroscope sensor inside to detect hands. This results
to flexible sensors and accelerometer, flex sensors to in a combination of motions and thus a motion dataset.
read movements. Also, for optimization, we are using Data transfer is done by Xbee transceiver to facilitate
an algorithm to better interpret the data and perform data flow. When data is received, the microprocessor
better execution. Next, we use python to interface the processes it and displays the output as a written text
Arduino Nano with the microprocessor and finally for the signed message. The text is displayed on the
convert it to speech. Grove-LCD. It will also be converted into speech by
Basically, an Artificial Neural Network is the main the Grove-buzzer sensor. Limitation: All sets can form
concept of our prototype. Flex sensors are placed on a maximum of 200 words. Another disadvantage of
the part of the fingers of the glove and then basically this system is the use of letters and numbers, which
that glove has to wear by deaf people, which converts significantly slows down communication. (Assam
the parameter like finger bend hand position angle Engineering Institute and others).
into electrical signal and provide it to the controller
and controller takes the action according to the sign.
And to increase the accuracy we used an
Accelerometer to detect the moment of hand, so that
it will be beneficial for the people to use the glove by
simply rotating the hand in any direction.
II. LITERATURE SURVEY
The intended purpose of the sign language translation
system is to provide a portable means of
communication with the deaf and mute by translating
standard sign language into spoken English. The
proposed system operates solely on a microcontroller
and does not require a central processing unit.
Embedded Systems are swiftly becoming the norm
across all industries, according to another survey.
Modern embedded application development is
intelligently transforming our way of life.
The development of speech converter by using RF Fig.1: The model of Hand Gesture Vocalizer
trans-receiver to send data to recorder leads to an OVERVIEW OF COMPONENTS
effective use of advice. For making this Sign Glove, we have mounted all the
M. S Kasar, Anvita Deshmukh [1] made a smart working components like LCD screen, DF player,
glove. A glove with a portable speaker and a sound Arduino Nano, and Speaker on the zero PCB and the
generator, designed for speech-impaired people. The flex sensors, Accelerometer are mounted in the gloves
system is well designed, but only captures 4 different itself. As we have made use of Arduino Nano, which
gestures and converts them into speech. Limitations: is a n open-source microcontroller board on which we
This is a very important task, but the potential for have compiled our program to make our glove. For
output is limited due to the small number of the operation of the glove, we are using the Flex
explanations that will emerge. sensors and ADXL335 accelerometer.
R.L.R. Lokesh Babu, S. Gagana Priyanka, P. Pooja We have made use of a Flex Sensors which are fixed
Pravallikka, Ch. Prathyusha [2], as "Jest Vocalizer". It to the part of the fingers in the glove for sensing the
uses a speech-to-text converter for mobile users. movement of fingers. To operate the flex sensors one
Limitations: It is difficult and inconvenient to control has to move the fingers in a specified way for getting
the phone app all the time. desired output. The complete system is powered by a
Prerana K.C, Nishu Mahato [3] proposed a method for 12 volts rechargeable battery.
gesture recognition. A system that reads the value of a For sensing the hand movement, we are using
particular move made by the user and predicts the ADXL335 Accelerometer which is mounted on the
outcome of that move. Restrictions: The system is backhand to sense the movement of hand from the
unreliable as there is no information about all the direction of its origin.
letters and words created.

@ IJTSRD | Unique Paper ID – IJTSRD55157 | Volume – 7 | Issue – 2 | March-April 2023 Page 767
 International Journal of Trend in Scientific Research and Development @ www.ijtsrd.com eISSN: 2456-6470

Fig.2: Circuit Diagram

III. WORKING to the analog input pins of the Arduino nano and the
The key notation behind this thing works is that it microcontroller reads the analog values from the
basically converts the sensed signal values to the sensors.
electrical energy.
A gesture recognition algorithm is implemented in the
The basic working principle of our project is based on Arduino code, which analyzes the changes in
the flex sensor. To implement these, we adjust all the resistance values from the flex sensors to determine
wooden flex sensors above each of the fingers of the type of hand gesture being made. The algorithm
glove. The main components of the gesture vocalizer can be trained to recognize different gestures, such as
are the microcontroller, the audio processing unit, and a fist, an open hand, a thumbs-up, or a peace sign,
the LCD display; the sensors (flex and an depending on the specific application requirements.
accelerometer) are worn on the hand of the hearing-
The Arduino can also be connected to a speaker or a
impaired individual.
buzzer, which serves as the audio output. The speaker
A glove consists of 4 flex sensors, which are can generate vocalized commands or responses based
connected on each finger and an accelerometer. This on the recognized hand gesture. For example, if the
piece of technology is a glove that renders hand user makes a fist gesture, the vocalizer can generate a
movements into human-understandable noises and voice command like "HELP" or "WATER," and if the
simultaneously displays the same information on an user makes a peace sign gesture, the vocalizer can
LCD screen. Inside the glove are flex sensors that generate a voice command like "cancel" or "back."
convert physical parameters, such as finger bending
The user can interact with the hand gesture vocalizer
and hand position angle, into an electrical signal that
by changing the hand gestures in real-time. The flex
is then sent to an Arduino NANO controller. The
sensors continuously measure the bending movements
audio processor microprocessor is responsible for
of the hand, and the Arduino updates the
storing and reproducing any recorded audio
communications. The use of an LCD panel that can LCD screen and speaker output accordingly based on
display text messages makes communication more the recognized hand gestures.
accessible for individuals with hearing impairments. The hand gesture vocalizer can be customized by
An Arduino Nano microcontroller, which is a small reprogramming the Arduino with different algorithms
programmable electronic device, is used to process or patterns to recognize specific hand gestures based
data from flex sensors. The flex sensors are connected on the user's preferences or application requirements.

@ IJTSRD | Unique Paper ID – IJTSRD55157 | Volume – 7 | Issue – 2 | March-April 2023 Page 768
 International Journal of Trend in Scientific Research and Development @ www.ijtsrd.com eISSN: 2456-6470
fatigue or discomfort due to the pressure or
tightness of the glove.
3. CONCLUSION
This paper has described a specific object of concept
which is used in a particular area. The the hand
gesture vocalizer project presents an innovative
approach by utilizing hand gestures to control
vocalized output. Through a combination of machine
learning algorithms and sensor technology, the project
demonstrates the potential of using hand gestures as
an intuitive and efficient means of controlling
vocalized output and simultaneously presents on the
LCD screen.
Overall, this project contributes to the advancement of
normal-deaf peoples interaction and opens up new
Fig.3: Working condition model of Hand Gesture possibilities for enhancing communication and
Vocalizer interaction in diverse domains.
1. ADVANTAGES: The project is capable to give the desired output by
Hand gesture is simply based on moving the and reading the values given by the sensors. The overview
fingers for the deaf people so that they can easily describes how the project functions and will be
communicate with normal people. implemented in the future.
Compact yet highly sensitive. IV. REFERENCES
Hand gesture vocalizer can provide accessibility [1] www.youtube.com
benefits for individuals with physical disabilities
or limitations, allowing them to control devices or [2] M. S Kasar, Anvita Deshmukh, Akshada
applications without the need for physical touch or Gavande, and Priyanka Ghadage, "Smart
fine motor skills. Speaking Glove-Virtual tongue for Deaf and
A glove-mounted hand gesture vocalizer can be Dumb," International Journal of Advanced
highly portable, allowing users to carry and use Research in Electrical, Electronics and
the system easily without the need for additional Instrumentation Engineering, vol. 5, no. 3, p. 7,
equipment or installations. Mar. 2016.

2. DISADVANTAGES: [3] R. Lokesh Babu, S. Gagana Priyanka, P. Pooja

Currently due to cost of all the sensors and budget Pravallika, Ch. Prathyusha “Gesture
limitations we choose to limited gestures which Vocalizer”, International Journal of Modern
can perform by single hand. Trends in Science and Technology, vol.2, issue
no 04, Apr 2016.
The accuracy and reliability of hand gesture
recognition with flex sensors and accelerometers [4] Prerana K.C, Nishu Mahato, and Bishruti
may depend on various factors, such as sensor Satyal, "Hand Gesture Recognition using
quality, calibration, and environmental conditions. KINECT," Nepal Engineering College,
Inaccurate or unreliable gesture recognition can Baktapur, Bachelor Thesis P3-I.0-14-4, 2015.
result in unintended actions or frustration for [5] Abhinandan Das, “Smart glove for Sign
users. Language communications”, International
Wearing a glove for an extended period of time Conference on Accessibility to Digital World
may cause physical discomfort, such as hand (ICADW), Dec 2016.

@ IJTSRD | Unique Paper ID – IJTSRD55157 | Volume – 7 | Issue – 2 | March-April 2023 Page 769