Microcomputer and Systems: Project Proposal
Microcomputer and Systems: Project Proposal
Project Proposal
SLTS
Sign Language To Text And Speech
Group Member
M Abuzar Khan 16-CP-19
Zain ul Abideen 16-CP-83
Introduction:
Deaf-mute people need to communicate with normal people for their daily routine. The deaf-mute people
throughout the world use sign language to communicate with other people. However, it is possible only for those
who have undergone special training to understand the language. Sign language uses hand gestures and other
means of non-verbal behaviors to convey their intended meaning [9]. It involves combining hand shapes,
orientation and hand movements, arms or body movement, and facial expressions simultaneously, to fluidly
express speaker's thoughts. The idea is to create a sign language to speech conversion system, using which the
information gestured by a deaf-mute person can be effectively conveyed to a normal person. The main aim of
this work is to design and implement a system to translate finger spelling (sign) to speech, using recognition and
synthesis techniques. The modules to be present in the proposed system are,
Components:
The components that are used in this project are as follow:
1. Bread board
2. Connecting wires
3. Resistors
4. LCD (16 X 2)
5. Glove
6. Potentiometer 10K
7. Speaker
8. Arduino UNO
9. SD card reader module
10. SD
Objectives:
Deaf-mute people face difficulty in communicating with normal people who do not understand sign
language. To overcome this barrier this work proposes a sensor-based system for deaf-mute people using glove
technology. It requires fewer components such as flex sensor, Arduino and accelerometer and hence its cost is
low compared to vision-based gesture recognition system. In this system the deaf-mute people wear the gloves
(with the resistors and sensors attached to it) to perform hand gesture. First the system will convert the gesture to
the corresponding text and then the speech is synthesized for the corresponding text by using the text-to-speech
synthesizer. The system consumes very low power and it is portable. The sensor glove design along with the
tactile sensor helps in reducing the ambiguity in gestures and shows improved accuracy. This paper can further
be developed to convert words, phrases and simple sentences by concatenating the alphabets. More number of
short flex sensors can be employed to recognize more gestures.