GROUP MEMBERS

• SREEKUTTAN P V
• KARTHIGA M
• JASHNA P J
• ANJU V K
 WHY THIS PROJECT????
According to the statistics of the world federation of the
deaf and the World Health Organization , approximately
70 million people in the world are deaf –mute.A total of
360 million people are deaf , and 32 million of these
individuals are children. The majority of speech and
hearing impaired people cannot read or write in regular
languages. Sign language is the native language used by
the deaf and mute to communicate with others. SL relies
primarily on gestures rather than voice to convey
meaning, and it combines the use of finger shapes, hand
movements and covert in to speech.
 ABSTRACT
• Loss of ability to speak or hear exerts psychological
and social impacts on the affected persons due to the
lack of proper communication.

• Sign language recognition(SLR) systems based on

sensory gloves are significant innovations that aim to
procure data on the shape or movement of the
human hand.

• A review is conducted to create a coherent taxonomy

to describe the latest research divided into 4 main
categories: development, framework, other hand
gesture based recognition, and reviews and survey.
 BLOCK DIAGRAM

LCD

APR LS

FLEX
Pic 16F877a
SENSOR RELAY 1 - DEV 1
RELAY 2 - DEV 2
CIRCUIT- POWER SUPPLY
SECTION
CIRCUIT-MAIN
 DESIGN
Flex sensor
-Height: 0.43mm (0.017") -Temperature Range: -35°C to
+80°C -Flat Resistance: 10K Ohms ±30% -Bend Resistance:
minimum 2 times greater than the flat resistance at 180° pinch
bend .
 APR
Ite Sy Co Min Ma U
m mb ndi x ni
ol tio t
n
Power Supply VC TA -0.3 6.5 V
voltage C =
25°
C
Input Voltage VIN IIN -1.0 VC V
2 <2 C+
0m 1.0
A
Storage TS - -65 150 °
Temperature TG C

Temperature TB - -65 125 °

Under Bias S C
Lead TL <1 -0.3 300 °
Temperature D 0s C
 PIC 16F877a

Operating Frequency DC –– 20 MHz

Resets (and Delays)- POR, BOR
(PWRT, OST)
Flash Program Memory
(14-bit words)-8K
Data Memory (bytes) -368
EEPROM Data Memory (bytes) -256
Interrupts -15
 COMPONENTS
Flex sensor:- A flex sensor or bend
sensor is a sensor that measures the
amount of deflection or bending.
Usually, the sensor is stuck to the
surface, and resistance of sensor
element is varied by bending the surface.
 FEATURES

- Angle Displacement Measurement

- Bends and Flexes physically with motion device
- Possible Uses
- Robotics
- Gaming (Virtual Motion)
- Medical Devices
- Computer Peripherals
- Musical Instruments
- Physical Therapy
- Simple Construction
- Low Profile
spectrasymbol.com v.2014 Rev A - Page 1 (888) 795-2283
Mechanical
 SPECIFICATIONS

-Life Cycle: >1 million

-Height: 0.43mm (0.017")

-Temperature Range: -35°C to +80°C

-Flat Resistance: 10K Ohms ±30%

-Bend Resistance: minimum 2 times greater than

the flat resistance at 180° pinch bend (see

"How it Works" below)

-Power Rating : 0.5 Watts continuous; 1 Watt Peak

 PIC 16F877a is used here
 It has 40 pins
 It has 5 ports in total.(PORTA, PORTB,
PORTC,PORT D,PORTE)
 It supports serial communication for which it
has2 pins TX and RX
 You can receive data from RX and can trasmit
data from tx
 It is also support spi protocol.
 It has a crystal oscillator ranging from 4MHZ
to 40MHZ
 PORTA has 8 pins in total and it is an
analogue port
 All pins in PORTA are analogue.
 PORTB also has 8 pin but these all are digital
pins
 PORTC is also a digital port having 8 pins
 PORTC pins are also used for serial
communication
 PIC16F877 divided into 3 types of memories

1. PROGRAM MEMORY:
PIC16F877 devices have a 13 bit wide program counter that is capable of

addressing 8K×14 bit program memory space. This memory is primarily

used for storing the programs that are written (burned) to be used by the
PIC. These devices also have 8K*14 bits of flash memory that can be
electrically erasable /reprogrammed.
 Contd……

DATE MEMORY:
The data memory of PIC16F877 is separated
into multiple banks which contain the general
purpose registers (GPR) and special function
registers (SPR).
The PIC16F877a chip only has four banks
(BANK 0, BANK 1, BANK 2, and BANK4). Each
bank holds 128 bytes of addressable
memory.
 Contd…….

 DATA EEPROM:
 The data EEPROM and Flash program
memory is readable and writable during
normal operation (over the full VDD range).
This memory is not directly mapped in the
register file space. Instead, it is indirectly
addressed through the Special Function
Registers.
LCD :- A liquid-crystal display (LCD) is
a flat-panel display or
other electronically modulated optical
device that uses the light-modulating
properties of liquid crystals
 HOW IT WORKS

The main principle behind liquid crystal molecules is

that when an electric current is applied to them, they

tend to untwist. This causes a change in the light angle

passing through them. This causes a change in the

angle of the top polarizing filter with respect to it. So

little light is allowed to pass through that particular

area of LCD. Thus that area becomes darker comparing

to others.
APR :-Automatic Playback Record,
used for recording voice in different
channels. This technique is widely
used in railway
 FEATURES

• Single-chip, high-quality voice recording & playback

solution

- No external ICs required

- Minimum external components

• Non-volatile Flash memory technology

- No battery backup required

• User-Selectable messaging options

- Random access of multiple fixed-duration messages

- Sequential access of multiple variable-duration

messages
• User-friendly, easy-to-use operation

- Programming & development systems not required

- Level-activated recording & edge-activated play

back switches

• Low power consumption

- Operating current: 25 mA typical

- Standby current: 1 uA typical

- Automatic power-down

• Chip Enable pin for simple message expansion

 RELAY

OPERATIONS
Relays are a remote control electrical switch that can be switched

using low current to control a high current load.

ON STATE
When there is current through the coil of wire on the
control side a magnetic field is produced. This magnetic
field closed the contacts on the load side.

OFF STATE
Drawn in natural state
 WORKING
INPUT UNIT

• The most prominent movement that can be performed by

the four fingers (pinkie, ring, middle, and index) is
bending towards the palm and then returning to the
initial position. The thumb has unique advantages over
the other fingers, thus enabling it to move freely in six
degrees of freedom (DOF).
• Flex sensor , which determines the amount of finger
curvature used by a wide number of researchers and
developers, is the most common of these kinds of
sensors
• The Flex sensor technology is based on resistive carbon
elements. When the substrate is bent, the sensor produces a
resistance output correlated to the bend radius—the smaller
the radius, the higher the resistance value. Thus, the resistance
of the flex sensor increases as the body of the component
bends. The flex sensor is very thin and light weight, so it is
also very comfortable.

• The optical sensor used to measure the angle of the finger

curvature—in order to determine its shape by the amount of
light passing through the channel—depends on the optic
technology Optical sensors are electronic detectors that
convert light, or a change in light, into an electronic signal
Furthermore, the combined pair of light-
emitting diode-light dependent resistor
(LED-LDR) is used but not frequently, to
detect bend of the finger. LDR is a
component that has a (variable) resistance
that changes with the light intensity that
falls upon it .
PROCESSING UNIT
• The microcontroller is the system’s mind
that is accountable for gathering the data
from the sensors provided by the glove and
performing the required processing of these
data to recognize and transfer the sign to
the output port to be presented in the final
stage. A high-performance microcontroller
with a microchip with 8-bit AVR
microcontrollers based on reduced
instruction set computer (RISC), which
combines 32KB in-system programming
(ISP) flash memory with read–write
capabilities called ATmega ), was used in .
A micro-controller MSP430G2553 (TEXAS
INSTRUMENTS, Dallas, TX, USA), with an
8-channel, 10-bit (analogue to digital
converter) ADC was used. The central
processor modules ARM7 and ARM9 are
used respectively. Furthermore, as found
in the literature, an open-source
electronics platform called Arduino has
been used. Several Arduino boards are
available on the market such as Arduino
Nano, Uno, Mega, etc.; for instance,
Arduino Uno (Arduino, Italy), is based on
the ATmega328P microcontroller and has
14 digital inputs/outputs, 6 analog
inputs, a 16 MHz quartz crystal, and USB
connection
OUTPUT UNIT
Customarily, a user interacts with the device
through output devices, so the output devices
play an important role in achieving the best
performance of devices implemented in the
field of SLR. The main device adopted by
researchers as the output was the screen of
computer . Other devices attracting the
attention of researchers are the liquid-crystal
display (LCD) , speaker , or both Ultimately, the
smartphone is another alternative chosen for
system output .
 BENEFITS
Advancements in Today’s Technology
• The devices and tools that help disabled people live a
normal and comfortable life have always been a domain
that has attracted innovation.
• Various developments in the technological world today
have helped diverse groups of people with disabilities in
terms of research and product system development in
assistive technologies that aid various disabled people to
carry out their daily activities. eg:wireless devices, low-
power electronics, and the capability to design both the
analogue front-end and digital processing back-end.
Educational Tools for SL
• In developing countries, deaf and dumb children
rarely receive education. In addition, adults with
hearing and speech loss have a significant
unemployment rate.
• The availability of an easy-to-use and cost-
effective SL learning tool will help these
individuals learn through natural means.
Therefore, improving access to education and
vocational rehabilitation services will reduce
unemployment rates for people with hearing or
speech disabilities .
• On the other hand, SL is the main tool to
communicate with the deaf and dumb. Thus,
many normal people are encouraged to begin to
learn SL through web sites, video clips, and
mobile applications.
Advantages of Glove-Based Systems
• Our hands are used to accomplish a large number
of basic tasks in our daily lives. Thus, many studies
have examined the development of techniques to
investigate hand movements and increase the
capability to simulate hand functions for the
completion of basic tasks. Data acquired from hand
movements are used in several engineering
applications ranging from motion analysis to
biomedical science .
• Glove-based systems are important techniques that
are used to obtain hand movement data .This field
of research is still extremely active .
• It is also obvious that technological advancements
in computing, materials, sensors, and processing-
classification methods will contribute to making the
new generation of glove systems more powerful,
highly accurate, comfortable, cheap, and possible to
use in many applications
Limitation of the Vision-Based Method

• Gesture recognition systems rely on two means to

capture and record the shape and movement of the
hand: they use a camera or a sensor. In gesture
recognition systems, the use of a vision approach
requires the adoption of at least one camera to
capture hand images and interpret the suitable
gesture.
• Sometimes, several devices, such as Kinect, leap
motion, or even a colored glove, are appended to
increase the capability to detect hand shape or
movements .The advantage of this approach is that
the deaf person is not required to wear an
uncomfortable device. Additionally, facial
expressions can be included.
 CHALLENGES
• Nature of SL
SL postures can either be static or dynamic. The classification of
static hand postures is easier than that of dynamic hand postures,
because movement history need not be considered .Thus, most of the
current recognition systems work well with static postures, because
the error rates for dynamic postures are high due to insufficient
training

• Pertain to User
In terms of the physical differentiation of each apprentice, the
beginner cannot accurately synchronize his/her movement with that
of a proficient person .As a result, even if the beginner carries out the
motion correctly according to his/her convictions, the listener may
still have difficulties interpreting this motion; hence, the apprentice
receives a low score because of the great variance from the skilled
person
 CONCLUSION
Developing an automatic machine-based SL translation
system that transforms SL into speech and text or vice
versa is particularly helpful in improving
intercommunication. Progress in pattern recognition
offers the promise of automatic translation systems, but
many difficult problems need to be solved before they
become a reality. Several aspects related to SLR
technology, particularly SLR that uses a glove sensor
approach, have been explored and investigated.
Furthermore, efforts should be made to enhance the
robustness of the system to enable effortless
customization and extend the current methods to other
types of applications, for example, to gesture-based
mobile interfaces.