Voice Operated Wheelchair
Voice Operated Wheelchair
Voice Operated Wheelchair
ABSTRACT
Many disabled people usually depend on others in their daily life especially in
getting from one place to another. For the wheelchair users, they need continuously
someone to help them in going the wheelchair moving. By having a wheelchair
control system will help handicapped persons become independent. The system is
a wireless wheelchair control system which employs a voice recognition system for
triggering and controlling all its movements. The wheelchair responds to the voice
command from its user to perform any movements functions. It integrates a
microcontroller, wireless microphone, voice recognition processor, motor control
interface board to move the wheelchair. By using the system, the users are able to
operate the wheelchair by simply speak to the wheelchair microphone. The basic
movement functions includes forward and reverse direction, left and right turns
and stop It utilizes a PIC controller microchip 16f877a to control the system
operations. It communicates with the voice recognition processor to detect word
spoken and then determines the corresponding output command to drive the left
and right motors. To accomplish this task, an assembly language program is
written and stored in the controller's memory .In order to recognize the spoken
words, the voice recognition processor HM 2007 must be trained with the word
spoken out by the user who is going to operate the wheelchair.
1
VOICE OPERATED WHEELCHAIR
Chapter1:
INTRODUCTION
2
VOICE OPERATED WHEELCHAIR
A wheelchair is a wheeled mobility device in which the user sits. The device is
propelled either manually by pushing the wheels with the hands or via various
automated systems. Wheelchairs are used by people for whom walking is
difficult or impossible due to illness, injury, or disability. People with walking
disability often need to use a wheelchair “World report on disability" jointly
presented by World Health Organization (WHO) and World Bank says that there
are 70 million people are handicapped in the world. Unfortunately day by day the
number of handicapped people is going on increasing due to road accidents as well
as disease like paralysis. If a person is handicapped he is dependent on other
person for his day to day work like transport, food, orientation etc. So a voice
operated wheel chair is developed which will operate automatically on the
commands from the handicapped user for movement purpose.
3
VOICE OPERATED WHEELCHAIR
There are many scientists and researchers who develop computer software
that can recognize human voice commands in so many languages such as
English, Japanese and Thai. There are many techniques that are used to
recognize voice commands .[1]
4
VOICE OPERATED WHEELCHAIR
5
VOICE OPERATED WHEELCHAIR
Speaker dependent systems are trained by the individual who will be using the
system. These systems are capable of achieving a high command count and better
than 95% accuracy for word recognition. The drawback to this approach is that the
system only responds accurately only to the ind ividual who trained the system.
This is the most common approach employed in software for personal computers.
Speaker independent is a system trained to respond to a word regardless of who
speaks. Therefore the system must respond to a large variety of speech patterns,
inflections and enunciation's of the target word. The command word count is
usually lower than the speaker dependent however high accuracy can still be
maintain within processing limits. Industrial requirements more often need speaker
independent voice systems, such as the AT&T system used in the telephone
systems. A more general form of voice recognition is available through feature
analysis and this technique usually leads to "speaker-independent" voice
recognition.
Recognition Style
Speech recognition systems have another constraint concerning the style of speech
they can recognize. They are three styles of speech: isolated, connected and
continuous. Isolated speech recognition systems can just handle words that are
spoken separately. This is the most common speech recognition systems available
today. The user must pause between each word or command spoken. The speech
recognition circuit is set up to identify isolated words of .96 second lengths.
Connected is a half way point between isolated word and continuous speech
recognition. Allows users to speak multiple words. The HM2007 can be set up to
identify words or phrases 1.92 seconds in length. This reduces the word
recognition vocabulary number to20.
6
VOICE OPERATED WHEELCHAIR
7
VOICE OPERATED WHEELCHAIR
8
VOICE OPERATED WHEELCHAIR
9
VOICE OPERATED WHEELCHAIR
10
VOICE OPERATED WHEELCHAIR
Chapter 2:
11
VOICE OPERATED WHEELCHAIR
12
VOICE OPERATED WHEELCHAIR
Fig 2.2
HARDWARE:
Block diagram of voice operated wheelchair consist of following blocks.
1) PIC microcontroller
2)Voice recognition block
3) Driver IC block
4) DC motors block
5) Battery
6) Battery charger
The description of this blocks is as follows.
1)MICROCONTROLLER PIC16F877
This is a 40 pin programmable interrupt microcontroller. It is a high performance
RISC CPU. This is used for controlling the movement and direction of wheel chair
13
VOICE OPERATED WHEELCHAIR
The voice recognition unit consists of the HM2007 IC. It is a Large Scale
Integration (LSI) circuit with analog front end, voice analyzer, voice recognition
processor and functional control system embedded in a single chip Complementary
Metal Oxide Semi conductor (CMOS). It also consists of HM6264B IC which is a
64k external static RAM used by the HM2007 IC to store the trained words that are
used at the recognition phase , a 4*3 keyboard , external microphone and some
other components assembled together to build a 40 isolated sound word
recognition system. The voice recognition IC HM2007 is operated in speaker
dependent recognition mode. In this mode, the unit responds only to the current
user. If another person needs to use the same system, a new training phase must be
applied. This mode reaches a high accuracy of more than 95% for voice command
recognition.
The L293 and L293D are quadruple high-current half-H drivers. The L293 is
designed to provide bidirectional drive currents of up to 1 A at voltages from 4.5 V
to 36 V. The L293D is designed to provide bidirectional drive currents of up to
600-mA at voltages from 4.5 V to 36 V. Both devices are designed to drive
14
VOICE OPERATED WHEELCHAIR
inductive loads such as relays, solenoids, dc and bipolar stepping motors, as well
as other high-current/high-voltage loads in positive-supply applications.
4)MOTORS(DC):
Two 12V dc motors are used in this experiment.
5)POWER SUPPLY SECTION
This section is consisting of a rechargeable battery. This section deals with the
power requirements of the wheel chair for DC motors, Microcontroller and other
Section. Battery is used to provide the power supply to L298 driver IC (supply)
which drives the DC motors, Microcontroller and IR section operates on 5V supply
which is provided with the help of LM7805 which is a 5V regulator IC by
converting 12V into 5V
SOFTWARE REQUIRD:
15
VOICE OPERATED WHEELCHAIR
2.3 SPECIFICATIONS:
Components:
Parts list for speech-recognition circuit
1. IC1 HM2007 IC
2. IC3 74LS373
3. IC4 and IC5 7448
4. XTAL 3.57 MHz
5. Speech-recognition PCB
6. 12-contact keypad
7. 7-segment displays
8. Microphone
9. 12V battery clip
Parts list for interface circuit
1. Microcontroller PIC16f877A
2. L293D
3.40 MHz crystal
4. DC motors
5.7pin connectors
COMPONENT SPECIFICATIONS:
1)HM2007 IC :
It is a 48 pin DIP IC.
Speaker independent mode was used.
Maximum of 40 words can be recognized
Each word can be maximum 1.92sec long.
Microphone can be connected directly to the analog input.
64K SRAM, two 7 segment displays and their drivers were connected.
16
VOICE OPERATED WHEELCHAIR
Instructions:32
Operating speed:DC 20 MHz
Flash program memory:upto 8k *14 words
Data memory:upto 368*8 bytes
EPROM: upto 856*8 bytes
Timer/Counter:3(2-8 bit ,1-16 bit)
Operating voltage:2.0 to5.5
A/D convertor: 10 bit 8 channel
4)DC Motors:
Operating voltage:12 v
Speed:100 rpm
Current rating: upto 2 amp
17
VOICE OPERATED WHEELCHAIR
SOFTWARE:
a)Flow Chart for voice training and recognition
START
TrainingMode
Speak the word
LED Blinking
Next Word
Y Word accepted
End
Fig 2.3
18
VOICE OPERATED WHEELCHAIR
19
VOICE OPERATED WHEELCHAIR
Fig 2.4
DESCRIPTION OF FLOW CHART FOR V.O.W
Start the process.
Select the mode of operating.
For voice mode, give the voice input command.
If voice input is ‘FORWARD’, then execute ‘FORWARD’ loop, wheelchair
will move in forward motion otherwise go to next loop.
If voice input is ‘BACKWARD’, then execute ‘BACKWARD’ loop,
wheelchair will move in backward motion otherwise go to next loop.
If voice input is ‘RIGHT’, then execute ‘RIGHT’ loop, wheelchair will
move in right motion otherwise go to next loop.
If voice input is ‘LEFT’, then execute ‘LEFT’ loop, wheelchair will move in
left motion otherwise go to next loop.
Execute the stop loop, wheelchair will stop
For manual mode, by using keypad press 01for FORWARD,02 for
BACKWARD,03 for RIGHT,04 for LEFT,05 for STOP.
20
VOICE OPERATED WHEELCHAIR
Chapter 3:
SYSTEM IMPLEMENTATION
21
VOICE OPERATED WHEELCHAIR
Fig 3.1
Description of pin diagram:
The pin diagram of the speech processor HM2007 is shown in figure. The heart of
this module is the voice processor HM2007 IC manufactured by Hualon
Microelectronic Corporation, USA which controls the overall voice recognition
process. The data sheet is in the Appendix A. This processor is a 48-pin single chip
CMOS voice recognition LSI circuit with on chip analog front end, voice analysis,
recognition process and system control functions. It uses a 3.57 MHz crystal as a
clock to synchronize its operation. A maximum of 40 isolated-word voice
recognition system can be composed of external microphone, keyboard, external
memory 64K SRAM and some other components. This means it
has two selections of command word length capabilities:
22
VOICE OPERATED WHEELCHAIR
1)40 words vocabulary which has a maximum limit of 0.96 second. Length for
each word.
2) 20 words vocabulary which has a maximum limit of 1.92 second. length for
each word Other features includes 'dependent' and 'independent' mode voice
recognition capabilities. The speaker-dependent system is trained by the individual
who will be using the system [5]. It is capable of achieving a high command count
and better than 95% accuracy for word recognition. The disadvantage of this
approach is that the system only responds accurately to the individual who trained
the system. Speaker-independent system is a system trained to respond to a word
regardless of who speaks. Therefore the system must respond to a large variety of
speech patterns, inflections, and enunciations of the target words. The command
word count is usually lower than that of the speaker dependent system, however,
high accuracy can still be maintained within processing limits. Combined with a
microprocessor, an intelligent recognition system can be built.
23
VOICE OPERATED WHEELCHAIR
Description:
General definition of a voice recognition or speech recognition is that, a process of
converting a speech or voice signal into a sequence of words, by means of an
algorithm implemented as a-computer program. It is the ability of a machine or
program to recognize 'spoken words, by comparing the spoken commands with a
sound sample. In this technology analog signal (voice) is converted into a digital
signal by using an analog-to-digital converter. This digital signal is then compared
to the digital database of the system which has
24
VOICE OPERATED WHEELCHAIR
been stored with digital speech patterns. The voice recognition used in this thesis is
SR-06 which is from Images SI Incorporation, USA. It converts the voice analog
signal to digital output. The circuit is made up by four main blocks:
1. Speech recognition processor IC HM2007
2. Input device which is a keypad for word training purpose
3. Digital display board which is used to display the word number
4. External memory SRAM IC
25
VOICE OPERATED WHEELCHAIR
Fig 3.3
26
VOICE OPERATED WHEELCHAIR
27
VOICE OPERATED WHEELCHAIR
28
VOICE OPERATED WHEELCHAIR
29
VOICE OPERATED WHEELCHAIR
30
VOICE OPERATED WHEELCHAIR
The main part of the design is to control the motion of the wheelchair. There
are four condition of motions are considered, moving forward, moving in
reverse direction, moving to the left and moving to the right. For the speed,
the user may use slow or fast speed command.
The system starts by applying the supply voltage to the speech recognition
circuit. For fast condition the system will supply higher current to the
motors.
If the user does not want the wheelchair move in high speed, the slow speed
command can be set by applying low current supply to the motors. The
wheel chair directions and movement possible are as given below.
31
VOICE OPERATED WHEELCHAIR
32
VOICE OPERATED WHEELCHAIR
33
VOICE OPERATED WHEELCHAIR
3.8 RESULTS
OUTPUT TABLE:
Table 1
Commands B.7 B.6 B.5 B.4 B.3 B.2 B.1 B.0 code REQUIRED
motion
FORWARD 0 0 0 0 0 0 0 1 01 FORWARD
BACKWARD 0 0 0 0 0 0 1 0 02 BACKWARD
RIGHT 0 0 0 0 0 0 1 1 03 RIGHT
LEFT 0 0 0 0 0 1 0 0 04 LEFT
STOP 0 0 0 0 0 1 0 1 05 STOP
Memory location=01
34
VOICE OPERATED WHEELCHAIR
Memory location=02
Memory location=03
35
VOICE OPERATED WHEELCHAIR
Memory location=04
Memory location=05
36
VOICE OPERATED WHEELCHAIR
Table 2
DESCRIPTION OF RESULT:
1)Table no 1shows the output result present on the Port B of the PIC
microcontroller 16F877.When we give the voice input as ‘FORWARD’ for the
memory location 01H,then IC HM2007 assigns this voice input to that memory
location and provides its binary form which is appears on Port B of
microcontroller. As per this, for all other voice inputs, we get the output.
2)Table no 2 shows the actual testing results of the voice operated wheelchair. The
output is speaker independent. For ‘FORWARD’ command, all the three speakers
got the result as ‘FORWARD’ motion of wheelchair. For ‘BACKWARD’
command, all speakers got ‘BACKWARD ’motion of wheelchair. So accuracy of
result is 100% for FORWARD and BACKWARD. For command ‘RIGHT
‘speaker 2 got result as ‘NO MOTION ’.For ‘LEFT’ command, speaker1 got
response as ’FORWARD’ motion. So accuracy of result for ’LEFT’ and
‘RIGHT’is66.66%.For ‘STOP’ command got the accuracy of result as100%.
37
VOICE OPERATED WHEELCHAIR
3.9 ADVANTAGES
1) A handicapped person without Legs can use this and become Independent.
2) Reduce manpower.
3) User friendly
3.10 CONCLUSION:
HM2007 the efficiency to detect voice command and control the wheel chair is
significantly increased. This voice operated wheel chair will assist the handicapped
persons to make them self dependent for the purpose of movement for which these
people are dependent on other most of the times. A person with disabled with legs
and arms can use this wheel chair efficiently if he is able to speak.
3.101FUTURE SCOPE:
The wheelchair speed control system is targeted to be operated in both indoor and
outdoor. This means it has to be noise-proofed and weather-proofed.It must has the
ability to recognize the command word even in the presence of the background
noise.
38
VOICE OPERATED WHEELCHAIR
Chapter 4:
APPENDIX
39
VOICE OPERATED WHEELCHAIR
4.1 REFERENCES:
[1] “Voice Operated Intelligent Wheelchair” by Ms. S. D. Suryawanshi , Mr. J. S.
Chitode , Ms. S. S. Pethakar, “ International Journal of Advanced Research in
Computer Science and Software Engineering
[2] “Voice Based Direction and Speed Control of Wheel Chair for Physically
Challenged by M.Prathyusha, K. S. Roy, Mahaboob Ali Shaik, “ International
Journal of Engineering Trends and Technology (IJETT)” ,
40
VOICE OPERATED WHEELCHAIR
4.2 DATASHEETS:
41