The People Sensor: A Mobility Aid for the Visually Impaired

Sunita Ram Jennie Sharf

[email protected] [email protected]
(407) 294-396 1 (2 12) 5298873
Interactive Telecommunications Program
New York University
72 1 Broadway, New York, NY 10003
Abstract Description
Electronic Travel Aids, which transform visual Using pyroelectric and ultrasound sensors, The
environmental cues into another sensory modality, People Sensor can distinguish between an animate
have been proven to help visually impaired people (person) and an inanimate (object) obstruction in the
travel with a greater degree of psychological comfort path of the user. The device also measures the
and independence. The People Sensor is an distance between the user and the obstruction. The
Electronic Travel Aid designed to address two issues user receives this information via vibrotactile
o f importance to visually impaired people: actuation. Two types of vibration are used; one to
inadvertent cane contact with other pedestrians and represent a person in the detection field, another to
objects, and speaking to a person who is no longer represent an inanimate object. The vibrotactiie
within hearing range. The device uses pyroelectric feedback becomes perceptibly more intense as the user
and ultrasound sensors to locate and dlflerentiate gets closer to the person or object which is being
between animate (human) and inanimate (non-human) detected. This feedback is based upon data from the
obstructions in the detection path. The distance object closest to the user within the range of the
between the user and the obstruction, along with the sensors. (The range of the combined sensors can be
nature of the obstruction (human or non-human) is adjusted between six inches and five feet in depth, and
transmitted via modulated vibrotactile feedback. between two inches and ten inches in width.)
Armed with advance knowledge of the presence and
location of objects and people in the environment, Application
users of The People Sensor can travel with increased During locomotion, pedestrians perceive
independence, safety and confidence. information about the identity and location of objects
in their environment. For example, navigating the
Introduction streets of New York City during rush hour is difficult
Over time, visually impaired people have used enough with all five senses. But take away the sense of
many methods and devices, such as the long white sight and the traveler is surely at a disadvantage -
cane and dog guide, to aid in mobility and to increase echolocation cues are obscured by the noise of traffic,
safe and independent travel. If a visually impaired familiar sidewalks are crowded and seem treacherous.
person has adequate information about his travel path, Navigation inside buildings can be problematic as
he will be more comfortable while navigating well. For example, upon entering a department store,
unfamiliar spaces. Towards that end, we have created the user approaches a counter. Is a salesperson there?
a prototype of a device that can help visually impaired Has the store been remodeled since the last visit? Has
people to travel with increased independence, safety, the line of people at the cash register moved a step
and confidence. further? It can be difficult for a visually impaired
“Electronic Travel Aids (ETAs) are devices that person to tell.
transform information about the environment that The People Sensor can reduce the possibility of
would normally be relayed through vision into a form embarrassment - through inadvertent contact with
that can be conveyed through another sensory people and objects, or by addressing a person who is
modality” [ 11. ETAs are proven to provide a greater no longer within hearing range - by discreetly
degree of psychological comfort and independence to informing the user of the presence and distance of a
the blind; they “represent a leap forward in person or object. We have chosen to avoid the use of
independent travel” [2]. an auditory modality, particularly the use of
In the course of our research, we found that headphones, because this interferes with the user’s
visually impaired users expressed a desire to know the hearing and can compromise the perception of
exact location of a human being in front of them in environmental auditory cues such as echolocation and
order to have the ability to maintain proper eye contact traffic sounds.
with them, and also wished to avoid inadvertent cane Our device is not meant as a stand-alone mobility
contact with other pedestrians and objects. The People aid, nor is it intended to “replace” vision; it is designed
Sensor is designed to address these issues. to augment such tried and true navigational methods
as the long cane, the guide dog, and environmental

166
O-8186-9074-7/98 $10.00 0 1998 IEEE
auditory cues. The People Sensor can be used by the Microcontroller Processing
partially sighted, blind, deaf-blind, and by visually We use a PIC16C73 microcontroller to process
impaired wheel-chair users. the data collected by the sensors and to control the
motors which provide the tactile feedback.
Design
Ergonomics is a prime consideration in our design Vibrotactile Actuation
of The People Sensor. Ideally, an ETA should be When an obstacle is detected, vibrotactile output
“small, light in weight, easily stored when not in use, occurs in pulses at a rate inversely related to the
and easily picked up and put down” [2]. Our unit is distance from the user. If there is no obstacle
self-contained and compact. Additionally, it is detected, no vibrational pulses are emitted. Two types
designed to be cosmetically pleasing in form and of pager motors are used, one representing a person in
simple to wear and operate, with a minimal learning the path of the sensor, and another representing an
curve. inanimate object.
In the prototype
version, the sensors are Next Steps
located on a clasp-style pin We plan to: Develop range/sensitivity adjuster to
which can be affixed to the calibrate sensors for indoor or outdoor use; Move from
user’s shirt or jacket, like a prototype form factor to ideal form factor; Continue
brooch or tie-tat, or tied user testing to refine vibrotactile feedback; Explore
around the user’s neck like detection of directional motion of objects and people.
a necklace allowing for In addition to its application as an Electronic
hands-free use. The guts of Travel Aid, the technology behind The People Sensor
the device are contained could be used in discreet, portable, wearable security
within a standard “fanny alert devices as well as to provide a finer granularity
pack,” easily fastened about of feedback from existing stationary security systems.
the waist, thus leaving both F;g. I Prorowe version in use
hands free. This belted, compartmentalized carrying Conclusion
case houses the major electronic components, We hope that The People Sensor will be an
batteries, and switches. The vibrotactile output is effective, low-cost solution for reducing travel anxiety
transmitted through the fanny pack to the user’s waist. for visually impaired users. Advance knowledge of
The ideal design will have the same fimctionality the presence and location of objects and people in the
as the prototype but in a smaller form factor which environment will enable the user to travel with
allows for multi-modal use: hand-held/chest- increased independence, safety and confidence.
mounted/waist-bound, with an easily convertible
wrist/neck/waist strap. References
[l] “Results of a National Survey of Electronic Travel Aid
Implementation Use.” Bruce Blasch. Richard Long. Nora Griffin-
The unit is powered by standard AA and 9V Shirley, Journal of Visual Impairment and Blindness,
batteries, easily replaced by the user, which provide a Vol. 83, No. 9, pp. 449-453, November 1989.
[2] Foundations ofOrientation and Mobiliry. edited by
minimum of five hours continuous operation.
Bruce Blasch, William Wiener. Richard Welsh. AFB
Press, 1997.
Non-Contact Distance Measurement
The ultrasonic sensor calculates the distance of an
object from the sensor by measuring the time of flight Acknowledgements
Jesse Dorogusker. Interval Research Corporation.
required for a sound wave to travel to the object and Marsha Duckert, Eye Tee.
back. Objects are detected regardless of ambient light John Hannum. Delaware Health and Social Services,
levels, color, material, and reflectivity. Division for the Visually Impaired.
The ultrasonic transmitter operates at a frequency Nova Herring, Orientation & Mobility Instructor, APSEA.
of 50 kHz and uses a 15-degree conical beam. Voltage Tony Heyes, Perceptual Alternatives.
output is proportional to the measured target range. Peter Meijer, The vOICe.
Dan O’Sullivan, Interactive Telecommunications Program,
Non-Contact Human Detection New York University.
Geoff Smith. Interval Research Corporation.
The pyroelectric sensor detects the presence of a
Sandra Stimweis. Foundation for Blind Children.
person via a thermal sensing element. It responds only Bob Sunberg, The Lighthouse.
to a change in radiation intensity. Since wavelengths “Choosing and Using Pyroelectric Detectors.” Hans Keller
near 10 micrometers are required to detect the and David Cima, ELTEC Instruments. Inc.
presence of humans, we chose a pyroelectric detector “Ultrasonic Sensor with Voltage Output: User’s Guide.”
with a response range from 8 to 14 micrometers. Senix Corporation.

167