ARTIFICIAL PASSENGER
Presented By:
Y.Prabhavathi
16FE1A04G7
VIGNAN’S LARA
Institute of Technology And Science
Department of Electronics and communication
Introduction
IBM (International business machines corporation ,NY) has
developed a software that holds a conversation with the driver
to determine whether the driver can respond alertly enough,
called “Artificial passenger”.
This was designed to make long solo journeys safer and more
bearable.
Why Such System?
According to a national survey in UK and USA, it is observed
that the driver fatigue annually causes
10000 crashes
1500 deaths
7100 injuries
Majority of off-road accidents observed, were caused by eye
closure of half and even 2-3 seconds, where the normal
human eye blinks at 0.2-0.3 seconds
What is an Artificial Passenger?
Natural language e-companion.
Sleep preventive device in cars to overcome drowsiness.
Life safety system.
What does it Do?
Detects alarm conditions through sensors.
Broadcasts pre-stored voice messages over the speakers.
Captures images of the driver.
Condition Mobile Indicator
Sensor Device
(contd)
A camera built into the dashboard also tracks your lip
movements to improve the accuracy of speech recognition.
A voice analyzer then looks for signs of tiredness by
checking to see if the answer matches your profile. Slow
responses and lack of attention are signs of fatigue.
If you reply quickly and clearly, the system judges you to
be alert and tells the conversation planner to continue the
line of questioning.
About Artificial Passenger
The AP is an Artificial Intelligence based companion that will be
resident in software and chips embedded in the automobile
dashboard.
The system has a conversation planner that holds a profile of you,
including details of your interests and profession.
A microphone picks up your answer and breaks it down into
separate words with speech-recognition software.
A camera built into the dashboard also tracks your lip
movements to improve the accuracy of speech recognition.
A voice analyzer then looks for signs of tiredness by checking
to see if the answer matches your profile. Slow responses and
lack of attention are signs of fatigue.
If you reply quickly and clearly, the system judges you to be
alert and tells the conversation planner to continue the line of
questioning.
If your response is slow or doesn’t make sense, the voice
analyzer assumes you dropping off and acts to get your attention.
Devices used in Artificial Passenger
Eye tracker
Voice recognizer or speech recognizer
Natural language processor
Driver analyzer
Conversational planner
Alarm
Microphone
Camera
Working components
Eye tracker
Collecting eye movement data requires both hardware and
software
Hardware::Head-mounted systems or remote systems
Both systems measure the corneal reflection of the infrared
LED.Which illuminates and generates a reflection of the
eye.
This action causes the pupil to appear as a bright disk in
contrast to surrounding iris and creates a small glint
underneath the pupil which is used for calibration and
tracking
Monitoring System
Software
Data collection and analysis is handled by eye tracking
software.
Software catalogs eye tracking in one of the two ways.
ERICA’s Eye Gaze software uses a small red x to
represent eye movement.
In other, data is stored as a series of x/y coordinates
related to specific grid points on computer screen.
Eye Tracker
Automatic speech recognition
There are two ASRs used in the system
First one is “speaker independent” and used for
decoding voice signals of the driver.
Second one operates with car voice media and decodes
tapes ,audio,telephones,mails etc.
Natural language processor
• Processes the decoded signals of voice or text data
provided from the ASR.
• Identifies the related meanings from the contents of
the decoded messages.
• Produces variant of responses.
• This output goes to the driver analyzer as an input.
Driver Analyzer
• Receives the textual data and voice data.
• Measures the time response using a clock.
• Time responses ,conclusions about driver’s alertness
will be passed on to the conversational planner.
Conversational planner
• It is the heart of the system.
• Instructs the language generator to produce the
response.
• If the driver is in perfect condition CP instructs the
language generator to continue the conversation
otherwise it will be instructed to change the
conversation.
Alarm
• If the CP(conversational planner ) receives information
that the driver is about to fall asleep an alarm system is
activated.
Microphone
• For picking up the words and
separate them by some
internally used software
for conversation.
Camera
• This will track the lip movements of the driver.
• Used to improve the accuracy of the speech
recognition.
Showing the dashboard of the car where the whole artificial system
is generally attached.
Applications
• Interface with neighbour cars: -Determines if a driver
presents a high safety risk. For eg. Falling
asleep.tired,inexperienced or under the influence of
alcohol and signals the cars nearby to be careful of the
driver.
• Medical applications:-This system can monitor a driver
and detect if they are sick .for eg. having a stroke or
heart attack.
• In any problem it alerts the vehicles nearby ,so the
driver there can become alert.
(CONTD…)
• Opens and closes the doors and windows of the car
automatically.
• It is also used for the entertainment.
• Also used in cabins in airplanes ,trains,boats etc,
Future implementation
• Will provide us with shortest time routing based on road
conditions changing because of weather and
traffic,information about the cars on route, destination
requirement(flight has been delayed).
Conclusion
Method for monitoring driver alertness.
Sufficient time to avert an accident.
Successful implementation of artificial passenger
would allow use of various services in cars like reading
emails,navigation,downloading music files,voice
games etc without compromising on driver safety.
ANY
QURIES
?
THANK YOU
