Scribd
Upload
26 views20 pages

Topic4-Realtime Drowsiness Detection System Final

detection

Uploaded by

Kim Keat
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
26 views20 pages

Topic4-Realtime Drowsiness Detection System Final

detection

Uploaded by

Kim Keat
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 20

Salvatore Vitabile, Alessandra De Paola, Filippo Sorbello Department of Biopathology and Medical Biotechnology and Forensics, University of Palermo,

Italy

Journal of Ambient Intelligence and Humanized Computing Published on March 30, 2011

Chien-Chih(Paul) Chao Chih-Chiang(Michael) Chang Instructor: Dr. Ann Gordon-Ross


1 / 20

An embedded monitoring system to detect symptoms of drivers drowsiness.

2 / 20

Motivation Related works Drowsiness Monitoring System


Eye Regions Segmentation Candidate Eye Regions Selection Drivers Eyes Detection Drowsiness Level Computation

Experimental trials Conclusion Limitations & Future Work


3 / 20

10-20% of all European traffic accidents are due to the diminished level of attention caused by fatigue. In the trucking industry about 60% of vehicular accidents are related to driver hypo-vigilance. [1] Automotive has gained several benefit from the Ambient Intelligent researches involving the development of sensors and hardware devices

[1] Awake Consortium (IST 2000-28062), System for effective assessment of driver vigilance and warning according to traffic risk estimation (AWAKE), Sep 20012004 [Online], available: http://www.awake-eu.org

4 / 20

The technique categories for preventing drivers drowsiness [2]


Readiness-to-perform and fitness-for-duty

technologies Mathematical models of dynamics alertness Vehicle-based performance technologies


The lateral position Steering wheel movements time-to-line crossing

Real-time technologies for monitoring drivers status


Intrusive monitoring systems Non-intrusive monitoring systems
[2] Hartley L, Horberry T, Mabbott N, Krueger G (2000) Review of fatigue detection and prediction technologies. National Road Transport Commission report 642(54469)

5 / 20

The most accurate techniques are based on physiological measures


Brain waves

Heart rate
Pulse rate

Causing annoyance due to require electrodes to be attached to the drivers

6 / 20

A non-intrusive, real-time drowsiness detection system. Using FPGA instead of ASIC of DSP
Re-programmability Performance Costs

IR camera
Low light conditions Bright pupil phenomenon to detect the eyes
7 / 20

PERCLOS (Percentage of Eye Closure) The driver eyes are closed more than 80% within a specified time interval is defined as drowsiness. [3]

[3] W. W. Wierwille: Historical perspective on slow eyelid closure: Whence PERCLOS?, In Technical Proceedings Ocular Measures of Driver Alertness Conference, Federal Highway Admin., Office Motor Carrier Highway Safety, R. J. Carroll Ed. Washington, D.C., FHWA Tech. Rep. No. MC-99-136, 1999

8 / 20

Bright Pupil Threshold Operation

Clipping & Morphological Operation

9 / 20

A list of blobs
Possible Eye Pairs
Quasi-circular shape: Square Bounding Box R R=a
a

10 / 20

11 / 20

Frame 1
Coordinate At t
[ (X1, Y1) , (X2, Y2) ]

Frame 2
[ (X1, Y1) , (X2, Y2) ]

Frame 3
[ (X1, Y1) , (X2, Y2) ]

Frame 4
[ (X1, Y1) , (X2, Y2) ]

t=4 5
Class 2 1 Class 1

t=3
Class 1

t=2
Class 1 Class 4

t=1
Class 1 Class 5

Class

Class 2 0 1

Class 3 0

Weight

4 3

12 / 20

PERCLOS

18 consecutive frames w/o eyes (300 ms)

The alarm system is activated!


13 / 20

JSP DF-402 infrared-sensitive camera


Color camera in daytime Infrared camera under low light cond.

http://www.es.ele.tue.nl/education/oo2/fpga/board.php

14 / 20

Celoxica RC203E
XilinX XC2V3000-4 Virtex II FPGA Handel-C PixelStreams Library

http://www.es.ele.tue.nl/education/oo2/fpga/board.php

15 / 20

In light controlled environment Drive-Camera relative distance

ID =1

Not affected by driver-camera relative distance


16 / 20

Vertical and Horizontal of head movement

ID =2
17 / 20

Real operation condition (External illumination not controlled)

ID =3

18 / 20

An algorithm to detect and track the drivers eyes has been developed by exploiting bright pupils phenomenon Good performance on rapid movements of drivers head. Performance not affected by driver-camera relative distance. The drowsiness monitoring system can be used with low light conditions by using infrared camera
19 / 20

Faulty operations
the driver is wearing glasses the drivers IR-reflecting objects such as earring

Drowsiness usually happen during the evening/night hours


Light poles might be recognized as eye

candidates due to the shape and size on screen

20 / 20

You might also like