DRIVER DROWSINESS DETECTION SYSTEM

A
Project Report

Under the Supervision of

Dr. Deepak Arya
(Professor)
Department of Computer Science and Engineering

In partial fulfilment of the requirement

For the degree
of

BACHELOR OF TECHNOLOGY

DEPARTMENT OF COMPUTER SCIENCE & ENGINEERING

ROORKEE INSTITUTE OF TECHNOLOGY,
ROORKEE

(Affiliated to VMSB Uttarakhand Technical

University, Dehradun)

JUNE,2023
 Driver Drowsiness Detection System

DECLARATION

I, declare that the work embodied in this Project report is my own original work carried out by
me under the supervision of Dr. Deepak Arya Sir for the session 2022 - 2023 at Roorkee Institute
of Technology, Roorkee. The matter embodied in this Project report has not been submitted
elsewhere for the award of any other degree. I declare that I have faithfully acknowledged, given
credit to and referred to the researchers wherever the work has been cited in the text and the
body of the thesis. I further certify that I have not willfully lifted up some other’s work, Para,
text, data, results, etc. reported in the journals, books, magazines, reports, dissertations, thesis,
etc., or available at websites and have included them in this Project report and cited as my own
work.

Date: Name: Shubham Kumar Verma(190240101105)

Place:

Driver Drowsiness Detection System

 Driver Drowsiness Detection System

CERTIFICATE FROM THE SUPERVISOR/CO-SUPERVISOR

This is to certify that the Project Report entitled:

“DRIVER DROWSINESS DETECTION SYSTEM” in partial fulfilment of the requirement
for the award of degree of Bachelor of Technology and submitted in the department of
Computer Science of Roorkee Institute of Technology, Roorkee is an authentic record of my
own work carried out under the supervision of DR. DEEPAK ARYA.
Submitted by :
Shubham Kumar Verma(190240101105)

at Roorkee Institute of Technology, Roorkee for the degree of Bachelor of Technology in

Computer Science & Engineering is her original work carried out by her under my guidance and
supervision. This work is fully or partially has not been submitted for the award of any other
degree or diploma. The assistance and help taken during the course of the study has been duly
acknowledged and the source of literature amply recorded.

Supervisor Signature :
Supervisor Name :
Supervisor Designation :
Name of Department :
Date :

Driver Drowsiness Detection System

 Driver Drowsiness Detection System

ACKNOWLEDGEMENT

I am very happy to gently acknowledge the numerous personalities involved in lending their
help to make our project “DRIVER DROWSINESS DETECTION SYSTEM” a successful
one.

We take this opportunity to express our deep sense of gratitude to our honorable Director “DR.
PARAG JAIN” for providing an excellent academic climate in the college that made this
endeavour possible.

We give our wholehearted admiration and a deep sense sense of gratitude to “DR. DEEPAK
ARYA”, HOD, “COMPUTER SCIENCE & ENGINEERING”, Roorkee Institute of
Technology, Roorkee for his inspiration, valuable guidance, encouragement, suggestion, and
overall help throughout.

We express our sincere thanks to our guide “DR. DEEPAK ARYA”, HOD,
“COMPUTER SCIENCE & ENGINEERING”, Roorkee Institute of Technology, Roorkee, for
his keen interest and invaluable help throughout the project.

We would like to express our sincere thanks to our project coordinator “DR.DEEPAK ARYA”,
“HOD”, “COMPUTER SCIENCE & ENGINEERING”, Roorkee Institute of Technology,
Roorkee, for his kind support and encouragement throughout this course of work.

Finally, we express our gratitude to all the Teaching and Non-Teaching staff of “COMPUTER
SCIENCE & ENGINEERING”, Roorkee Institute of Technology, Roorkee for their timely
support and suggestions.

Date: Shubham Kumar Verma(190240101105)

Driver Drowsiness Detection System

 Driver Drowsiness Detection System

ABSTRACT
• This document is a review report on the research conducted and the project made in the
field of computer engineering to develop a system for driver drowsiness detection to
prevent accidents from happening because of driver fatigue and sleepiness. The report
proposed the results and solutions on the limited implementation of the various
techniques that are introduced in the project. Whereas the implementation of the
project gives the real-world idea of how the system works and what changes can be done
to improve the utility of the overall system.

• Furthermore, the paper states the overview of the observations made by the authors to
help further optimization in the mentioned field to achieve the utility at a better
efficiency for a safer road.

• This project describes on how to detect the eyes and mouth in a video recorded from
the experiment conducted by MIROS (Malaysian Institute of Road Safety). In the video,
a participant will drive the driving simulation system and a webcam will be place in front
of the driving simulator. The video will be recorded using the webcam to see the
transition from awake to fatigue and finally, drowsy. The designed system deals with
detecting the face area of the image captured from the video. The purpose of using the
face area so it can narrow down to detect eyes and mouth within the face area. Once
the face is found, the eyes and mouth are found by creating the eye for left and right
eye detection and mouth detection. The parameters of the eyes and mouth detection
are created within the face image. The video was change into images frames per second.
From there, locating the eyes and mouth can be performed. Once the eyes are located,
measuring the intensity changes in the eye area determine the eyes are open or closed.
If the eyes are found closed for 4 consecutive frames, it is confirmed that the driver is in
drowsiness condition.

Driver Drowsiness Detection System

 Driver Drowsiness Detection System

Definitions, Acronyms, and Abbreviations

Abbreviation Description

WHO World Health Organization

CNN Convolutional Neural Networks

R-CNN Regional Convolutional Neural Network

FASTER RCNN Faster Regional Convolutional Neural Network

FASTER RCNN

Driver Drowsiness Detection System

 Driver Drowsiness Detection System

Table of Contents
1. PROJECT INTRODUCTION ....................................................................................................................................... 7
1.2 PROBLEM STATEMENT ................................................................................................................................................ 8
1.3 THE INTENDED AUDIENCE .................................................................................................................................................9
1.4 ADVANTAGE OF PROJECT ..................................................................................................................................................9
1.5 SCOPE OF PROJECT ......................................................................................................................................................... 9
1.6 TOOLS & TECHNOLOGY USED .......................................................................................................................................... 10

2. LITERATURE REVIEW ............................................................................................................................................. 13

2.1.Vehicle-Based Measures ............................................................................................................................................ 15
2.2.Behavioral Measures ................................................................................................................................................. 16
3. PROJECT DESCRIPTION .......................................................................................................................................... 17
3.2 DESIGN & METHODOLOGY ............................................................................................................................................... 19
3.2.1 Flow Chart ............................................................................................................................................................... 19
3.2.2 Block Diagram/ Machine Diagram ......................................................................................................................... 20
3.3 WORKING OF PROJECT ........................................................................................................................................................ 22
3.3.1 Circuit Diagram/ Assembled View ..................................................................................................................... 25
3.3.2 Hardware Description (if any) .......................................................................................................................... 25
3.3.3 Software Programming (if any) ...................................................................................................................... 26
3.3.4 Building a CNN model ............................................................................................................................................. 30
3.4 SNAPSHOTS ...................................................................................................................................................................... 38
3.5.2. Vehicle-Based Measures ........................................................................................................................................ 50
3.5.3. Behavioral Measures ............................................................................................................................................. 51
4 RESULTS & OBSERVATIONS .................................................................................................................................... 52
5 FUTURE SCOPE ....................................................................................................................................................... 57

6 CONCLUSION ......................................................................................................................................................... 58
7 REFERENCES ........................................................................................................................................................... 59

Driver Drowsiness Detection System Page |6

 Driver Drowsiness Detection System

CHAPTER-1
PROJECT INFORMATION

1.1 Purpose

1.1.1 Human Psychology with current technology

• Humans have always invented machines and devised techniques to ease and protect their
lives, for mundane activities like traveling to work, or for more interesting purposes like
aircraft travel. With the advancement in technology, modes of transportation kept on
advancing and our dependency on it started increasing exponentially. It has greatly affected
our lives as we know it. Now, we can travel to places at a pace that even our grandparents
wouldn’t have thought possible. In modern times, almost everyone in this world uses some
sort of transportation every day. Some people are rich enough to have their own vehicles
while others use public transportation. However, there are some rules and codes of
conduct for those who drive irrespective of their social status. One of them is staying alert
and active while driving. Neglecting our duties towards safer travel has enabled hundreds
of thousands of tragedies to get associated with this wonderful invention every year. It may
seem like a trivial thing to most folks but following rules and regulations on the road is of
utmost importance. While on road, an automobile wields the most power and in
irresponsible hands, it can be destructive and sometimes, that carelessness can harm lives
even of the people on the road. One kind of carelessness is not admitting when we are too
tired to drive. In order to monitor and prevent a destructive outcome from such
negligence, many researchers have written research papers on driver drowsiness detection
systems. But at times, some of the points and observations made by the system are not
accurate enough. Hence, to provide data and another perspective on the problem at hand,
in order to improve their implementations and to further optimize the solution, this project
has been done.

1.1.2 Facts and Statistics

• Our current statistics reveal that just in 2015 in India alone, 148,707 people died due to car
related accidents. Of these, at least 21 percent were caused due to fatigue causing drivers
to make mistakes. This can be a relatively smaller number still, as among the multiple
causes that can lead to an accident, the involvement of fatigue as a cause is generally
grossly underestimated. Fatigue combined with bad infrastructure in developing countries
like India is a recipe for disaster. Fatigue, in general, is very difficult to measure or observe

Driver Drowsiness Detection System Page |7

 Driver Drowsiness Detection System

unlike alcohol and drugs, which have clear key indicators and tests that are available easily.
Probably, the best solutions to this problem are awareness about fatigue-related accidents
and promoting drivers to admit fatigue when needed. The former is hard and much more
expensive to achieve, and the latter is not possible without the former as driving for long
hours is very lucrative. When there is an increased need for a job, the wages associated
with it increases leading to more and more people adopting it. Such is the case for driving
transport vehicles at night. Money motivates drivers to make unwise decisions like driving
all night even with fatigue. This is mainly because the drivers are not themselves aware of
the huge risk associated with driving when fatigued. Some countries have imposed
restrictions on the number of hours a driver can drive at a stretch, but it is still not
enough to solve this problem as its implementation is very difficult and costly.

1.1.3 Background of study

Driver drowsiness detection is a car safety technology which helps prevent accidents
caused by the driver getting drowsy. Various studies have suggested that around 20% of all
road accidents are fatigue-related, up to 50% on certain roads. Some of the current systems
learn driver patterns and can detect when a driver is becoming drowsy.

1.2 Problem Statement

• Fatigue is a safety problem that has not yet been deeply tackled by any country in the world
mainly because of its nature. Fatigue, in general, is very difficult to measure or observe
unlike alcohol and drugs, which have clear key indicators and tests that are available easily.
Probably, the best solutions to this problem are awareness about fatigue-related accidents
and promoting drivers to admit fatigue when needed. The former is hard and much more
expensive to achieve, and the latter is not possible without the former as driving for long
hours is very lucrative

• Current drowsiness detection systems monitoring the driver’s condition requires complex
computation and expensive equipment, not comfortable to wear during driving and is not
suitable for driving conditions; for example, Electroencephalography (EEG) and
Electrocardiography (ECG), I. e. detecting the brain frequency and measuring the rhythm
of heart, respectively.

• A drowsiness detection system which uses a camera placed in front of the driver is more
suitable to be use but the physical signs that will indicate drowsiness need to be located
first in order to come up with a drowsiness detection algorithm that is reliable and accurate.
Lighting intensity and while the driver tilts their face left or right are the problems occur
during detection of eyes and mouth region.

Driver Drowsiness Detection System Page |8

 Driver Drowsiness Detection System

• Therefore, this project aims to analyse all the previous research and method, hence
propose a method to detect drowsiness by using video or webcam. It analyses the video
images that have been recorded and come up with a system that can analyse each frame
of the video Project Objective

1.3 The Intended Audience

The intended audience for this document is the development team, the project evaluation jury,
and other tech-savvy enthusiast who Wish to further work on the project.

1.4 Advantage of Project

• The Drowsiness Detection System developed based on eye closure of the driver can
differentiate normal eye blink and drowsiness and detect the drowsiness while driving. The
proposed system can prevent the accidents due to the sleepiness while driving. The system
works well even in case of drivers wearing spectacles and even under low light conditions
if the camera delivers better output

• During the monitoring, the system is able to decide if the eyes are opened or closed. When
the eyes have been closed for too long, a warning signal is issued. processing judges the
driver’s alertness level on the basis of continuous eye closures

• The driver abnormality monitoring system developed is capable of detecting drowsiness,

drunken and reckless behaviours of driver in a short time

1.5 Scope of Project

• In this project, the author will focus on these following procedures: Basic concept of
drowsiness detection system Familiarize with the signs of drowsiness Determine the
drowsiness from these parameters - Eye blink - Area of the pupils detected at eyes -
Yawning Data collection and measurement. Integration of the methods chosen. Coding
development and testing. Complete testing and improvement

• There are many products out there that provide the measure of fatigue level in the drivers
which are implemented in many vehicles. The driver drowsiness detection system provides
the similar functionality but with better results and additional benefits. Also, it alerts the
user on reaching a certain saturation point of the drowsiness measure

Driver Drowsiness Detection System Page |9

 Driver Drowsiness Detection System

1.6 Tools & Technology Used

Python: -
Python is a high-level, interpreted, general-purpose programming language. Its design philosophy
emphasizes code readability with the use of significant indentation.

Python is dynamically typed, and garbage collected. It supports multiple programming paradigms,
including structured (particularly procedural), object-oriented and functional programming. It is
often described as a "batteries included" language due to its comprehensive standard library.

Guido van Rossum began working on Python in the late 1980s as a successor to the ABC
programming language and first released it in 1991 as Python 0.9.0. Python 2.0 was released in
2000 and introduced new features such as list comprehensions, cycle-detecting garbage collection,
reference counting, and Unicode support. Python 3.0, released in 2008, was a major revision that
is not completely backward compatible with earlier versions. Python 2 was discontinued with
version 2.7.18 in 2020.

Python consistently ranks as one of the most popular programming languages.

PyCharm: -
PyCharm is an integrated development environment (IDE) used in computer programming,
specifically for the Python programming language. The Czech company JetBrains (formerly known
as IntelliJ) develops it. It provides code analysis, a graphical debugger, an integrated unit tester,
integration with version control systems (VCSeZ), and supports web development with Django as
well as data science with Anaconda.

PyCharm is cross-platform, with Windows, macOS and Linux versions. The Community Edition is
released under the Apache License, and there is also an educational version, as well as a
Professional Edition with extra features (released under a subscription-funded proprietary license)

OpenCV: -
OpenCV is the huge open-source library for the computer vision, machine learning, and image
processing and now it plays a major role in real-time operation which is very important in today’s
systems. By using it, one can process images and videos to identify objects, faces, or even

Driver Drowsiness Detection System Page |10

 Driver Drowsiness Detection System

handwriting of a human. When it integrated with various libraries, such as NumPy, python can
process the OpenCV array structure for analysis. To Identify image pattern and its various features
we use vector space and perform mathematical operations on these features.

The first OpenCV version was 1.0. OpenCV is released under a BSD license and hence it’s free for
both academic and commercial use. It has C++, C, Python and Java interfaces and supports
Windows, Linux, Mac OS, iOS and Android. When OpenCV was designed the main focus was real
time applications for computational efficiency. All things are written in optimized C/C++ to take
advantage of multi-core processing.

Machine Learning: -
Machine Learning is the field of study that gives computers the capability to learn without being
explicitly programmed. ML is one of the most exciting technologies that one would have ever come
across. As it is evident from the name, it gives the computer that makes it more like humans: The
ability to learn. Machine learning is actively being used today, perhaps in many more places than
one would expect.

Driver Drowsiness Detection System Page |11

 Driver Drowsiness Detection System

Image Processing: -
Image processing is the process of transforming an image into a digital form and performing certain
operations to get some useful information from it. The image processing system usually treats all
images as 2D signals when applying certain predetermined signal processing methods.

There are five main types of image processing:

• Visualization - Find objects that are not visible in the image

• Recognition - Distinguish or detect objects in the image
• Sharpening and restoration - Create an enhanced image from the original image
• Pattern recognition - Measure the various patterns around the objects in the image
• Retrieval - Browse and search images from a large database of digital images that are like
the original image

Driver Drowsiness Detection System Page |12

 Driver Drowsiness Detection System

CHAPTER-2
2. Literature Review

This survey is done to comprehend the need and prerequisite of the general population, and to
do as such, we went through different sites and applications and looked for the fundamental data.
Based on these data, we made an audit that helped us get new thoughts and make different
arrangements for our task. We reached the decision that there is a need of such application and
felt that there is a decent extent of progress in this field too

The developed system is a real time system. It uses image processing for eye and face detection.
HAAR based cascade classifier is used for face detection. An algorithm to track objects is used to
track the eyes continuously. In order to identify the drowsy state of the driver, the PERCLOS
algorithm issued [2]. The paper focuses on developing a non- intrusive system which can detect
fatigue and issue a warning on time. The system will monitor the drivers eyes using a camera. By
developing an algorithm, the symptoms of driver fatigue can be detected early enough to avoid
accident. When the signs of fatigue have been identified output in the form of sound and seat belt
vibration is provided to alert the driver. Warning will be deactivated manually rather than
automatically. This paper uses a faster algorithm than PERCLOS. This system will detect drivers
fatigue by the processing of the eye region. After image acquisition, the first stage of processing is
face detection. If eyes are blinking

visual, non-visual, and vehicular features into one. The last idea is to develop wearable hardware
such as smart watches in order to detect drowsiness

Driver Drowsiness Detection System Page |13

 Driver Drowsiness Detection System

CHAPTER-3

3. Method for measuring Drowsiness

Researchers have used various methods to measure driver drowsiness. This section provides a
review of the four most widely used methods, among which the first method is measured either
verbally or through questionnaire and the remaining three by means of various sensors.

3.1 Subjective Measures

Subjective measures that evaluate the level of drowsiness are based on the driver’s personal
estimation and many tools have been used to translate this rating to a measure of driver
drowsiness. The most commonly used drowsiness scale is the Karolinska Sleepiness Scale (KSS), a
nine-point scale that has verbal anchors for each step, as shown in Table 1. Hu et al. measured the
KSS ratings of drivers every 5 min and used it as a reference to the EoG signal collected. Portouli et
al. evaluated EEG data by confirming driver drowsiness through both a questionnaire and a
licensed medical practitioner. Some researchers compared the self-determined KSS, which was
recorded every 2 min during the driving task, with the variation of lane position (VLP) and found
that these measures were not in agreement. Ingre et al. determined a relationship between the
eye blink duration and the KSS collected every 5 min during the driving task.

Driver Drowsiness Detection System Page |14

 Driver Drowsiness Detection System

Researchers have determined that major lane departures, high eye blink duration and drowsiness
related physiological signals are prevalent for KSS ratings between 5 and 9. However, the subjective
rating does not fully coincide with vehicle-based, physiological and behavioural measures.

Because the level of drowsiness is measured approximately every 5 min, sudden variations cannot
be detected using subjective measures. Another limitation to using subjective ratings is that the
self-introspection alerts the driver, thereby reducing their drowsiness level. In addition, it is
difficult to obtain drowsiness feedback from a driver in a real driving situation. Therefore, while
subjective ratings are useful in determining drowsiness in a simulated environment, the remaining
measures may be better suited for the detection of drowsiness in a real environment.

3.2. Vehicle-Based Measures

Another method to measure driver drowsiness involves vehicle-based measurements. In most

cases, these measurements are determined in a simulated environment by placing sensors on
various vehicle components, including the steering wheel and the acceleration pedal; the signals
sent by the sensors are then analysed to determine the level of drowsiness. Liu et al. published a
review on current vehicle-based measures. Some researchers found that sleep deprivation can
result in a larger variability in the driving speed. However, the two most used vehicle-based
measures are the steering wheel movement and the standard deviation of lane position.

Steering Wheel Movement (SWM) is measured using steering angle sensor and it is a widely used
vehicle-based measure for detecting the level of driver drowsiness [32,33,36]. Using an angle
sensor mounted on the steering column, the driver’s steering behaviour is measured. When
drowsy, the number of micro-corrections on the steering wheel reduces compared to normal
driving. Fairclough and Graham found that sleep deprived drivers made fewer steering wheel
reversals than normal drivers. To eliminate the effect of lane changes, the researchers considered
only small steering wheel movements (between 0.5° and 5°), which are needed to adjust the lateral
position within the lane. Hence, based on small SWMs, it is possible to determine the drowsiness
state of the driver and thus provide an alert if needed. In a simulated environment, light side winds
that pushed the car to the right side of the road were added along a curved road in order to create
variations in the lateral position and force the drivers to make corrective SWMs. Car companies,
such as Nissan and Renault, have adopted SWMs but it works in very limited situations. This is
because they can function reliably only at particular environments and are too dependent on the
geometric characteristics of the road and to a lesser extent on the kinetic characteristics of the
vehicle.

Driver Drowsiness Detection System Page |15

 Driver Drowsiness Detection System

Standard Deviation of Lane Position (SDLP) is another measure through which the level of driver
drowsiness can be evaluated. In a simulated environment, the software itself gives the SDLP and
in case of field experiments the position of lane is tracked using an external camera. Ingra et al.
conducted an experiment to derive numerical statistics based on SDLP and found that, as KSS
ratings increased, SDLP (meters) also increased. For example, KSS ratings of 1, 5, 8, and 9
corresponded to SDLP measurements of 0.19, 0.26, 0.36 and 0.47, respectively. The SDLP was
calculated based on the average of 20 participants; however, with some drivers, the SDLP did not
exceeded 0.25 m even for a KSS rating of 9. In the above experiment by performing correlation
analysis on a subject-to-subject basis significant difference is noted. Another limitation of SDLP is
that it is purely dependent on external factors like road marking, climatic and lighting conditions.
In summary, many studies have determined that vehicle-based measures are a poor predictor of
performance error risk due to drowsiness. Moreover, vehicular-based metrics are not specific to
drowsiness. SDLP can also be caused by any type of impaired driving, including driving under the
influence of alcohol or other drugs, especially depressants

3.3. Behavioral Measures

A drowsy person displays several characteristic facial movements, including rapid and constant
blinking, nodding or swinging their head, and frequent yawning. Computerized, non-intrusive,
behavioral approaches are widely used for determining the drowsiness level of drivers by
measuring their abnormal behaviors. Most of the published studies on using behavioral
approaches to determine drowsiness, focus on blinking. PERCLOS (which is the percentage of
eyelid closure over the pupil over time, reflecting slow eyelid closures, or “droops”, rather than
blinks) has been analysed in many studies. This measurement has been found to be a reliable
measure to predict drowsiness and has been used in commercial products such as Seeing Machines
and Lexus. Some researchers used multiple facial actions, including inner brow rise, outer brow
rise, lip stretch, jaw drop and eye blink, to detect drowsiness. However, research on using other
behavioral measures, such as yawning and head or eye position orientation, to determine the level
of drowsiness is ongoing.

Driver Drowsiness Detection System Page |16

 Driver Drowsiness Detection System

3. Project Description
3.1 Introduction & Working Principle

Driver drowsiness detection is a car safety technology which prevents accidents when the driver is
getting drowsy. Numerous studies have suggested that around 20% of all road accidents are
fatigue-related, up to 50% on certain roads. Driver fatigue is a significant factor in a large number
of vehicle accidents. Recent statistics estimate that annually 1,200 deaths and 76,000 injuries can
be attributed to fatigue related crashes. The development of technologies for detecting or
preventing drowsiness at the wheel is a major challenge in the field of accident-avoidance systems.
Because of the hazard that drowsiness presents on the road, methods need to be developed for
counteracting its affects. Driver inattention might be the result of a lack of alertness when driving
due to driver drowsiness and distraction. Driver distraction occurs when an object or event draws
a person’s attention away from the driving task. Unlike driver distraction, driver drowsiness
involves no triggering event but, instead, is characterized by a progressive withdrawal of attention
from the road and traffic demands. Both driver drowsiness and distraction, however, might have
the same effects, i.e., decreased driving performance, longer reaction time, and an increased risk
of crash involvement. shows the block diagram of overall system. Based on Acquisition of video
from the camera that is in front of driver perform real-time processing of an incoming video stream
to infer the driver’s level of fatigue if the drowsiness is Estimated then it will give the alert by
sensing the eyes.

3.1.1 Existing System

Here we are used SVM (support vector machine) to classify the components in the input video.
While cropping the region of interest components in the video is not accurate. Sometimes it will
show regions wrong. To sense the eyes first we have to create boundary boxes for that and a
classification algorithm. The algorithm of SVM will not support.

3.1.2 Proposed Method

There are several different algorithms and methods for eye tracking, and monitoring. Most of them
in some way relate to features of the eye (typically reflections from the eye) within a video image
of the driver. The original aim of this project was to use the retinal reflection as a means to find
the eyes on the face, and then using the absence of this reflection as a way of detecting when the
eyes are closed. Applying this algorithm on consecutive video frames may aid in the calculation of

Driver Drowsiness Detection System Page |17

 Driver Drowsiness Detection System

eye closure period. Eye closure period for drowsy drivers is longer than normal blinking. It is also
extraordinarily little, longer time could result in severe crash. So, we will warn the driver as soon
as closed eye is detected.

3.1.3 Block Diagram

Driver Drowsiness Detection System Page |18

 Driver Drowsiness Detection System

3.2 Design & Methodology

3.2.1 Flow Chart

Driver Drowsiness Detection System Page |19

 Driver Drowsiness Detection System

3.2.2 Block Diagram/ Machine Diagram

Driver Drowsiness Detection System Page |20

 Driver Drowsiness Detection System

3.2.3 Design Calculation

The framework is created utilizing the incremental model. The center model of the framework is
first created and afterwards augmented in this way in the wake of testing at each turn. The
underlying undertaking skeleton was refined into expanding levels of ability.

At the following incremental level, it might incorporate new execution backing and improvement

Driver Drowsiness Detection System Page |21

 Driver Drowsiness Detection System

3.3 Working of Project

In this Python project, we will be using OpenCV for gathering the images from webcam and feed
them into a Deep Learning model which will classify whether the person’s eyes are ‘Open’ or
‘Closed.’ The approach we will be using for this Python project is as follows:

Step 1 – Take image as input from a camera.

With a webcam, we will take images as input. So to access the webcam, we made an infinite loop
that will capture each frame. We use the method provided by OpenCV, cv2.VideoCapture(0) to
access the camera and set the capture object (cap). cap.read() will read each frame and we store
the image in a frame variable.

Step 2 – Detect the face in the image and create a Region of Interest (ROI).

To detect the face in the image, we need to first convert the image into grayscale as the OpenCV
algorithm for object detection takes gray images in the input. We don’t need color information to
detect the objects. We will be using haar cascade classifier to detect faces. This line is used to set
our classifier face = cv2.CascadeClassifier(‘ path to our haar cascade xml file’). Then we perform
the detection using faces = face.detectMultiScale(gray). It returns an array of detections with x,y
coordinates, and height, the width of the boundary box of the object. Now we can iterate over the
faces and draw boundary boxes for each face.

Step 3 – Detect the eyes from ROI and feed it to the classifier.

The same procedure to detect faces is used to detect eyes. First, we set the cascade classifier for
eyes in leye and reye respectively then detect the eyes using left eye = leye.detectMultiScale(gray).
Now we need to extract only the eyes data from the full image. This can be achieved by extracting
the boundary box of the eye and then we can pull out the eye image from the frame with this code

Step 4 – Classifier will categorize whether eyes are open or closed.

We are using CNN classifier for predicting the eye status. To feed our image into the model, we
need to perform certain operations because the model needs the correct dimensions to start with.

Driver Drowsiness Detection System Page |22

 Driver Drowsiness Detection System

First, we convert the color image into grayscale using r_eye = cv2.cvtColor(r_eye,
cv2.COLOR_BGR2GRAY). Then, we resize the image to 24*24 pixels as our model was trained on
24*24 pixel images cv2.resize(r_eye, (24,24)). We normalize our data for better convergence r_eye
= r_eye/255 (All values will be between 0-1). Expand the dimensions to feed into our classifier. We
loaded our model using model = load_model(‘models/cnnCat2.h5’) . Now we predict each eye with
our model lpred = model.predict_classes(l_eye). If the value of lpred[0] = 1, it states that eyes are
open, if value of lpred[0] = 0 then, it states that eyes are closed.

Step 5 – Calculate score to check whether the person is drowsy

The score is basically a value we will use to determine how long the person has closed his eyes. So
if both eyes are closed, we will keep on increasing score and when eyes are open, we decrease the
score. We are drawing the result on the screen using cv2.putText() function which will display real
time status of the person.

The dataset used for this model is created by us. To create the dataset, we wrote a script that
captures eyes from a camera and stores in our local disk. We separated them into their respective
labels ‘Open’ or ‘Closed’. The data was manually cleaned by removing the unwanted images which
were not necessary for building the model. The data comprises around 7000 images of people’s
eyes under different lighting conditions. After training the model on our dataset, we have attached
the final weights and model architecture file “models/cnnCat2.h5

The model we used is built with Keras using Convolutional Neural Networks (CNN). A convolutional
neural network is a special type of deep neural network which performs extremely well for image
classification purposes. A CNN basically consists of an input layer, an output layer and a hidden
layer which can have multiple layers. A convolution operation is performed on these layers using
a filter that performs 2D matrix multiplication on the layer and filter.

The CNN model architecture consists of the following layers:

Convolutional layer; 32 nodes, kernel size 3

Convolutional layer; 32 nodes, kernel size 3
Convolutional layer; 64 nodes, kernel size 3
Fully connected layer; 128 nodes

Driver Drowsiness Detection System Page |23

 Driver Drowsiness Detection System

The final layer is also a fully connected layer with 2 nodes. A Relu activation function is used in all
the layers except the output layer in which we used Softmax.

Driver Drowsiness Detection System Page |24

 Driver Drowsiness Detection System

3.3.1 Circuit Diagram/ Assembled View

3.3.2 Hardware Description (if any)

Webcam: -
A webcam is a video camera that feeds or streams an image or video in real time to or through a
computer network, such as the Internet. Webcams are typically small cameras that sit on a desk,
attach to a user's monitor, or are built into the hardware. Webcams can be used during a video
chat session involving two or more people, with conversations that include live audio and video.

Driver Drowsiness Detection System Page |25

 Driver Drowsiness Detection System

Webcam software enables users to record a video or stream the video on the Internet. As video
streaming over the Internet requires much bandwidth, such streams usually use compressed
formats. The maximum resolution of a webcam is also lower than most handheld video cameras,
as higher resolutions would be reduced during transmission. The lower resolution enables
webcams to be relatively inexpensive compared to most video cameras, but the effect is adequate
for video chat sessions.[1]

The term "webcam" (a clipped compound) may also be used in its original sense of a video camera
connected to the Web continuously for an indefinite time, rather than for a particular session,
generally supplying a view for anyone who visits its web page over the Internet. Some of them, for
example, those used as online traffic cameras, are expensive, rugged professional video cameras.

Laptop: -
Memory: 16 GB RAM is the minimum, I repeat, the minimum. 32 GB or 64 GB is obviously better,
but most laptops don’t come with that as a standard. Check if it supports adding extra RAM. It’s
the single most important piece of hardware for data science, both for holding large datasets in
memory and running VMs. CPU: Core i7 or equivalent.

3.3.3 Software Programming (if any)

Python: -
Python is an interpreted, object-oriented, high-level programming language with dynamic
semantics. Its high-level built in data structures, combined with dynamic typing and dynamic
binding, make it very attractive for Rapid Application Development, as well as for use as a scripting
or glue language to connect existing components together. Python's simple, easy to learn syntax
emphasizes readability and therefore reduces the cost of program maintenance. Python supports
modules and packages, which encourages program modularity and code reuse. The Python
interpreter and the extensive standard library are available in source or binary form without charge
for all major platforms, and can be freely distributed.

Often, programmers fall in love with Python because of the increased productivity it provides. Since
there is no compilation step, the edit-test-debug cycle is incredibly fast. Debugging Python
programs is easy: a bug or bad input will never cause a segmentation fault. Instead, when the
interpreter discovers an error, it raises an exception. When the program doesn't catch the
exception, the interpreter prints a stack trace. A source level debugger allows inspection of local
and global variables, evaluation of arbitrary expressions, setting breakpoints, stepping through the

Driver Drowsiness Detection System Page |26

 Driver Drowsiness Detection System

code a line at a time, and so on. The debugger is written in Python itself, testifying to Python's
introspective power. On the other hand, often the quickest way to debug a program is to add a
few print statements to the source: the fast edit-test-debug cycle makes this simple approach very
effective.

PlaySound: -
The playsound module contains only one thing - the function (also named) playsound.

It requires one argument - the path to the file with the sound you’d like to play. This may be a local
file, or a URL.

There’s an optional second argument, block, which is set to True by default. Setting it to False
makes the function run asynchronously.

On Windows, uses windll.winmm. WAVE and MP3 have been tested and are known to work. Other
file formats may work as well.

On OS X, uses AppKit.NSSound. WAVE and MP3 have been tested and are known to work. In
general, anything QuickTime can play, playsound should be able to play, for OS X.

On Linux, uses GStreamer. Known to work on Ubuntu 14.04 and ElementaryOS Loki. I expect any
Linux distro with a standard gnome desktop experience should work.

If you’d like other Linux distros (or any other OS) to work, submit a PR adding in support for it, but
please make sure it passes the tests

Numpy: -
NumPy, which stands for Numerical Python, is a library consisting of multidimensional array objects
and a collection of routines for processing those arrays. Using NumPy, mathematical and logical
operations on arrays can be performed. This tutorial explains the basics of NumPy such as its
architecture and environment. It also discusses the various array functions, types of indexing, etc.
An introduction to Matplotlib is also provided. All this is explained with the help of examples for
better understanding.

Dlib: -
Dlib is principally a C++ library, however, you can use a number of its tools from python
applications. This page documents the python API for working with these dlib tools. If you haven’t

Driver Drowsiness Detection System Page |27

 Driver Drowsiness Detection System

done so already, you should probably look at the python example programs first before consulting
this reference. These example programs are little mini-tutorials for using dlib from python. They
are listed on the left of the main dlib web page.

Scipy: -
SciPy (pronounced /ˈsaɪpaɪ/ "sigh pie"[3]) is a free and open-source Python library used for
scientific computing and technical computing.

SciPy contains modules for optimization, linear algebra, integration, interpolation, special
functions, FFT, signal and image processing, ODE solvers and other tasks common in science and
engineering.

SciPy is also a family of conferences for users and developers of these tools: SciPy (in the United
States), EuroSciPy (in Europe) and SciPy.in (in India).[5] Enthought originated the SciPy conference
in the United States and continues to sponsor many of the international conferences as well as
host the SciPy website.

The SciPy library is currently distributed under the BSD license, and its development is sponsored
and supported by an open community of developers. It is also supported by NumFOCUS, a
community foundation for supporting reproducible and accessible science.

The SciPy package is at the core of Python's scientific computing capabilities. Available subpackages
include:

cluster: hierarchical clustering, vector quantization, K-means

constants: physical constants and conversion factors fft:
Discrete Fourier Transform algorithms fftpack: Legacy
interface for Discrete Fourier Transforms integrate:
numerical integration routines interpolate: interpolation
tools io: data input and output linalg: linear algebra routines
misc: miscellaneous utilities (e.g. example images)
ndimage: various functions for multi-dimensional image processing
ODR: orthogonal distance regression classes and algorithms optimize:
optimization algorithms including linear programming signal: signal
processing tools sparse: sparse matrices and related algorithms
spatial: algorithms for spatial structures such as k-d trees, nearest
neighbors, convex hulls, etc.
special: special functions stats: statistical functions weave: tool for writing C/C++ code as Python
multiline strings (now deprecated in favor of Cython

Driver Drowsiness Detection System Page |28

 Driver Drowsiness Detection System

OpenCV: -
OpenCV (Open Source Computer Vision Library) is a library of programming functions mainly aimed
at real-time computer vision.[1] Originally developed by Intel, it was later supported by Willow
Garage then Itseez (which was later acquired by Intel[2]). The library is cross-platform and free for
use under the open-source Apache 2 License. Starting with 2011, OpenCV features GPU
acceleration for real-time operations.

OpenCV is written in C++ and its primary interface is in C++, but it still retains a less comprehensive
though extensive older C interface. All of the new developments and algorithms appear in the C++
interface. There are bindings in Python, Java and MATLAB/OCTAVE. The API for these interfaces
can be found in the online documentation.[12] Wrappers in several programming languages have
been developed to encourage adoption by a wider audience. In version 3.4, JavaScript bindings for
a selected subset of OpenCV functions was released as OpenCV.js, to be used for web platforms

Pygame: -
Pygame is a cross-platform set of Python modules designed for writing video games. It includes
computer graphics and sound libraries designed to be used with the Python programming language

Pygame was originally written by Pete Shinners to replace PySDL after its development stalled. It
has been a community project since 2000 and is released under the free software GNU Lesser
General Public License (which "provides for Pygame to be distributed with open source and
commercial software

Pygame uses the Simple Direct Media Layer (SDL) library,[a] with the intention of allowing realtime
computer game development without the low-level mechanics of the C programming language
and its derivatives. This is based on the assumption that the most expensive functions inside games
can be abstracted from the game logic, making it possible to use a high-level programming
language, such as Python, to structure the game.

Other features that SDL does have include vector math, collision detection, 2D sprite scene graph
management, MIDI support, camera, pixel-array manipulation, transformations, filtering,
advanced free type font support, and drawing.

Applications using Pygame can run on Android phones and tablets with the use of Pygame Subset
for Android (pgs4a). Sound, vibration, keyboard, and accelerometer are supported on Android.

Driver Drowsiness Detection System Page |29

 Driver Drowsiness Detection System

Imutils: -
Imutils is a series of functions to implement basic image processing functions such as translation,
rotation, resizing, displaying Matplotlib images, detecting edges, and much more easier with
OpenCV.

To install imutils, you should already have NumPy, SciPy, Matplotlib, and OpenCV installed. To
install these modules into your python environment, run the following commands in the terminal.

3.3.4 Building a CNN model

The implementation uses a custom-designed Convolutional Neural Network that has the following
characteristics —

• Three Convolution Blocks having 2, 3, and 3 convolutional layers, respectively.

• A Batch Normalization Layer follows each Convolution Layer.
• A Dropout Layer follows each Convolution Block for avoiding overfitting and a MaxPool
Layer.
• Fully Connected Layers follow convolution Layers for classification.

Driver Drowsiness Detection System Page |30

 Driver Drowsiness Detection System

Defining the model using Keras —

Driver Drowsiness Detection System Page |31

 Driver Drowsiness Detection System

Loading the dataset —

Training the Model ---

Driver Drowsiness Detection System Page |32

 Driver Drowsiness Detection System

Model training runs for a total of 200 epochs with a batch size of 128. ImageDataGenerator is used
for randomizing the training images for better performance of the model.

Performance of the Model: -

The following Performance Metrics are used —

Loss vs Number of Epochs Plot

Accuracy vs Number of Epochs Plot
Classification Report
Confusion Matrix
The results of the metrics mentioned above are as follows —

Driver Drowsiness Detection System Page |33

 Driver Drowsiness Detection System

Classification Report —

Confusion Matrix —

Driver Drowsiness Detection System Page |34

 Driver Drowsiness Detection System

Evaluating the Model: -

The predictions of the model on images of eyes can be seen in the following pictures —

Building a Pipeline for Predictions on Full Face Images

This project’s last and final step is to build a pipeline for making predictions on full-face images.
The channel includes Face detection, face alignment, eyes detection, preprocessing the ROI of the
image, passing to the model for prediction and displaying results on the image.

Driver Drowsiness Detection System Page |35

 Driver Drowsiness Detection System

The implementation is as follows —

The implementation uses the ‘dlib’ library for face detection in the image. Face Alignment is done
using FaceAlignment class of imutils.face_utils library for better eye detection. Eye detection is
performed using Haar Cascade Classifiers.
Finally, the results can be viewed as follows —

Driver Drowsiness Detection System Page |36

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |37

 Driver Drowsiness Detection System

3.4 Snapshots

Code Snippets: -

Driver Drowsiness Detection System Page |38

 Driver Drowsiness Detection System

–––

Driver Drowsiness Detection System Page |39

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |40

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |41

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |42

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |43

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |44

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |45

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |46

 Driver Drowsiness Detection System

Driver Drowsiness Detection System Page |47

 Driver Drowsiness Detection System

3.5 Method for measuring Drowsiness

Researchers have used various methods to measure driver drowsiness. This section provides a
review of the four most widely used methods, among which the first method is measured either
verbally or through questionnaire and the remaining three by means of various sensors.

3.5.1 Subjective Measures

Subjective measures that evaluate the level of drowsiness are based on the driver’s personal
estimation and many tools have been used to translate this rating to a measure of driver
drowsiness. The most commonly used drowsiness scale is the Karolinska Sleepiness Scale (KSS), a
nine-point scale that has verbal anchors for each step, as shown in Table 1. Hu et al. measured the
KSS ratings of drivers every 5 min and used it as a reference to the EoG signal collected. Portouli et
al. evaluated EEG data by confirming driver drowsiness through both a questionnaire and a
licensed medical practitioner. Some researchers compared the self-determined KSS, which was
recorded every 2 min during the driving task, with the variation of lane position (VLP) and found
that these measures were not in agreement. Ingre et al. determined a relationship between the
eye blink duration and the KSS collected every 5 min during the driving task.

Researchers have determined that major lane departures, high eye blink duration and
drowsinessrelated physiological signals are prevalent for KSS ratings between 5 and 9. However,
the subjective rating does not fully coincide with vehicle-based, physiological and behavioural
measures.

Driver Drowsiness Detection System Page |48

 Driver Drowsiness Detection System

Because the level of drowsiness is measured approximately every 5 min, sudden variations cannot
be detected using subjective measures. Another limitation to using subjective ratings is that the
self-introspection alerts the driver, thereby reducing their drowsiness level. In addition, it is
difficult to obtain drowsiness feedback from a driver in a real driving situation. Therefore, while
subjective ratings are useful in determining drowsiness in a simulated environment, the remaining
measures may be better suited for the detection of drowsiness in a real environment.

3.5.2. Vehicle-Based Measures

Another method to measure driver drowsiness involves vehicle-based measurements. In most cases, these
measurements are determined in a simulated environment by placing sensors on various vehicle
components, including the steering wheel and the acceleration pedal; the signals sent by the sensors are
then analysed to determine the level of drowsiness. Liu et al. published a review on current vehicle-based

Driver Drowsiness Detection System Page |49

 Driver Drowsiness Detection System

measures. Some researchers found that sleep deprivation can result in a larger variability in the driving
speed. However, the two most used vehicle-based measures are the steering wheel movement and the
standard deviation of lane position.

Steering Wheel Movement (SWM) is measured using steering angle sensor and it is a widely used
vehiclebased measure for detecting the level of driver drowsiness [32,33,36]. Using an angle sensor
mounted on the steering column, the driver’s steering behavior is measured. When drowsy, the number of
microcorrections on the steering wheel reduces compared to normal driving. Fairclough and Graham found
that sleep deprived drivers made fewer steering wheel reversals than normal drivers. To eliminate the effect
of lane changes, the researchers considered only small steering wheel movements (between 0.5° and 5°),
which are needed to adjust the lateral position within the lane. Hence, based on small SWMs, it is possible
to determine the drowsiness state of the driver and thus provide an alert if needed. In a simulated
environment, light side winds that pushed the car to the right side of the road were added along a curved
road in order to create variations in the lateral position and force the drivers to make corrective SWMs. Car
companies, such as Nissan and Renault, have adopted SWMs but it works in very limited situations. This is
because they can function reliably only at particular environments and are too dependent on the geometric
characteristics of the road and to a lesser extent on the kinetic characteristics of the vehicle.

Standard Deviation of Lane Position (SDLP) is another measure through which the level of driver drowsiness
can be evaluated. In a simulated environment, the software itself gives the SDLP and in case of field
experiments the position of lane is tracked using an external camera. Ingre et al. conducted an experiment
to derive numerical statistics based on SDLP and found that, as KSS ratings increased, SDLP (meters) also
increased. For example, KSS ratings of 1, 5, 8, and 9 corresponded to SDLP measurements of 0.19, 0.26, 0.36
and 0.47, respectively. The SDLP was calculated based on the average of 20 participants; however, with
some drivers, the SDLP did not exceeded 0.25 m even for a KSS rating of 9. In the above experiment by
performing correlation analysis on a subject-to-subject basis significant difference is noted. Another
limitation of SDLP is that it is purely dependent on external factors like road marking, climatic and lighting
conditions. In summary, many studies have determined that vehicle-based measures are a poor predictor
of performance error risk due to drowsiness. Moreover, vehicular-based metrics are not specific to
drowsiness. SDLP can also be caused by any type of impaired driving, including driving under the influence
of alcohol or other drugs, especially depressants

3.5.3. Behavioral Measures

A drowsy person displays several characteristic facial movements, including rapid and constant blinking,
nodding or swinging their head, and frequent yawning. Computerized, non-intrusive, behavioral approaches
are widely used for determining the drowsiness level of drivers by measuring their abnormal behaviors.
Most of the published studies on using behavioral approaches to determine drowsiness, focus on blinking.
PERCLOS (which is the percentage of eyelid closure over the pupil over time, reflecting slow eyelid closures,
or “droops”, rather than blinks) has been analysed in many studies. This measurement has been found to
be a reliable measure to predict drowsiness and has been used in commercial products such as Seeing
Machines and Lexus. Some researchers used multiple facial actions, including inner brow rise, outer brow

Driver Drowsiness Detection System Page |50

 Driver Drowsiness Detection System

rise, lip stretch, jaw drop and eye blink, to detect drowsiness. However, research on using other behavioral
measures, such as yawning and head or eye position orientation, to determine the level of drowsiness is
ongoing.

Driver Drowsiness Detection System Page |51

 Driver Drowsiness Detection System

CHAPTER-4

4 Results & Observations

4.1 Results

Driver Drowsiness Detection System Page |52

 Driver Drowsiness Detection System

Many Deep Learning projects get delayed because due attention is not paid to managing the
dependencies across the various teams. The project plan must take into consideration the
crossteam dependencies when setting start and end dates for each deliverable. It is also crucial to
break a ‘user story” into as many meaningfully small pieces as possible. This will ensure that
progress can be shown on a weekly basis rather than having to wait for a full month (or more)
before showing any progress.

4.2 Observation

One of the challenges in developing an efficient drowsiness detection system is how to obtain
proper drowsiness data. Due to safety reasons, drowsiness cannot be manipulated in a real
environment; thus, the drowsiness detection system must be developed and tested in a laboratory
setting. However, in a laboratory setting, the most reliable and informative data that pertains to
driver drowsiness relies only on the way in which the driver falls into the drowsy state.

Driver drowsiness mainly depends on: (i) the quality of the last sleep; (ii) the circadian rhythm (time
of day) and (iii) the increase in the duration of the driving task [11,26,27]. In some research
experiments, the subjects were fully deprived of sleep, whereas they were only partially deprived
of sleep-in others . In addition, some researchers recruited night shift workers as their subjects; in
these cases, the subjects were totally deprived of sleep because the experiments were conducted
in the morning . Kokonozi et al. conducted an experiment in which they monitored the participants
for 24 h before the experiment began to ensure that they were completely sleep-deprived. In
certain experiments, researchers partially deprived the subjects of sleep by allowing them to sleep
for less than 6 h. Peters et al. studied the same subjects during four consecutive days and
considered the effects of no sleep deprivation, partial sleep deprivation and total sleep deprivation
on their drowsiness level. They observed that, even in the case of partial sleep deprivation, the
subjects tend to get drowsy after some time. Hence, the quality of the last sleep is an important
criterion that influences drowsiness.

The performance of the driver deteriorates when physiological activity diminishes. A circadian
rhythm is used to refer to any biological variations or rhythms that occur in a cycle of approximately
24 h. These rhythms are self-sustaining (i.e., free running) and will persist even when the organism
is placed in an environment devoid of time cues, such as constant light or constant darkness.
Recent statistics from countries such as the United Kingdom, the United States, Israel, Finland, and
France indicate that an increased number of vehicle accidents caused by driver drowsiness
occurred during the peak drowsiness periods of 2:00 am to 6:00 am and 2:00 pm to
4:00 pm. During these time frames, the circadian rhythm shows higher chance of getting drowsy
and drivers are three times more likely to fall asleep at these times than at 10:00 am or at 7:00 pm.
Liu et al. pointed out that the circadian rhythm produces small, but significant, changes in vehicle-

Driver Drowsiness Detection System Page |53

 Driver Drowsiness Detection System

based measures. Researchers have asked subjects to drive between 2:30 pm and 5:30 pm in order
to monitor drowsiness by measuring eyelid movement, ECG and EEG.

The duration of the driving task also plays a major role in influencing drowsiness. Otamani et al.
found that sleep deprivation alone does not directly influence the brain signals that control
drowsiness, whereas the duration of task has a strong influence. Researchers have also inferred
that prolonged driving on a monotonous environment stimulates drowsiness. In fact, it has been
observed that the subjects can become drowsy within 20 to 25 min of driving. This last finding,
reported by Philip et al., contradicts the observation made by Thiffault et al. that, in a real
environment, the duration of the drive does not impact the performance during the first two hours.
In addition, researchers have found that drowsiness-related crashes are more probable in a
monotonous environment than in a stimulating environment.

Therefore, there is a very high probability that a partially sleep-deprived driver will become drowsy
when driving in a monotonous environment at a constant speed for three hours during a time
when their circadian rhythm is low. This should be taken into consideration when designing an
experiment relating to recording driver drowsiness.

4.3 Safety Instruction

• safety system. To develop such a system, we need to estimate the condition of the driver
at wheel. The following is a concise description of the papers surveyed.

• The following is a concise description of the papers surveyed. The paper presents an
arithmetic-based method to solve the problem related to the detection of drowsiness.
Three stages were involved. They are Face detection, Eye position detection and Eye
tracking. This paper provides an efficient method for the detection of the state of the driver.
This framework uses the motion of the eyes to detect the state of the driver and gives an
alert within 0.5 seconds. The performance of the driver is transcribed in the form of a graph.
A new method for fatigue detection is presented. YCbCr colour space and canny edge
detection methods are used. These methods are used to determine if the driver is under
fatigue. When the driver is drowsy, an alarm system is turned on. A distinct system which
focuses on the concept of computer vision is designed. A software algorithm is developed.
This algorithm is partially tested and is found to be working effectively. Research is in
progress in order to develop a full-blown system. The developed system is capable in
identifying the state of drowsiness quickly. The system can differentiate between normal
eye blink and the eye blink associated with drowsiness. It can perform under low light
conditions and when the driver is wearing spectacles. This can further be developed by
adding different sensors. The developed system is based on computer vision. The system

Driver Drowsiness Detection System Page |54

 Driver Drowsiness Detection System

utilizes Viola Jones algorithm as well as the CAMSHIFT algorithm. This paper is concerned
with the development of a software framework for the timely and precise detection of
drowsiness. Multiple facial features were considered as inputs. The paper proposes a
method for detecting the drowsy state based on the time-series analysis of the angular
velocity of the steering wheel. When compared with the traditional method, this method
provides a series of advantages. It groups drowsiness detection techniques into two kinds.
They are

• driver based and vehicle based. It also provides a survey of numerous driver and
vehiclebased techniques. A drowsiness detection system which is dependent upon an
algorithm known as shape predictor algorithm and eye blink rate is developed. It is based
on the concept of image processing. The system provides a non-invasive approach. This
system also proposes the incorporation of yawning as a parameter to detect drowsiness.
In order to estimate a driver’s condition, certain facial features were identified. Using
python libraries, they were examined. These features were rate of eye closure, ECD, per
closure, head positions and rate of yawning. Certain limitations were also highlighted

• A safe work method statement (SWMS) must be prepared for all high-risk construction
projects, before work commences. The SWMS should outline the scope of work involved,
any potential safety issues, and how risks will be prevented and managed. By law,
construction work must not commence until SWMS standards are met.

• Restricted site access should not only be put in place to simply protect equipment from
damage or theft. Security in and outside of work hours is integral to protect pedestrians
from potential construction hazards. This includes supervision or authorised site visitors.
Strict security and safety protocols will also protect contractors from liability and
negligence in the case of a safety incident or security breach
• A safe work method statement (SWMS) must be prepared for all high-risk construction
projects before work commences. The SWMS should outline the scope of work involved,
any potential safety issues, and how risks will be prevented and managed. By law,
construction work must not commence until SWMS standards are met
• The site SWMS should be clearly displayed at the construction site, so that all safety
protocols are readily available - including a 24-hour emergency contact number and a map
or directions to the site office. Visible signage should also indicate site amenities (such as
toilets), entry and exit points, and first aid or emergency fire equipment
• Separate entry and exit points should be established for heavy machinery/vehicle access,
to strengthen pedestrian safety at high traffic points

Driver Drowsiness Detection System Page |55

 Driver Drowsiness Detection System

• Chemicals need to be stored very carefully to minimise fires, explosions, asphyxiation,

chemical injury and pollution on worksites. Use high quality, compliant outdoor storage
solutions such as explosive storage cabinets to segregate chemicals and reduce spillage
• Extreme weather conditions can cause serious safety hazards. Your on-site emergency plan
should provide clear guidelines for workers who need to stop work in the event of natural
disaster, severe environmental conditions or other emergency circumstances.
• For the construction industry, it's best practice to provide one first aid officer per 25
workers. First aid kits and equipment must be placed in an easily accessible area on site.

4.4 Maintenance

The execution and control phase of a project encompasses kicking off the project, monitoring and
control, quality and deliverable acceptance, issues and change management, and finally meetings,
reviews and reporting. Although all aspects of the execution and control phase are equally
important, the main focus often falls on the deliverable. For a client to accept the deliverable, it
must meet his expectations for both quality and scope. Therefore, precise monitoring and control
are required.

Depending on the nature of the project, the project manager will be responsible for monitoring
and controlling the project. Some of the factors they may be responsible for could include schedule
actuals (start, finish and milestone dates), cost actuals versus budget constraints, and effort and
resource actuals. The detail and frequency of monitoring updates should be determined up front
with the frequency likely to vary during the project.

Several tools are available that can help the project manager communicate what is being
monitored to the client. Performance curves, Gantt charts and any other visual methods are useful
to avoid misinterpretation of the data.

Driver Drowsiness Detection System Page |56

 Driver Drowsiness Detection System

5 Future Scope
• The model can be improved incrementally by using other parameters like blink rate,
yawning, state of the car, etc. If all these parameters are used it can improve the accuracy
by a lot.
• We plan to further work on the project by adding a sensor to track the heart rate to prevent
accidents caused due to sudden heart attacks to drivers.
• Same model and techniques can be used for various other uses like Netflix and other
streaming services can detect when the user is asleep and stop the video accordingly. It can
also be used in application that prevents user from sleeping

Driver Drowsiness Detection System Page |57

 Driver Drowsiness Detection System

6 Conclusion

In this paper, we have reviewed the various methods available to determine the drowsiness state
of a driver. Although there is no universally accepted definition for drowsiness, the various
definitions and the reasons behind them were discussed. This paper also discusses the various
ways in which drowsiness can be manipulated in a simulated environment. The various measures
used to detect drowsiness include subjective, vehicle-based, physiological and behavioral
measures; these were also discussed in detail and the advantages and disadvantages of each
measure were described. Although the accuracy rate of using physiological measures to detect
drowsiness is high, these are highly intrusive. However, this intrusive nature can be resolved by
using contactless electrode placement. Hence, it would be worth fusing physiological measures,
such as ECG, with behavioral and vehicle-based measures in the development of an efficient
drowsiness detection system. In addition, it is important to consider the driving environment to
obtain optimal results.

Driver Drowsiness Detection System Page |58

 Driver Drowsiness Detection System

7 References
• For Python installation
 https://www.python.org/downloads/

• Reference websites

 http://ncrb.gov.in/StatPublications/ADSI/ADSI2015/chapter1A%20traffic%20
accidents.pdf

 http://www.jotr.in/text.asp?2013/6/1/1/118718

 http://dlib.net/face_landmark_detection_ex.cpp.html

 https://data-flair.training/blogs/python-project-driver-
drowsinessdetectionsystem/

• Reference Books

 COMPUTATIONALLY EFFICIENT FACE DETECTION; B. SCHLKOPF-A. BLAKE, S.

ROMDHANI, AND P. TORR.

 USE OF THE HOUGH TRANSFORMATION TO DETECT LINES AND CURVES IN

PICTURE; R. DUDA AND P. E. HART.

 JAIN, “FACE DETECTION IN COLOR IMAGES; R. L. HSU, M. ABDEL-MOTTALEB,

AND A.
K. JAIN.

 OPEN/CLOSED EYE ANALYSIS FOR DROWSINESS DETECTION; P.R. TABRIZI AND

R. A.
ZOROOFI.

Driver Drowsiness Detection System Page |59