PBLreport
PBLreport
ON
In
COMPUTER ENGINEERING
By
Submitted to
DEPARTMENT OF COMPUTER ENGINEERING
STES’S SINHGAD ACADEMY OF ENGINEERING, PUNE-411048
2023-2024
CERTIFICATE
Is a bonafide work carried out by them under the supervision by Prof. S.H.Thengil and
it is approved for the partial fulfilment of the requirement of Savitribai Phule Pune
University for the Project in the second Year of Computer Engineering.
We would like to take this opportunity to thank all the people who were part of this
seminar in numerous ways, people who gave un-ending support right from the initial stage.
In particular we wish to thank Prof.S.H.Thengil as internal project guide who gave
their co-operation timely and precious guidance without which this project would not have
been a success. We thank them for reviewing the entire project with painstaking efforts and
more of his, unbanning ability to spot the mistakes.
We would like to thank our H.O.D Prof.S.N.Shelke for his continuous encouragement,
support and guidance at each and every stage of project.
And last but not the least we would like to thank all my friends who were Associated
with me and helped me in preparing my project. The project named “Drowsiness Detetctor
for Drivers” would not been possible without the extensive support of people who were
directly or indirectly involved in its successful execution.
The proposed system aims to lessen the number of accidents that occur due to drivers’
drowsiness and fatigue, which will in turn increase transportation safety. This is becoming a
common reason for accidents in recent times. Several faces and body gestures are considered such
as signs of drowsiness and fatigue in drivers, including tiredness in eyes and yawning.
These features are an indication that the driver’s condition is improper. EAR (Eye
Aspect Ratio) computes the ratio of distances between the horizontal and vertical eye landmarks
which is required for detection of drowsiness. For the purpose of yawn detection, a YAWN value
is calculated using the distance between the lower lip and the upper lip, and the distance will be
compared against a threshold value. We have deployed an eSpeak module (text to speech
synthesizer) which is used for giving appropriate voice alerts when the driver is feeling drowsy or
is yawning.
The proposed system is designed to decrease the rate of accidents and to contribute to
the technology with the goal to prevent fatalities caused due to road accidents.
Acknowledgment iii
Abstract iv
Table of Contents v
List of Figures vii
Chapter 1 Introduction 1
1.1 Introduction
1.2 Motivation
1.3 Problem Statement
1.4 Objectives of the proposed work
Chapter 5 Results
Chapter 6 Conclusion
INDEX
1.1 INTRODUCTION
In recent years, road accidents caused by driver drowsiness have become a significant
concern worldwide, leading to devastating consequences in terms of loss of life and property.
According to statistics from the World Health Organization (WHO), a substantial portion of road
accidents is attributed to drivers falling asleep or experiencing drowsiness behind the wheel. To
mitigate this alarming trend, advanced technologies are being harnessed to develop proactive
systems capable of detecting driver drowsiness in real-time.
This project presents a comprehensive exploration into the realm of drowsiness detection
using computer vision techniques. We delve into the underlying principles of computer vision
algorithms, including facial landmark detection, eye tracking, and image processing
methodologies, which form the backbone of our proposed drowsiness detection system.
[2]
SAE, Department of Computer Engineering 2023-24
1.2 MOTIVATION
In recent years, road accidents caused by driver drowsiness have become a significant
concern worldwide, leading to devastating consequences in terms of loss of life and property.
According to statistics from the World Health Organization (WHO), a substantial portion of road
accidents is attributed to drivers falling asleep or experiencing drowsiness behind the wheel. To
mitigate this alarming trend, advanced technologies are being harnessed to develop proactive
systems capable of detecting driver drowsiness in real-time.
This project presents a comprehensive exploration into the realm of drowsiness detection
using computer vision techniques. We delve into the underlying principles of computer vision
algorithms, including facial landmark detection, eye tracking, and image processing
methodologies, which form the backbone of our proposed drowsiness detection system.
In summary, this project aims to contribute to the ongoing efforts in developing effective
drowsiness detection systems using computer vision technology. By advancing our understanding
and implementation of such systems, we strive towards a safer and more secure transportation
ecosystem for all road users.
[3]
SAE, Department of Computer Engineering 2023-24
1.3 PROBLEM STATMENT
The primary goal of this research is to develop an effective drowsiness detection system using
computer vision techniques. This system must be capable of robust performance under diverse
driving conditions, accurately analyzing facial cues and behavioral patterns indicative of
drowsiness in real-time.
1. Developing robust computer vision algorithms capable of accurately detecting facial landmarks
and tracking eye movements under varying lighting conditions and driver orientations.
2. Integrating machine learning models to analyze facial expressions and physiological signals to
accurately distinguish between alert and drowsy states.
3. Designing a real-time processing pipeline that can efficiently process video feeds from onboard
cameras and provide timely alerts to drivers when signs of drowsiness are detected.
4. Ensuring the system's reliability and effectiveness in preventing accidents while minimizing
false alarms and maintaining user privacy.
[4]
SAE, Department of Computer Engineering 2023-24
1.4 OBJECTIVES OF PROPOSED WORK
1. Algorithm Development: Develop robust computer vision algorithms for detecting facial
landmarks, tracking eye movements, and analyzing facial expressions indicative of drowsiness.
2. Data Collection and Annotation: Collect a diverse dataset of annotated video footage
depicting drivers in various states of alertness and drowsiness to train and validate the proposed
algorithms.
3. Machine Learning Model Training: Train machine learning models using the collected
dataset to accurately classify driver states as alert or drowsy based on facial cues and behavioral
patterns.
4. Real-time Processing Pipeline: Design and implement a real-time processing pipeline capable
of efficiently processing video feeds from onboard cameras and detecting signs of drowsiness in
drivers.
5. Integration with Automotive Systems: Integrate the developed drowsiness detection system
with existing automotive systems, ensuring seamless interoperability and minimal performance
impact on vehicle operation.
7. User Interface Design: Design an intuitive user interface for drivers to interact with the
drowsiness detection system, providing timely alerts and recommendations to prevent accidents.
8. Validation and Deployment: Validate the effectiveness of the developed system through real-
world testing and validation studies, ensuring its readiness for deployment in commercial vehicles
to enhance road safety.
[5]
SAE, Department of Computer Engineering 2023-24
CHAPTER 2. LITERATURE REVIEW
[6]
SAE, Department of Computer Engineering 2023-24
Sr.No Paper Author Year of Abstract
Name Publish
3. The Chris 2019
detection of Schwarz, Drowsiness is a major cause of driver impairment
drowsiness John leading to crashes and fatalities. Research has
using a Gaspar, established the ability to detect drowsiness with
driver Thomas various kinds of sensors. We studied drowsy
monitoring Miller & driving in a high-fidelity driving simulator and
system Reza evaluated the ability of an automotive production-
Yousefian ready driver monitoring system (DMS) to detect
drowsy driving. Additionally, this feature was
compared to and combined with signals from
vehicle-based sensors.The National Advanced
Driving Simulator was used to expose drivers to
long, monotonous drives. Twenty participants
drove for about 4 h in the simulator between 10
p.m. and 2 a.m. They were allowed to use cruise
control and traffic was sparse and semirandom,
with both slower- and faster-moving vehicles.
Observational ratings of drowsiness (ORDs) were
used as the ground truth for drowsiness, and
several dependent measures were calculated from
vehicle and DMS signals. Drowsiness
classification models were created that used only
vehicle signals, only driver monitoring signals,
and a combination of the 2 sources.
4. Computer Rahul Atul 2019 Since the advent of high-speed motorized vehicles
Vision based drowsy driving accidents have claimed the lives
Bhope
drowsiness of millions of people across the globe. With more
detection for research happening in advanced high-speed
motorized engines, the risk of such accidents has increased
vehicles with ten-fold times. To avoid such accidents, this paper
Web Push proposes a Computer Vision-basedsystem
Notifications drowsiness system for motorized vehicles with
Web Push Notifications to notify the driver before
any accident occurs. A real-time video system
captures the face of the driver and a pre-trained
machine learning model detects the eye
boundaries from that real-time video stream. Then
each eye is represented by 6 - coordinates (x,y)
starting from the left corner of the eye and then
working clockwise around the eye. The EAR (Ear
Aspect Ratio) is calculated for 20 consecutive
frames, which if less than a threshold sounds an
alarm and sends an alert on your mobile device
through a Web Push Notification. The alert when
opened also shows some coffee shops near the
driver's location to increase the driver's alertness.
[7]
SAE, Department of Computer Engineering 2023-24
Fig 2.1 Alert System
[8]
SAE, Department of Computer Engineering 2023-24
CHAPTER 3.SOFTWARE REQUIREMENTS
a. Storage for storing historical data (optional, for analysis and reporting)
b. Database management system (DBMS) for storing and querying data (optional, depending
on the need for data logging and analysis)
[9]
SAE, Department of Computer Engineering 2023-24
CHAPTER 4. SOFTWARE DESIGNS
[10]
SAE, Department of Computer Engineering 2023-24
Fig.4.2.2 DFD Level 1
[11]
SAE, Department of Computer Engineering 2023-24
4.3 UML DIAGRAMS
Open cv Application
[12]
SAE, Department of Computer Engineering 2023-24
4.4 ALGORITHM DETAILS
1. Face Detection and Landmark Detection: Utilize dlib's pre-trained face detector and facial
landmark detector to detect faces and locate key facial landmarks such as eyes, eyebrows, and
mouth.
2. Eye Aspect Ratio (EAR) Calculation: Calculate the EAR using the detected facial landmarks.
You can use the formula for EAR calculation:
[13]
SAE, Department of Computer Engineering 2023-24
Fig.4.4.2 EAR Calculation
3. Drowsiness Detection: Monitor changes in the EAR over time. When the EAR falls below a
certain threshold, it indicates that the eyes are closing or drooping, suggesting drowsiness. You
can set a threshold based on experimentation or prior research.
[15]
SAE, Department of Computer Engineering 2023-24
CHAPTER 5.RESULTS
5.1 OUTCOMES
1. Real-time Alert System: The system can provide real-time alerts to the individual, such as
visual or auditory warnings, when signs of drowsiness are detected. This could include messages
like "Take a break" or "Stay awake" to prompt the person to take necessary actions to prevent
accidents.
2. Data Logging and Analysis: The system can log data on instances of drowsiness detection
over time, including frequency, duration, and severity of drowsy episodes. This data can be
analyzed to identify patterns and trends, helping individuals understand their sleep patterns and
make lifestyle adjustments accordingly.
3. Integration with Vehicles or Machinery: Drowsiness detection systems can be integrated into
vehicles or machinery to automatically alert drivers or operators when they are becoming drowsy.
4. Customizable Thresholds and Alerts: Users may have different thresholds for drowsiness or
preferences for alert types. The system can be designed to allow customization of detection
thresholds and alert settings to accommodate individual preferences and needs.
5. Remote Monitoring and Support: In scenarios where individuals are operating vehicles or
machinery as part of their job, drowsiness detection systems can provide remote monitoring
capabilities. Supervisors or support staff can receive alerts when drowsiness is detected, allowing
them to intervene or provide assistance as needed.
6. Behavioral Feedback and Coaching: Over time, the system can provide feedback and
coaching to help individuals improve their sleep habits and reduce instances of drowsiness. This
could include suggestions for better sleep hygiene, relaxation techniques, or reminders to take
regular breaks during long periods of activity.
[16]
SAE, Department of Computer Engineering 2023-24
5.2 SCREENSHOTS
[17]
SAE, Department of Computer Engineering 2023-24
CHAPTER 6. CONCLUSION
6.1 APPLICATIONS
1. Transportation Safety: Integrating drowsiness detection systems into vehicles (cars, trucks,
buses, trains, etc.) to alert drivers when they exhibit signs of drowsiness, thereby reducing the risk
of accidents due to driver fatigue.
3. Aviation: Incorporating drowsiness detection technology into cockpit systems to monitor pilot
alertness and prevent incidents related to fatigue during flight operations.
4. Public Safety: Deploying drowsiness detection in surveillance systems in public spaces (e.g.,
airports, train stations, stadiums) to identify individuals who may pose a risk due to fatigue or
sleep deprivation.
7. Consumer Electronics: Integrating drowsiness detection features into wearable devices (e.g.,
smartwatches, fitness trackers) and smartphones to provide users with personalized insights into
their sleep habits and promote healthier sleep behaviors.
[18]
SAE, Department of Computer Engineering 2023-24
6.2 CONCLUSION
This project is about drowsiness detection using computer vision could highlight the
effectiveness of such systems in identifying signs of drowsiness based on visual cues like eye
movements, head position, and facial expressions. It could also emphasize the potential benefits
in various fields such as transportation safety, workplace monitoring, and healthcare.
Additionally, it might mention ongoing challenges like real-time processing, accuracy
improvement, and ensuring privacy and ethical considerations in deploying such systems. Overall,
the conclusion could stress the promising future of drowsiness detection using computer vision
technology with continued research and development efforts.
[19]
SAE, Department of Computer Engineering 2023-24
6.2 FUTURE SCOPE
1. Enhancing Accuracy: Continuously improving algorithms to accurately detect subtle signs of
drowsiness in various environmental conditions and diverse populations.
3. Integration with AI: Integrating advanced artificial intelligence techniques such as deep
learning for more robust and adaptive drowsiness detection systems.
4. Multimodal Approaches: Exploring the combination of computer vision with other modalities
such as physiological signals to enhance detection accuracy and reliability.
5. Wearable Devices: Designing wearable devices equipped with computer vision technology to
provide continuous monitoring of drowsiness levels in real-world scenarios.
6. Human Factors Research: Conducting studies to understand user acceptance, usability, and
potential societal impacts of deploying drowsiness detection systems in various contexts.
7. Privacy and Ethical Considerations: Addressing concerns related to privacy, data security,
and potential biases inherent in computer vision algorithms, ensuring responsible deployment and
adherence to ethical guidelines.
[20]
SAE, Department of Computer Engineering 2023-24
REFERENCES
1. X. Fan, B. Yin, and Y. Sun, "Yawning detection for monitoring driver fatigue", Proceedings of
the International Conference on Machine Learning and Cybernet, vol. 2, pp. 664-668, Aug. 2007.
2. L. Li, Y. Chen and Z. Li, "Yawning detection for monitoring driver fatigue based on two
cameras", Proceedings of the 12th International IEEE Conference Intelligent Transportation
Systems., pp. 1-6, Oct. 2009.
3. T. Danisman, I.M. Bilasco, C. Djeraba and N. Ihaddadene, “Drowsy driver detection system
using eye blink patterns,” Universite Lille 1 & Telecom Lille 1, Marconi, France, 2010.
4. S. Abtahi, B. Hariri and S. Shirmohammadi, "Driver drowsiness monitoring based on yawning
detection", Proceedings of the IEEE International Control, Measurement and Instrumentation
(CMI), IEEE, pp. 1-4, May 2011.
5. Z. Mardi, S. N. Ashtiani, and M. Mikaili, “EEG-based drowsiness detection for safe driving
using chaotic features and statistical tests,” Journal of Medical Signals and Sensors, vol. 1, pp.
130–137, 2011.
6. Rahul Atul Bhope, “Computer Vision based drowsiness detection for motorized vehicles with
Web Push Notifications”, IEEE 4th International Conference on Internet of Things, IEEE,
Ghaziabad, India, 2019.
7. Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P, Aschwanden & Mark
Stevenson, “Real-time monitoring of driver drowsiness on mobile platforms using 3D neural
networks”, Neural Computing and Applications, 2019.
8. Chris Schwarz, John Gaspar, Thomas Miller & Reza Yousefian, “The detection of drowsiness
using a driver monitoring system” , in Journal of Traffic Injury Prevention (Taylor and Francis
Online), 2019.
9. B.Mohana, C.M.Sheela Rani, “Drowsiness Detection Based on Eye Closure and Yawning
Detection”, in International Research Journal of Engineering and Technology(IRJET), 2019.
10. Aditya Ranjan, Karan Vyas, Sujay Ghadge, Siddharth Patel, Suvarna Sanjay Pawar, “Driver
Drowsiness Detection System Using Computer Vision.”, in International Research Journal of
Engineering and Technology(IRJET), 2020.
[21]
SAE, Department of Computer Engineering 2023-24