Drivers Drowsiness Detection System
Richa Vivek Gupta*
Kadugula Priscilla
Sharda University,Uttar Pradesh
Sharda University,Uttar Pradesh
Abstract— Accidents involving motor vehicles and other
connected incidents frequently result in fatalities and serious
injuries among people. According to World Health
Organization estimates from the last five years, fatal crashes
caused by traffic-related injuries resulted in over 1.25 million
deaths worldwide or about one crash every 25 seconds. One of
the major contributors to traffic accidents is drowsy driving.
Road accidents can hence be decreased by identifying drowsy
drivers. A machine learning method for drowsiness detection is
described in this research.
The areas of the driver's eyes are located using face
detection, and these regions serve as templates for eye tracking
in following frames. Finally, the detection is performed on the
tracked eye pictures to produce alarm warnings. This method's
three stages are detection of Face, detection of Eyes, and
detection of Drowsiness. The driver's face is recognized using
image processing, which then extracts the image of the driver's
eyes to check for signs of fatigue.
Keywords—Drowsiness Detection, Machine Learning, Image
Processing
I. INTRODUCTION
Sleep deprivation contributes significantly to vehicle
accidents and has a similar impact on the brain as drinking.
Driving while in this condition results in slow, decreased
reaction time and stimulus judgment which leads to the
increased number of accidents.
Facts1 about fatigued driving:
1. According to a 2005 survey by the National
Sleep Foundation (NSF), 38 percent of adults
have dozed off behind the wheel and about 21
percent have led to fatal accidents.
2. The majority of sleep-related accidents occur in
young adults (18 to 29).
3. Each year, car accidents result in approximately
1,550 fatalities, 71,000 injuries, and about 1250
crores of financial loss.
The creation of drowsiness detection technology is a
challenge for both industry and academia.
 Volvo created the Driver Alert Control for the
automotive sector, which uses a camera
mounted on the car linked to its lane departure
warning system to alert drivers who may be
driving while fatigued (LDWS).
 In a similar line, Mercedes-Benz has created and
introduced the Attention Assist System, which
continuously assesses whether the information
gathered from a driver's driving behavior
matches with the steering movement and the
current driving situation.
Ritika Prakash
Sharda University,Uttar Pradesh
*communicating author
 The Bosch-supplied driver fatigue detection
system makes choices using information from
the steering-wheel-mounted sensor, the vehicle's
speed, the use of its turn signals, and the lane
assist camera located in the front of the vehicle.
Recently, Tata Motors2, India’s largest commercial
vehicle manufacturer launched India's first CNG-powered
Medium & Heavy Commercial Vehicle (M&HCV) truck. It
introduced safest trucks with Advanced Driver Assistance
System (ADAS) – Collision Mitigation System, Lane
Departure Warning System(LDWS) and Driver Monitoring
System.
It should be noted that while these drowsiness detection
safety systems are typically found in high-end vehicles, their
use is limited and not very common among drivers. Surveys
conducted in 20153 revealed a growth in the embedding and
connection of smart devices with sensors and mobile
operating systems like Android, which is the operating
system with the largest installed base in automobiles.
Additionally, deep learning has made ground-breaking
strides in machine learning during the past few years. As a
result, implementing these new technologies and approaches
can be a useful way to both boost the effectiveness of the
real-time driver sleepiness detection system that is already in
place and give drivers a tool that they can use on a regular
basis.
A machine learning method for drowsiness detection is
described in this research.
 Machine learning is an application of AI
(Artificial Intelligence) which uses algorithms to
separate data, learn from that data, and then put
together rational decisions.
 DL(Deep learning) is subfield of machine
learning that structures algorithms in layers to
form an "artificial neural network" that can learn
on its own and make intelligent decisions.
However, its capabilities are different. While
basic machine learning models get progressively
better at their task, they still require some
guidance. If an AI algorithm gives a wrong
prediction, an engineer will have to step in and
make adjustments. With a deep learning model,
an algorithm can determine on its own if a
prediction is accurate or not through its own
neural network. A deep learning model is
designed to continually analyze data with a logic
structure similar to how a human would draw
conclusions.
 Real-Time Shruti Pandey Haar 80%
Driver- Rushikesh cascade
Drowsiness Nikam 2014 classifier,
4 Detection Open CV
II. PROPOSED SYSTEM System
Using Facial
The fatigue detection system's goal is to help reduce Features
accidents involving both passenger and commercial vehicles. Driver Mahek Jain, eSpeak module, 82.4%
Before the driver completely loses all attention, the system drowsiness Bhavya Eye aspect ratio,
will recognize the early signs of tiredness and alert them that monitoring Bhagerathi, CNN
5
they can no longer operate the car safely. However, using based on Sowmyarani
this device won't ensure that the driver is fully aware and that yawning C N 2015
an accident won't occur. It is merely a tool for enhancing detection
driver safety, with a particular emphasis on long-distance Driver Wanghua Convolutional 90%
truck drivers, nighttime drivers, solo drivers, and those who Drowsines Deng, neural
are sleep deprived. s Detection Ruoxue Wu network,
by 2017 fatigue
Applying detection,
Deep feature
III. LITERATURE REVIEW 6 Learning location
Several approaches have been suggested in an effort to Techniques
improve drowsiness detection, accuracy and speed. The to
existing fatigue monitoring techniques and strategies are Sequences
summarized in this section. The first method that has been of
utilized is based on driving patterns, and it is very dependent Images
on the characteristics of the vehicle, the state of the roads, A Driver Shabnam Drowsiness 83%
and driving abilities. Drowsiness Abtahi , Monitoring,
Detection Behnoosh Hariri, face tracking,
Deviation from a lateral or lane position or the movement 7 Framework Shervin yawning
of the steering wheel should be taken into consideration Using Deep Shirmohammadi detection
when calculating the driving pattern4. The benefit of adopting Learning 2017
steering behavior for fatigue detection is that these devices Heuristic
monitor continuously, affordably, discreetly, and robustly A Uche M. Open CV, 80%
even under the most challenging environmental conditions. Drowsiness Chikezie 2017 Raspberry pi,
detection IoT
8
system using
deep learning
TABLE I. LITERATURE REVIEW TBLE and IoT
An Jongseong Hybrid 82.07%
S.No Accurac
Paper Title Author Method Used Investigation Gwak Akinari Sensing,Python
. y
of Early Hirao 2018 Open CV
Driver D.Mounika CNN,Android 82% Detection of
Drowsiness K. Divya Deepika studio, python Driver
Detection 2011 Drowsiness
Model Using 9 Using
Convolutional Ensemble
1 Neural Machine
Networks Learning
Techniques Based on
for Android Hybrid
Application Sensing
Driver M. Kesava Machine learning, 87% IoT-Based Keyong Li IoT 81%
Drowsiness Puneeth Varma Artificial Smart Alert Lisheng Jin Tensorflo
Detection 2012 Intelligence, System for 2018 w OpenCV
2 System Using Python 10
Drowsy
Computer Driver
Vision Detection
Real-Time Drashti Patel, CNN using 92% Effects of Yuying CNN 95%
Driver Rishika Tiwari tensorflow driver JiangLin Lin Deep Learning
Drowsiness 2012 behavior style Gao Machine
3 Detection differences 2018 learning
using 11 and individual
Computer differences on
Vision driver
sleepiness
detection
 Drowsiness Anil Kumar Keras software 96% C. Proposed Design
monitoring Biswal Open CNN  The physiological properties and the gradual change
based on Debabrata
12
driver and in the facial features like6- fluctuations in the driver's
Singh 2019
driving data concentration, changes in the size or position of the
fusion pupils and the eyelids, and rapid shifts in head
Driver Binod Tensorflo 87.6% position, head orientation, and blink rate are some of
drowsiness Kumar w Open the factors which are considered while detecting the
monitoring Pattanaya CV alertness level of the driver.
system using k
13
visual  The device will be able to distinguish between tired
Ming-Hour
behavior and and awake drivers by analyzing the eye states. The
Yang 2020
machine driver's faces will continuously provide a video
learning stream, which will be fed into a microcontroller for
Drowsiness Motoki Shino Python 79% processing. After then, classifiers will be applied to
monitoring 2020 Deep learning categorize the condition of the driver's eye. If the
based on driver is found to be drowsy, a warning will be raised
14
driver and in the form of an alarm.
driving
behaviour  Lane tracking detection algorithm:Image processing
Driver Hong J. EohMin Open CV 85% techniques are used to measure how a driven vehicle
Inattention K. Face behaves in relation to its position in relation to its
Monitoring ChungSeong- tracking surroundings.
15 System for Han Kim
Intelligent
2020
Vehicles: A
Review

IV. METHODOLOGY

The Drowsiness Detection System was created via an

ongoing cycle of study and analysis5. Concepts are created
during the research stage and requirements ,constraints are
examined during the analysis stage. The cycle is then
repeated to produce increasingly complex theories, which are
later examined in more detail.

A. Requirements

 In order to fulfill its role as a system for increasing

driver safety, the solution must be able to identify
drowsiness with accuracy.
 It's crucial that the solution is as transparent as
possible to the driver.
 There are currently existing solutions to this issue, but
the best ones are typically too expensive to be widely
used. So, the solution must be economical.
 The system should give real time response in order to
tackle high speed vehicles.
 It should be flexible i.e. it should accommodate all
types of users.

B. Constraints Fig.1 Component Diagram

(Drivers drowsiness detection system)
 The solution must be built to function properly with
limited power requirements.
 The solution must be implemented in a space-
efficient way. It must not compromise the vehicle's
existing controls.
 V. DATASET
We used the Real-Life Drowsiness Dataset to identify
multi-stage drowsiness for our training and test data. The
ultimate goal is to make it possible for our system to
distinguish between milder forms of fatigue and more severe,
evident occurrences of sleepiness.
About 2900 files are taken both of open and closed eyes
along with the rest of the facial features like
yawning.Many subjects were recorded in a range of
simulated driving scenarios, including standard driving
mode, yawning, slow blink rate, conscious laughter, and
dizzy napping, etc., during both day and night light settings.
As a result, we were able to compile enough data to take
both alertness and tiredness into account.
Fig.2 Type of data used
(Dataset Distribution7)
Fig.3 Dataset
VI. WORKFLOW
 A webcam is designed to track the driver's real-time,
live video which is subsequently edited into video
frames.
 Sometimes because of the constant alterations in the
amount of light, each frame of the video is
preprocessed to meet the requirements (like
illumination enhancement).
 [For the project images/videos are extracted from the
provided dataset].
 After that, Open CV(Open Source Computer Vision)
analyses the footage and finds any faces.
 The DLIB is used to reanalyze the identified faces to
identify facial landmarks using the 68 point
technique. The key feature sets are extracted as Eyes
and Mouth(DLIB offers a pre-defined facial
landmark detector which is capable of detecting 68
point on the face).
Fig.4 68 point view8
 From the 68 points, the coordinates of left eye, right
eye and mouth are located and are further provided
to the conditional logic for monitoring of EAR and
MAR values.
 When the EAR value falls below the threshold value
for the predetermined amount of time, an alarm
sound is produced to warn the driver of their
drowsiness.
 VII. RESULT
In this study,  five driving simulation scenarios (with
glasses, with sunglasses, without glasses, at night with
glasses, and at night without glasses) were taken into
account. For each scenario, videos of two different states—
sleepy and awake—were chosen. With the help of dlib
framework facial landmarks were created which intern were
used for the fatigue detection.
The results for various categories are provided below:-
TABLE II. Accuracy in different cases
According to the evaluation outcomes of various
scenarios, eyes are essential for classifying tiredness in any
situation. Additionally, it has been demonstrated that the
model's effectiveness decreases when the driver is wearing
sunglasses since the algorithm cannot detect the driver's eyes.
When the system is tested under different lighting
circumstances, the results continuously change based on the
amount of light. Lighting is a factor that has a significant
impact on the system's performance.
VIII. CONCLUSION AND FUTURE SCOPE
The enormous potential of image processing is
demonstrated in this study. The majority of global problems
can be solved by using technology that is competent and
inexpensive for manipulating images, much to how humans
use vision to interact with the world. This will enable
machines to find solutions to various issues.
The system's job is to identify facial landmarks in photos
and send the collected information to the trained model to
determine the driver's state. Given that present applications
cannot be used in embedded systems due to their restricted
computation and storage capacity, the method's goal is to
reduce the model's size.
Improvements: Environmental lighting can be handled in
order to enhance this technology by adding a module that
can measure the illumination levels and alter the threshold
value for blink detection correspondingly. A transmission
module can also be integrated to convey the driving status
information in real-time to the appropriate authorities,
improving control and increasing driver situation
monitoring.
ACKNOWLEDGMENT
The key elements concentration, dedication, hard work
and application are not only essential factors for achieving
the desired goals but also guidance, assistance and co-
operation of people is necessary.
We are grateful to our faculty guide Prof. Shaveta Khepra
for guiding us. She has the qualities to be an ideal guide. She
will always prevail upon our remembrance.
We are very fortunate to have unconditional support from
our family. We thank our parents, who gave us the courage to
get our education, supported us in all achievements
throughout our life. Without their encouragement, this work
would indeed have been very difficult for us to tackle.
REFERENCES
[1] Drowsy Driving NHTSA reports. (2018, January 08). Retrieved
from https://www.medindia.net/patientinfo/drowsy-
driving.htm#:~:text=21%20percent%20of%20all%20fatal,drowsy
%20in%20the%20past%20year
[2] Information on tata motors taken from
https://www.tatamotors.com/press/tata-motors-makes-indias-trucks-
smarter-safer-and-more-efficient/.
[3] T Cornez, R Cornez
Android Programming Concepts., Jones & Bartlett Publishers (2015)
[4] Krajewski, J. & Sommer, D. & Trutschel, U. & Edwards, D. & Golz,
M., (2009) “Steering Wheel Behavior Based Estimation of
Fatigue”, Driving Assessment Conference 5(2009), 118-124.
doi: https://doi.org/10.17077/drivingassessment.1311
[5] https://uwaterloo.ca/systems-design-engineering/current-
undergraduate-students/courses/workshop-projects/fourth2002/
drowsiness-detection-system
[6] http://www.ijaema.com/gallery/241-ijaema-april-3854.pdf
[7] https://www.kaggle.com/datasets/dheerajperumandla/
drowsiness-dataset?select=train
[8] https://www.irjmets.com/uploadedfiles/paper/
issue_4_april_2022/21084/final/fin_irjmets1650438819.pdf
.