Final year Project:

Driver Drowsiness Detection

System

Guided by: Prof. Kailash

Group members

• BE20F04F08 – Veerbhadra Bramhane

• BE20F04F37 – Raman Kesale

• BE20F04F58 – Anushka Suradkar

Abstract

Driver drowsiness is a major cause of road accidents, resulting in thousands of deaths and
injuries each year. This project aims to develop a real-time driver drowsiness detection system
using Dlib and OpenCV. The system works by first detecting the driver's face in the video
stream using the Dlib face detector. Once the face is detected, the system then uses OpenCV
to extract facial landmarks, such as the eyes and mouth.The system then uses these
landmarks to calculate various drowsiness features, such as the eye aspect ratio (EAR) and the
mouth opening width. The EAR is a measure of how open the eyes are, and the mouth
opening width is a measure of how open the mouth is.The system then uses these drowsiness
features to classify the driver's state as either drowsy or not drowsy. If the driver is classified
as drowsy, the system triggers an alarm to wake the driver up. This project has the potential to
make a significant contribution to road safety by helping to prevent driver drowsiness-related
accidents.
Introduction
• Driver drowsiness is a major cause of road accidents. A drowsy driver is more likely to make
mistakes, such as lane drifting, tailgating, and running red lights. Drowsy driving accidents
are estimated to cause over 100,000 crashes and 1,550 deaths in the United States each
year.
• There are a number of factors that can contribute to driver drowsiness, such as lack of
sleep, fatigue, and medication side effects. However, even well-rested drivers can become
drowsy on long trips or during monotonous driving conditions.
• One way to reduce the risk of drowsy driving accidents is to develop systems that can
detect driver drowsiness and alert the driver before an accident occurs. This project aims
to develop a real-time driver drowsiness detection system using Dlib and OpenCV.
• The system works by first detecting the driver's face in the video stream using the Dlib face
detector. Once the face is detected, the system then uses OpenCV to extract facial
landmarks, such as the eyes and mouth.
• The system then uses these drowsiness features to classify the driver's state as either
drowsy or not drowsy. If the driver is classified as drowsy, the system triggers an alarm to
wake the driver up.
.
• This project has the potential to make a significant contribution to road safety by helping to
prevent driver drowsiness-related accidents.
Existing scenario
• Driver drowsiness detection is a well-studied problem, and there are a
number of existing solutions. These solutions can be broadly categorized
into two types: intrusive and non-intrusive.
• Intrusive solutions require the driver to wear sensors, such as an EEG cap
or a wristband. These sensors can measure physiological signals, such as
brain activity and heart rate, to detect drowsiness.
• Non-intrusive solutions do not require the driver to wear any sensors.
Instead, they use cameras and other sensors to monitor the driver's
behavior for signs of drowsiness. For example, these systems may look for
eye blinks, head nods, and lane drifting.
• Existing driver drowsiness detection systems have a number of limitations.
Intrusive systems can be uncomfortable and inconvenient for the driver to
wear. Non-intrusive systems can be less accurate, especially in challenging
conditions such as low light or heavy traffic.
Literature review
Driver drowsiness detection is a well-studied problem, and there are a number of existing solutions.
However, many of these solutions are expensive and complex, making them impractical for widespread
use.
In recent years, there has been a growing interest in using low-cost, single-board computers such as the
Raspberry Pi for driver drowsiness detection. The Raspberry Pi is a small, powerful computer that can be
used to develop a variety of embedded systems, including driver drowsiness detection systems.
One of the most popular approaches to driver drowsiness detection using the Raspberry Pi is to use the
Dlib and OpenCV libraries. Dlib is a C++ library that provides a number of computer vision algorithms,
including face detection and landmark extraction. OpenCV is a popular open-source computer vision
library.
A number of research projects have been conducted on driver drowsiness detection using the Raspberry
Pi, Dlib, and OpenCV. The results of these projects are promising, and suggest that this approach is a
viable solution for developing low-cost and effective driver drowsiness detection systems.
For example, a study by researchers at the University of Texas at Dallas evaluated a driver drowsiness
detection system implemented using a Raspberry Pi, Dlib, and OpenCV. The system was able to achieve
an accuracy of over 90% in detecting drowsy drivers.
Another study by researchers at the Indian Institute of Technology Bombay evaluated a driver drowsiness
detection system implemented using a Raspberry Pi, Dlib, and OpenCV. The system was able to achieve
an accuracy of over 95% in detecting drowsy drivers.
These results suggest that driver drowsiness detection systems implemented using the Raspberry Pi, Dlib,
and OpenCV can be very effective. Additionally, these systems are relatively inexpensive and easy to
implement, making them a viable solution for widespread use.
System description
The driver drowsiness detection system consists of the
following components:
1. A camera to capture the driver's face
2. A Raspberry Pi to process the video stream from the camera
3. A Dlib library to detect the driver's face in the video stream
4. An OpenCV library to extract facial landmarks, such as the eyes and mouth
5. An algorithm to calculate drowsiness features, such as the eye aspect ratio
(EAR) and the mouth opening width
6. An algorithm to classify the driver's state as either drowsy or not drowsy
7. An buzzer to wake the driver up if they are detected to be drowsy
8. verall, the HOG + SVM has undeniably better accuracy than the Haar
detector especially in the findings of detecting in dark and low illumination
condition. But the response time posed a problem in terms of the response
of the subject to wake from microsleep during driving.
Calculation of the Eye Aspect Ratio (EAR) :
The mathematical equation to calculate the eye aspect ratio (EAR) is as follows:

EAR = (A + B) / (2 * C)
where:
• A is the distance between the two inner corners of the eye
• B is the distance between the two outer corners of the eye
• C is the distance between the center of the pupil and the bottom of the eye
• The EAR is a measure of how open the eyes are. A higher EAR indicates that the eyes are
more open, while a lower EAR indicates that the eyes are more closed.
• To calculate the EAR, the following steps are typically taken:
• Identify the facial landmarks for the eyes. This can be done using a face detection and
landmark extraction algorithm.
• Calculate the distances A, B, and C.
• Substitute the values for A, B, and C into the EAR equation.
68 Facial Landmarks
Conclusion
The driver drowsiness detection system is a low-cost and effective way to
detect drowsy drivers. The system is easy to implement and can be used in
a variety of vehicles.
If the driver is detected to be drowsy, the system triggers an alarm to wake
the driver up.
The driver drowsiness detection system has the potential to make a
significant contribution to road safety by helping to prevent driver
drowsiness-related accidents.
The driver drowsiness detection system is a low-cost and effective way to
detect drowsy drivers.
The system is easy to implement and can be used in a variety of vehicles.
The system has the potential to make a significant contribution to road
safety by helping to prevent driver drowsiness-related accidents.
 Research Papers
1.Review of Recent Developments in Driver Drowsiness Detection Systems Yaman
Albadawi 1 , Maen Takruri 2,* and Mohammed Awad 1

2.Article 4D: A Real-Time Driver Drowsiness Detector Using Deep Learning Israt Jahan 1 ,
K. M. Aslam Uddin 1,* , Saydul Akbar Murad 2 , M. Saef Ullah Miah 2 , Tanvir Zaman Khan
1 , Mehedi Masud 3 , Sultan Aljahdali 3 and Anupam Kumar Bairagi

3.Fatigue and Drowsiness Detection System Using Artificial Intelligence Technique for Car
Drivers Mohd Azlan Abu, Izzat Danial Ishak, Hafiz Basarudin, Aizat Faiz Ramli, and Mohd
Ibrahim Shapiai
References
Books and articles:
• Driver Drowsiness Detection: Systems and Techniques by Neeraj Jain and Lalit Jain
• Driver Drowsiness Detection: A Survey by Prashant Dhawde, Pankaj Nagare, Ketan Sadigale,
Darshan Sawant, and Prof. J. R. Mahajan
• Driver Drowsiness Detection Using Machine Learning by Huong Nice Quan
• Drowsiness Detection for car assisted driver system using image processing by Picot, A.,
Charbonnier, S., Caplier, A.
• Driver Drowsiness Detection by Using Webcam by UTPedia

Conference papers:
• Driver Drowsiness Detection Using Facial Analysis Techniques by Sarbjit Singh and N.P.
Papanikolopoulos
• Underestimating the societal costs of impaired alertness: safety, health, productivity risks by
M.R. Rosekind
• On Computer Vision by David G. Lowe

Other resources:
• Driver Drowsiness Detection System by the National Highway Traffic Safety Administration
(NHTSA)
• Drowsy Driving by the Centers for Disease Control and Prevention (CDC)