Driver Drowsiness Detection System

A Synopsis Submitted
in Partial Fulfillment of the Requirements
for the Degree of
Bachelor In Technology
in
Computer Science and Engineering

by

Prakhar Chaurasia (1903480100076)

Rashi Pandey (1903480100081)
Tanishka Gupta (1903480100113)
Yash Chaturvedi (1903480100128)

Computer Science & Engineering

PSIT COLLEGE OF ENGINEERING
AKTU, LUCKNOW, INDIA
April, 2021-22
 Synopsis
1. Introduction

In a car safety technology, driver drowsiness detection is very essential to prevent road
accidents. Now-a-days, many people using automobiles for daily commutation, higher
living standards, comfortability, and timing constraints to reach destinations.
According to the National Highway Traffic Safety Administration, every year about
1,00,000 police-reported crashes involve drowsy driving. These crashes result in more
than 1,550 fatalities and 71,000 injuries. Sleep-deprived drivers remain responsible
for about 40% of the road accidents, according to enforcement officers patrolling the
highways and major roads here.

Exhausted drivers who doze off at the wheel are responsible for about 40% of road
accidents, says a study by the Central Road Research Institute (CRRI).

There are different signs of driver drowsiness can be observed while driving the
vehicle such as inability to keep eyes open, frequently yawning, moving the head
forward etc.

To determine the level of driver drowsiness various measures are used. These
measures are Physiological Measures, Behavioral Measures and Vehicle-based
Measures.

In physiological measures, Electrocardiography (ECG), Electroencephalography

(EEG), and Electrooculogram (EOG) are used to access the driver’s conditions. Even
though these devices provide accurate results, due to their practical limitations, these
are not widely accepted. In vehicle-based measures, drowsiness is analyzed based on
steering wheel movements and braking patterns. Face detection Algorithms was used
to identify face regions from the input images in Face Detection phase.

2. Motivation

Driver drowsiness is a significant factor in the increasing number of accidents on

today’s roads and has been extensively accepted. This proof has been verified by
many researchers that have demonstrated ties between driver drowsiness and road
accidents. Although it is hard to decide the exact number of accidents due to
drowsiness, it is much likely to be underestimated. The above statement shows the
significance of a research with the objective of reducing the dangers of accidents
anticipated to drowsiness. So far, researchers have tried to model the behavior by
creating links between drowsiness and certain indications related to the vehicle and
to the driver.

Previous approaches to drowsiness detection primarily make pre-assumptions about

the relevant behavior, focusing on blink rate, eye closure, and yawning. The
automobile business also has tried to build several systems to predict driver
drowsiness but there are only a few commercial products available today. The
 systems do not look at driver performance and overlook driver ability and
characteristics. Naturally, most people would agree that different people drive
differently. The system that being develop able to adapt to the changes of the
driver’s behavior.

3. Related work

The current technologies available relating to the issue of our study are included in
the survey we conducted. It's an attempt to gain a better understanding of the efforts
that have gone into this field of study, as well as to determine where our efforts
should be directed when working on this project. It focuses on existing tiredness
detection technologies such as facial landmark detection, blink detection, and yawn
detection. Deep CNN, Computer Vision, Behavioral measurements, and machine
learning algorithms are among the various ways used to detect drowsiness, each with
its own set of benefits, problems, and levels of accuracy.

We'll create a computer vision-based drowsiness system for vehicles, along with
warning sounds that will inform the driver and help prevent an accident.
Other goals include developing a system that identifies driver drowsiness by
regularly monitoring the driver's eyes, particularly the retina. When the driver yawns
repeatedly or closes his or her eyes for more than a few seconds, the system should
inform him or her.

4. Proposed Method

The proposed method aims to lessen the number of accidents that occur due to drivers’
drowsiness and fatigue, which will in turn increase transportation safety. This is
becoming a common reason for accidents in recent times. Several faces and body
gestures are considered such as signs of drowsiness and fatigue in drivers, including
tiredness in eyes and yawning. These features are an indication that the driver’s
condition is improper. EAR (Eye Aspect Ratio) computes the ratio of distances
between the horizontal and vertical eye landmarks which is required for detection of
drowsiness. For the purpose of yawn detection, a YAWN value is calculated using the
distance between the lower lip and the upper lip, and the distance will be compared
against a threshold value. We have deployed an eSpeak module (text to speech
synthesizer) which is used for giving appropriate voice alerts when the driver is feeling
drowsy or is yawning. The proposed system is designed to decrease the rate of
accidents and to contribute to the technology with the goal to prevent fatalities caused
due to road accidents.

5. Methodology
Firstly, the face is localized in the image using facial landmark detection. Then, shape
prediction methods are used to detect important features on the face. Face detection is
done by OpenCV built in HAAR cascades, which are pre-trained. In the next step, to
estimate the location of 68 (x,y)-coordinates that map to facial structures, a facial
landmark detector which is pre-trained and included in the dlib library is used. It is
 also trained on the iBUG 300-W dataset. The EAR is computed using the ratio of
distances between the horizontal and vertical eye landmarks for drowsiness detection.
For the purpose of yawn detection, a YAWN value will be calculated using the
distance between the upper and the lower lip, and the distance will be compared
against a threshold value. eSpeak module (text to speech synthesizer) is used for
giving appropriate voice alerts when the driver is feeling drowsy or is yawning.

6. Plan of work
The Gantt Chart below shows a tentative schedule of our plans for the ongoing
project. We will use this schedule to ensure that we stay focused; however, plans are
not set completely and may be changed.
Driver Drowsiness Detection System Gantt Chart

Tasks Start Date End Date

1 Planning/Design 03/04/2022 02/05/2022
1.1 Project Definition 03/04/2022 11/04/2022
1.2 Project Research 12/04/2022 23/04/2022
1.3 Project Design 24/04/2022 02/05/2022
2 Coding 05/05/2022 15/07/2022
2.1 Phase 1 05/05/2022 15/06/2022
2.2 Phase 2 17/06/2022 10/07/2022
2.3 Additional Features 10/07/2022 15/07/2022
3 Testing 18/07/2022 16/08/2022
3.1 Phase 1 Testing 18/07/2022 30/07/2022
3.2 Phase 2 Testing 31/07/2022 10/08/2022
3.3 Final Testing 10/08/2022 16/08/2022
4 Documentation 17/08/2022 30/08/2022
4.1 User Guide 17/08/2022 23/08/2022
4.2 Presentation 23/08/2022 30/08/2022

References

[1] Identification of Driver Drowsiness Using Image Processing(Volume 7, Issue 4,

2020 1264) K.Praveen Kumar, Srinivasa Rao Thamanam, M. Naresh Kumar
Assistant Professors, Department of Electrical, Electronics and Communications
Engineering, GITAM (Deemed to be University), Hyderabad, Telangana,
India(2020)

[2] Deep CNN: A Machine Learning Approach for Driver Drowsiness Detection Based
on Eye State(Vol. 33, No. 6, December, 2019, pp. 461-466).

[3] Automatic detection of driver impairment based on pupillary light reflex.IEEE

Transactions on Intelligent Transportation Systems, pp. 1-11. (Volume: 20 Issue: 8)
Amodio, et al.
[4] Yang, J.H., Mao, Z.H., Tijerina, L., Pilutti, T., Coughlin, J.F., Feron, E. (2018).
Detection of driver fatigue caused by sleep deprivation. IEEE Transactions on
Systems, Man, and Cybernetics – Part A: Systems and Humans, 39(4): 694-
705(Volume: 39 Issue: 4).

[5] Anirban Dasgupta, anjith George A Vision-Based System For Monitoring The Loss
Of Attention in Automotive Drivers (IEEE Transaction), vol. 14,no.4 2013.