DRIVER’S DROWSINESS DETECTION

SYSTEM

BACHELOR OF TECHNOLOGY
In
COMPUTER SCIENCE AND ENGINEERING
By

SOMA SAI PAVAN 18C21A0541

MUCHERLA SHANKER 18C21A0532
SATLA BHARATH RAJ 18C21A0565

Under the Guidance of

MRS.G.RAMYA
(Assistant Professor Department of CSE)
 ABSTRACT

Drowsy driving is one of the major causes of road accidents and death.
Hence, detection of drivers fatigue and its indication is an active
research area. Most of the conventional methods are either vehicle
based, or behaviour based or physiological based. Few methods are
intrusive and distract the driver, some require expensive sensors and data
handling. Therefore, in this study, a low cost, real time drivers
drowsiness detection system is developed with acceptable accuracy. In
the developed system, a webcam records the video and drivers face is
detected in each frame employing image processing techniques. Facial
landmarks on the detected face are pointed and subsequently the eye
aspect ratio mouth opening ratio and nose length ratio are computed and
depending on their values, drowsiness is detected based on developed
adaptive thresholding. Machine learning algorithms have been
implemented as well in an offline manner. A sensitivity of 95.58% and
specificity of 100% has been achieved in Support Vector Machine based
classification.
 INTRODUCTION

 In recent years, there has been growing interest in intelligent vehicles. A notable initiative on
intelligent vehicles was created by the U.S. Department of Transportation with the mission of
prevention of highway crashes. The ongoing intelligent vehicle research will revolutionize the
way vehicles and drivers interact in the future. The US National Highway Traffic Safety
Administration estimates that in the US alone approximately 100,000 crashes each year are
caused primarily by driver drowsiness or fatigue. Thus incorporating automatic driver fatigue
Gwen Littlewort, Marian Bartlett, Javier Movellan University Of California San Diego Institute
of Neural Computation San Diego, CA, USA detection mechanism into vehicles may help
prevent many accidents. One can use a number of different techniques for analyzing driver
exhaustion. One set of techniques places sensors on standard vehicle components, e.g., steering
wheel, gas pedal, and analyzes the signals sent by these sensors to detect drowsiness. It is
important for such techniques to be adapted to the driver, since Abut and his colleagues note
that there are noticeable differences among drivers in the way they use the gas pedal. A second
set of techniques focuses on measurement of physiological signals such as heart rate, pulse
rate, and Electroencephalography (EEG).
 .
 It has been reported by researchers that as the alertness level decreases EEG power of the
alpha and theta bands increases. Hence providing indicators of drowsiness. However this
method has drawbacks in terms of practicality since it requires a person to wear an EEG cap
while driving. A third set of solutions focuses on computer 8 vision systems that can detect and
recognize the facial motion and appearance changes occurring during drowsiness. The
advantage of computer vision techniques is that they are noninvasive, and thus are more
amenable to use by the general public. There are some significant previous studies about
drowsiness detection using computer vision techniques. Most of the published research on
computer vision approaches to detection of fatigue has focused on the analysis of blinks and
head movements.
 However the effect of drowsiness on other facial expressions have not been studied thoroughly.
Recently Gu & Ji presented one of the first fatigue studies that incorporates certain facial
expressions other than blinks. Their study feeds action unit information as an input to a
dynamic bayesian network. The network was trained on subjects posing a state of fatigue. The
video segments were classified into three stages: inattention, yawn, or falling asleep. For
predicting falling-asleep, head nods, blinks, nose wrinkles and eyelid tighteners were used.
Previous approaches to drowsiness detection primarily make pre-assumptions about the
relevant behaviour, focusing on blink rate, eye closure, and yawning. Here we employ machine
learning methods to datamine actual human behaviour during drowsiness episodes. The
objective of this study is to discover what facial configurations are predictors of fatigue. In this
study, facial motion was analysed automatically from video using a fully automated facial
expression analysis system based on the Facial Action Coding System (FACS). In addition to
the output of the automatic FACS recognition system we also collected head motion data using
an accelerometer placed on the subject’s head, as well as steering wheel data
 LITERATURE SURVEY

1. SYSTEM REVIEW

This survey is done to comprehend the need and prerequisite of the general population, and to do as
such, we went through different sites and applications and looked for the fundamental data. Based on
these data, we made an audit that helped us get new thoughts and make different arrangements for our
task. We reached the decision that there is a need of such application and felt that there is a decent
extent of progress in this field too.
 TECHNOLOGY USED

PYTHON - Python is an interpreted, high-level, general-purpose

programming language. Python's design philosophy emphasizes code readability with its notable use of significant whitespace. Its
language constructs and object-oriented approach aim to help programmers write clear, logical code for small and large-scale
projects. Python is dynamically typed AND supports multiple programming paradigms,
including procedural, object-oriented, and functional programming.

JUPYTER Lab - Project Jupyter is a nonprofit organization created to develop open-source software, open-standards, and services
for interactive computing across dozens of programming languages.

IMAGE PROCESSING - In computer science, digital image processing is the use of computer algorithms to perform image
processing on digital
images.

MACHINE LEARNING - Machine learning is the scientific

study of algorithms and statistical models that computer systems use in order to perform a specific task effectively without using
explicit instructions, relying on patterns and inference instead. It is seen as a subset of artificial intelligence. Machine learning
algorithms build
a mathematical model based on sample data, known as "training data", in order to make predictions or decisions without being
explicitly told
 EXISTING SYSTEM

The Existing system converts the images in to text data using Artificial Neural Network (ANN) and
Machine learning (ML). The accuracy and prediction are less accurate and time
consumption is more.

The Limitations of Machine Learning:

Each narrow application needs to be specially trained.

Require large amounts of hand-crafted, structured training data.
Learning must generally be supervised: Training data must be tagged.
Require lengthy offline/ batch training.
 PROPOSED SYSTEM
Convolutional neural networks have been one of the most influential innovations in the field of computer
vision. They have performed a lot better than traditional computer vision and have produced state-ofthe-art
results.
These neural networks have proven to be successful in many different real-life case studies and applications,
like:

➢ Image classification, object detection, segmentation, face recognition;

➢ Self driving cars that leverage CNN based vision systems;
➢ Classification of crystal structure using a convolutional neural network;
➢ And many more, of course!
 SYSTEM REQUIREMENTS

SOFT WARE REQUIREMENTS

3.1 Python:
Python 3
3.2 Libraries
Numpy
Scipy
Playsound
Dlib
Imutils
opencv, etc.
Operating System
Windows or Ubuntu
 HARDWARE REQUIREMENTS

I. Laptop with basic hardware.

II. Webcam
 PSEUDOCODE

drowsiessDetection →
eyeCheck →
set blinkTime to
X set amplitude to Y
set six eye point to ep[]
openCloseCheck = (|ep[2]- ep[6]|+|ep[3]- ep[5]|)/(2*|ep[1] – ep[4]|)
if current blinkTime > X and’
current amplitude < Y
return True
else return False
yawningCheck →
set yawning threshold
set the RGB image to Binary do find the biggest hole in the mouth
do verify the mouth opening
do if current yawning status > yawning threshold
return True
else return False
alarm →
if eyeCheck() == true
OR
eyelidClosedFrameCount →
if
frameCount > 15
operateAutonomously()
else
drowsinessDetection()
else
drowsinessDetection(
) operateAutonomously →
bookNSPS()
pathNavigation()
notifyAuthority()
UML DIAGRAM OVERVIEW
UML DIAGRAM
SYSTEM TESTING
 FUTURE SCOPE
The model can be improved incrementally by using other parameters like blink rate, yawning, state of the car, etc. If
all these parameters are used it
can improve the accuracy by a lot.

We plan to further work on the project by adding a sensor to track the
heart rate in order to prevent accidents caused due to sudden heart attacks to drivers.

Same model and techniques can be used for various other uses like Netflix and other streaming services can detect
when the user is asleep
and stop the video accordingly. It can also be used in application that prevents user from sleeping.
 CONCLUSION
 It completely meets the objectives and requirements of the system. The framework has achieved an unfaltering
state where all the bugs have been disposed of. The framework cognizant clients who are familiar with the
framework and comprehend it's focal points and the fact that it takes care of the issue of stressing out for individuals
having fatigue-related issues to inform them about the drowsiness level while driving.
 REFERENCES
➢ United States Department of Transportation., “Intelligent vehicle
initiative.,”http://www.its.dot.gov/ivi/ivi.htm./.
➢ United States Department of Transportation., “Saving lives through advancedvehicle safety technology.,”
http://www.its.dot.gov/ivi/docs/AR2001.pdf.
➢ Y. Takei, Y. Furukawa, “Estimate of driver’s fatigue through steering motion,” in Man and Cybernetics, 2005
IEEE International Conference, Volume: 2, On page(s): 1765- 1770 Vol. 2.
➢ Kei Igarashi, Kazuya Takeda, Fumitada Itakura, and Huseyin Abut, DSP for In-Vehicle and Mobile Systems,
Springer US, 2005.
➢ W.A. Cobb., “Recommendations for the practice of clinical neurophysiology.,”Elsevier, 1983.
➢ Kim Hong, Chung, “Electroencephalographic study of drowsiness in simulated driving with sleep
deprivation.,” International Journal of Industrial Ergonomics.,Volume 35, Issue 4, April 2005, Pages 307-320.
➢ Haisong Gu and Qiang Ji, “An automated face reader for fatigue detection,”automatic face and gesture