Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

1

Development of Fatigue Detection Device


Based On IR-UWB and Optic Sensor to Driver

Adrian Kusuma Rahardjo, Arief Kurniawan, ST., MT. , Dr. I Ketut Eddy Purnama, ST., MT.
Departemen Teknik Komputer, Fakultas Teknologi Elektro, Institut Teknologi Sepuluh Nopember
Jl. Arief Rahman Hakim, Surabaya 60111
E-mail: iankusumarahardjo@gmail.com

Abstract— Fatigue is one of the biggest causes of accidents common complaints of people seen in primary health
while driving. To this end, this task is performed on the care. Fatigue is common and sad for those who suffer from
development of the driver fatigue detection device. This device rheumatoid arthritis, diabetes, multiple sclerosis, AIDS, and
consists of infrared-UWB radiation that works to detect the those who are subject to radiation or chemotherapy, are
breathing wave and optical sensors to detect the driver's heart
limited to. It is also a major disorder in people with chronic
rate. The results of respiratory wave detection and heart rate
will be processed using Single Board Computer and display fatigue syndrome, a poorly understood condition
them on the screen. The initial storage will be performed on characterized by persistent and debilitating fatigue. In fact,
local storage and then proceed towards cloud storage. Using the nature of fatigue that exists everywhere makes a full
cloud storage will make it easier to store data so that it makes understanding become more challenging for researchers and
it easier to monitor over the Internet. This fatigue detection physicians [5].
device can be applied to industrial trucks or at-risk transport Fatigue is a state of mind where response time is slower
industries will cause fatigue in driving. than natural levels. This is a natural physiological state
triggered by circadian rhythms and lack of sleep. Symptoms
Keywords: IR-UWB, Sensor Optics, Fatigue, Driver.
of major fatigue are lack of concentration, attention, focus,
alertness and difficulty in staying awake. Late stages of
I. INTRODUCTION fatigue cause micro-sleep episodes where a person becomes
ncreased traffic accidents first a lot Due to the low level completely unconscious for a few seconds to 30 seconds.

I of alertness of the driver. The total number This is a


serious concern in the local community. Statistics
indicate that the main causes of traffic accidents Which
Mental fatigue is a natural response to the phenomenon of
the human brain in our daily lives and is defined as a state of
cortical deactivation, which reduces mental performance and
reduces alertness. The main symptoms of mental fatigue are
causes death injury due to the low level of vigilance on the
driver. On the industrial trucks, 57% of the cases of fatal slow reaction time, general sensation of weakness, feelings
accidents were due to driver fatigue [1]. of being hampered and disturbed. Mental fatigue is a serious
Empirical evidence on the case of an accident is a problem and results in operating errors, especially in the
separate effect. As well as a subscriber that stems from fields of transportation and flight [6].
several factors such as fatigue and low performance. The
research indicates that Fatigue is not enough tracking and • Driver Drowsiness
reporting the cause Accident on the highway. And the Sleepiness is considered a significant risk factor that
accident is the effect from long and irregular hours, even the contributes greatly to the increasing number of motor
longest Rather than driving [2]. vehicle accidents every year. Important aspects of driving
A variety of methods have been used to detect the disruption associated with drowsiness are slow reaction
condition Driver. Use of the electrical brain signal (EEG), time, reduced alertness, and deficits in information
electric cochlea (EOG), electroencephalography (ECG) to processing all of which lead to abnormal driving
detect fatigue based on conditions physiologi drivers, behavior. Driver drowsiness is usually used
However, this solution is extremely uncomfortable because interchangeably with the term driver fatigue. However,
the driver is required to wear the device to perform the each of these terms has its own meaning. Fatigue is
detection of [3]. Detecting fatigue on the driver to use considered as one of the factors that can cause drowsiness
infrared-UWB radar Optical sensors can solve all the and is a consequence of physical work or prolonged
problems mentioned above. Infrared-UWB can work in the experience and is defined as a tendency to continue with
dark and measurements do not require direct contact on the existing tasks.
B.
body Without disturbance the comfort of the driver [4]. B.
B. Sensor Optik
II. DASAR TEORI
A. Fatigue
Fatigue is a global symptom that is not only associated
with acute and chronic diseases, but also deals with health
functions normally and daily life. This is one of the most
2

Figure 1. The process of recovering data using optical 8. Complete electrical isolation of high power
sensors. possibilities.
Optical sensors can be used in a wide range of research and 9. Remote operation on several kilometers: ideal for use in
commercial applications at the time now. This sensor can be harsh environmental conditions.
used in medical technology, metering, mapping, and QC
process. It currently has a lot of variety of optical sensor
systems based on laser, mapping, and fibers. The optical C. Impulse Radio-Ultra Wideband (IR-UWB)
sensor is a tool that can transform a beam of light into Ultra Broadband-Radio Rush (UWB-IR) is a hardware
electronic signals. Similar with light resistance, optical device that is used as a radar sensor with High precision for
sensors measure light physical quantities and translate them detecting the wave of the respiratory tract and objects. The
into a model that can be read by metrics. One of the features infrared-UWB consists of an integrated circuit (IC)
of the optical sensor is the ability to measure one or more generator impulse in the transmitter and is discharged with a
glow changes. Other features of the optical sensor which is circle IC baseband range Incorporated as receiver Kurreator
in the process of placing the sensor either internally or [8]. Send me R-UWB forwards waves of very thin and
externally on a device. This can be seen in Table 1. receive the receiver of wave racsy of results [9]. Use of
technology Infrared-UWB in solutions that allow detection
Ekstrinsik Intrinsik of objects, localization, tracking in a closed environment,
Suhu Rotasi infrared-UWB has a high distance accuracy range, summary
size, and Affordable fees [9].
Tekanan Akselerasi In this study, UWB Wireless Radar Drive (IR-UWB) is
Aliran cairan Tegangan used to detect, localize and track mobile targets in the
Kadar cairan Vibrasi neighbourhood. The infrared-UWB radar has one transmitter
Kurang sensitif Lebih sensitif and one receiver. The transmitter in the radar sends a very
Mudah multiplexing Lebih sulit multiplexing narrow pulse, and the receiver receives the reflected pulse.
Terdapat masalah koneksi Mengurangi masalah koneksi Signals are received through several steps of signal
processing to extract the target signal. This target signal.
Mudah digunakan Demodulasi lebih rumit
Generally suffers from chaos, noise, and attenuation. By
Lebih terjangkau Lebih membutuhkan biaya Therefore, the removal of unwanted signals and signal
compensation is an important task to improve the capacity
Table 1 Comparison of optical and external sensors To uncover the target.
Substantive. Xethru Breathing Unit (X2M200) work by measuring the
movement of the human body with the rest of the rotating.
The new sensor method, which allows for a more This profile is optimized to measure someone's breathing
sophisticated discovery, continues to be developed using awake with the sensors placed in the chest height or
New substances, such as supermaterials, micro and nano- abdomen pointed towards the chest or abdomen.
regulated or using new frequency bands such as THz The parts of the body that produce the best signal will
radiation, for example. vary from one person to another. Some shallow breathing,
The optical sensor is the device that converts light into the air pulls in the chest area, the next biggest movement
electronic signals. Similar to the resitor image, optical comes from the chest. While others breathe deeper, the
sensor to measure the physical amount of light and translate stomach cavity expands instead of the chest. In this case, the
it into a readable form on the instrument. One of the features stomach will be the largest movement at the time of
of optical sensor is the ability to measure changes from one Detection.
or many light rays. These changes often occur because of Burst radar used in infrared-UWB features ultra-wide
the light intensity effect. Optical sensors can work with a bandwidth The transmission power is very weak. Because
single point method or distribution point. Through one the motive is signals such as sound, infrared signal
point, the method changes the single phase necessary to processing is usually done in the time area compared to the
enable the sensor. On the roads of a distribution point, the frequency area.
sensor will activate on all series of sensors [7].

• Advantages of Optic Sensor


Take advantage of the optical sensors listed below [7]:
1. Completely passive: can be used in volatile
environments.
2. Immune to electromagnetic interference: ideal for use
in the land environment of magnetic field.
3. Resistant to high temperature and reactive Gambar 2. Modul IR-UWB (XeThru X2M200)
environments with chemical fluid: ideal for harsh and
unfriendly environments.
4. Small size: Ideal for installation on any media. D. Heart Rate
5. High level of Biokompabilitas: ideal for medical Human heart rate is the integrated cardiovascular qualities
applications. of survival prediction [10]. Although properties such as
6. Physical and chemical reactions can be monitored. heart rate (HR) and blood pressure (BP) are usually reported
7. The potential used for sensitivity, range and high in studies related to the relationship between fatigue and
precision. function Heart, some reports examine how heart function
3

parameters such as heart output (CO) and stroke size (SV) calculated quickly and breathe visually shallow possible
associated with fatigue. Calculating the rate of fatigue Is the Missed. Agitation, anxiety and fever can cause respiratory
result of 6% of the variant Stroke index and 8% of the heart disturbance increase breathing rate not related.
variables Index. The effects of fatigue are also based on Average breathing rate based on age [12]:
Demogra dataBe As Age, ethnicity, and gender [11]. 1. Age from 0 to 6 weeks : 30-60 RPM
The human heart rate is grouped by age, i.e. [12]: 2. Age six months : 25-40 RPM
1. Newborn: 140 BPM 3. Three years old : 20-30 RPM
Newborn: 140 BPM 4. six years old : 18-25 RPM
2. Age one year :120 BPM 5. Ten years old : 15-20 RPM
3. Two years old :110 BPM 6. Adult : 12-20 RPM
4. Five years old :96-100 BPM
5. Ten years old :80-90 BPM
6. Adult :60-80 BPM

1. Determining the degree of fatigue

Gambar 5. Normal breathing during waking.

1. Determining the degree of fatigue


The investigation is by Table 2, and the respiratory rate
changes that indicate someone in the sleep state (RPM
values are less than 12). Data is the value of breathing rate
Gambar 3. Determining the degree of fatigue [13] in ordinary adult people.

Based on Figure 3, for the results of setting the Perubahan Nilai dari Kondisi
Referensi Terjaga
drowsiness level using the heart rate sensors can be obtained Terjaga
using the formula. The level of drowsiness on the basis of Tabachnik et al
heart rate is obtained from the average of the entire heart 17,4 -9,8
[14]
rate data during the test. Krieger et al [15] 16,2 -3,1
Lopes et al [16] 16,3 -3,7
Shore et al [17] 16,4 -9,1
Gould et al [18 14,4 -2,8

III. SYSTEM DESIGN

On the systems that were built, a IR-UWB sensor to get a


RPM value and optical sensors to get the BPM value while
driving motorists. All of the sensors are placed on the wrist
(optical sensor) and lead the chest cavity (IR-UWB). The
data will display the result of detection on the attached LCD
screen and real-time display data RPM and BPM. In order to
Gambar 4. Detecting drowsiness [13]. achieve the research mission, create a system design that
describes the Walker conceptAC power System.
E. Respiratory Rate
Respiratory system provides oxygen and eliminate me.
Carbon dioxide to regulate the partial pressure of the oxygen
accurately and carbon dioxide in arterial blood. This role is
partly performed by regulating the respiratory rate and the
size of the tide on Its turn is controlled by the work of
kemoreseptor who feel oxygen, carbon dioxide and ph.
Mechanical receptors of the lungs. and respiratory centers in
the Marrow and bones. Breathing The natural tide phase
consists of an important and ekspirasi and occurs with the
simultaneous movement of the chest and abdomen.
The respiratory rate is measured using 15, 30 and 60
seconds. However, the most accurate count of 60 seconds
due to a shorter duration often exaggerations at a number of
breaths per minute. In pediatric studies, the respiratory rate
is calculated With your stethoscope And instead of the
visual was 20-50% higher and more accurate the volume of
Figure 6. Overview of the work system.
breathing shows that the tides are only bigger tend to be
4

Fatigue detector system stages the riders as The blepython and optical sensors for the library Module
following: Controller Censored Library IR-UWB.
1. Capture data using respiratory sensor and heart rate Initial process before unauthorized access to data any
sensors. There are two types of parameters, namely, calibration process model Authenticate to each sensor.
breathing waves and heart rate. Optical heartbeat Optical sensors are always calibrated to every use on
sensor installation placed on the wrist while installing passenger drivers. Optical sensor requires less than 5
a breathing sensor using infrared-UWB X2M200 minutes of new sensor conditions Connect with BLE. While
directed at the chest area. the IR-UWB sensor requires Less than 10 seconds to do
2. After the values of the parameters obtained, the data is authentication. After optical sensor detects BPM and IR-
sent towards Single Board Computer In two ways. UWB sensor detects RPM, the acquisition process can be
Upon delivery, the sensor data using a serial cable, initiated by optical and infrared-UWB sensors. As a result of
while the heart rate sensor using a BLE (Bluetooth the acquisition of sensors in the form of raw data and then
Low Energy). Processed using a library for each sensor. Data Arranged in
3. The data is processed on the SBC. Driver data is the form of serialization data with string type with add
processed in the form of breathing and heart strokes to Contains the comma (,) in order to distinguish the data with
determine whether the driver's condition is in normal each other. Then DATA data is saved to the local SBC in
conditions or in conditions of fatigue. the form BeLe type CSV. That would be available to be sent
4. Data storage will be saved locally in CSV format. to cloud storage and data visualization. Data retrieval By
5. Real-time data appears on the monitor that is installed sensors are performed every second. Workflow Retrieve
on the tool. Data from sensors described in figure 9.
6. As a condition for BingHurry When you're in the
momentn tired, the driver will receive notice in the
form of vibrations Embedded optical sensor.
7. Data will be sent to cloud storage when the device is
connected to the Internet, so that raw data can be
displayed on local storage online to monitor the
driver's condition and can be used as a limit when
driving.
A. Installation of the driver's sensor contract

Figure 8. Schema Configuration sensor node

Figure 7. Mounting Sensore node charts on the driver

Installation sensor node Placed on the wrist for optical


sensors and routed in the bra for IR-UWB sensor.

B. Retrieving data related sensor node


Figure 9. Retrieving flowchart data to an SBC
Composition of optical and infrared-UWB sensors in the
SBC, as shown in Figure 8. Sensor node It is made up of
several components namely the optical sensor Xiaomei Mei
Band 2 and the IR-UWB sensor Xethru the respiratory unit
connected with the SBC Berry Pi 3. Optical sensors
connected to the Pi berry via low-power Bluetooth (BLE)
that has a MAC address as a means of communicating with
the SBC. While IR-UWB sensor connected to most serial
communications with SBC (Universal Asynchronous
transceiver). The SBC program use some libraries including
5

C. Notifikasi Tanda Kelelahan screen. and results It brings the value of BPM rotation and
RPM in real time. On the initial terms, the BPM value and
the value RPM = 0, and then when the Start button was
pressed, the BPM value and RPM will appear according to
the conditions of the user's heart rate and respiratory
system..

Figure 12. View initial conditions User Interface

Figure 10. Signs of fatigue in the flowchart report.

Figure 13 Case At the time the Start button is pressed

B. Device Test

In this research, the test was performed on a device used in


the sensor node, i.e. optical and infrared-UWB sensors to
determine the value of the precise optical sensor and the IR-
Figure 11. Sign the dangers of fatigue.
UWB sensor. There are two tests for visual sensors i.e. test
accuracy at the moment of silence, while driving, while
In this process, a driver who suffers from fatigue will get
sleeping and testing the accuracy of the IR-UWB sensor for
a warning in the form of vibrations coming from an optical
any accurate moment of silence test, while driving, and
sensor (MIBAND2). The notice will appear when the
sleep time.
driver's heart rate reaches 60 beats per minute or the < 12
rpm <. Drivers with fatigue will get a warning shake for four
1. Optical sensor test
seconds.
In this test, you make a comparison between the BPM
value obtained by the optical sensor with the same
IV. TEST AND DISCUSSION object. This test is used to see the value of the optical
There are four stages of test and testing. User sensor line used when the condition is silent, driving
InterfaceTest device, test, warning systems, and test data and sleeping.
validation.

A. User Interface Test

Give me the test user interfaceThe test is done, whether the


data of the sensor can be ter Isasikan Visualizer on the LCD
6

Figure 18. Respiratory Rate at sleep


Figure 14. Heart Rate at steady phase

Figure 19. Respiratory Rate at drive

C. Alarm Systems Test


Figure 15 Heart Rate at sleep
In this test, the heart rate and breathing will appear at the
time of fatigue that the user has not detected. When
suffering from unknown fatigue, the MI Band 2 device will
vibrate four times.

Figure 16. Heart Rate at drive


Figure 20. Respiratory Rate if there is a warning

2. Pengujian Sensor IR-UWB

Figure 21. Heart Rate If there is a warning

Figure 17. Respiratory Rate at steady phase


7

V. CONCLUSION smartwatch," International Journal of Arti_cial Intelligence


The developent of detecting fatigue based on the and Interactive Multimedia, vol. 3, no. 3, pp. 96-100, 2015.
UWB-IR device and optical sensor on the driver can be [14] T. E. dan Muller NL dan Bryan AL dan Levison H,
applied to me The driver that is exhausted with the old “Changes in ventilation and chest wall mechanics during
wheel for at least 30 minutes. The results of fatigue sleep in normal adolescents," J Appl Physiol, vol. 51, pp.
detection were according to a known reference. The warning 557-64, 1981.
requirement of fatigue for the driver was according to the [15] K. J. dan Turlot JC dan Mangin P dan Kurtz D,
data obtained at the time of data retrieval. “Breathing during sleep in normal young and elderly
subjects: hypopneas, apneas, and correlated factors," Sleep,
vol. 6, pp. 108-20, 1983.
Bibliography
[16] L. J. dan Tabachnik E dan Muller NL dan Levison H
dan Bryan AC, “Total airway resistance and respiratory
[1] J. Qiang, Z. Zhiwei, and L. Peilin, “Real-time
activity during sleep," J Appl Physiol, vol. 54, pp. 773-7,
nonintrusive monitoring and prediction of driver fatigue,"
1983.
IEEE Transaction on Vehicular Technology, vol. 53, no. 4,
[17] S. E. dan Millman RP dan Silage DA dan Chung DCC
pp. 1052-1068, 2004.
dan Pack AI, “Ventilatory and arousal patterns during sleep
[2] B. I. D, “Driver fatigue," Human Factors, vol. 36, no. 2,
in normal young and elderly subjects," J Appl Physiol, vol.
pp. 298-314, 1994.
59, pp. 1607-15, 1985.
[3] L. W. Chieh, Y. John, S. D. Chuan, and L. M. Han,
[18] G. G. dan Gugger M dan Molloy J dan Tsara V dan
“Changes in physiological parameters induced by indoor
Shapiro CM dan Douglas NJ, “Breathing pattern and eye
simulated driving: Effect of lower body exercise at mid-term
movement density during rem sleep in humans," Am Rev
break," Sensors, vol. 9, pp. 6913-6933, 2009.
Respir Dis, vol. 138, pp. 874-7, 1988.
[4] L. S. Kyu, K. Faheem, and C. S. Ho, “Vital sign
monitoring and mobile phone usage detection using ir-uwb
radar for intended use in car crash prevention," Sensors, vol.
17, p. 1250, 2004.
[5] A. L. S. dan Teel Cynthia S dan Cassmeyer Virginia dan
Neuberger Geri B dan Pallikkathayi Leonie dan Pierce Janet
dan Press Allan N dan Williams Phoebe D dan Wingate
Anita, “Defining and measuring fatigue," Image: Journal of
Nursing Scholarship, vol. 31, no. 1, pp. 45-50, 1999.
[6] A. H. dan Al-Nuaimy Waleed dan Al-Ataby Ali dan
Salem Sameh A dan Al-Zubi Hamzah S, “Prediction of
driver fatigue: Approaches and open challenges," IEEE, vol.
978, no. 1, pp. 4799-5538, 2014.
[7] A. Dhiraj and P. Deepa, “Optical sensors and their appli-
cations," Journal of Scientific Research and Reviews, vol. 1,
no. 5, pp. 60-68, 2012.
[8] S. B. dan Nasr Ismail dan Trasser Andreas dan Schuma-
cher Hermann, “Ir-uwb radar demonstrator for ultra-fine
movement detection and vital-sign monitoring," IEEE
Transaction on Microwave Theory and Techniques, vol. 61,
no. 5, pp. 1-10,2013.
[9] N. Van-Han and P. Jae-Young, “Location detection and
tracking of moving targets by a 2d ir-uwb radar system,"
Sensors, vol. 15, pp. 6740-6762, 2015.
[10] Z. K. dan Deacon Dekker C dan Rao Fangwen dan
Schork Andrew J dan Fung Maple M danWaalen Jill dan
Schork Nicholas J dan Nievergelt Caroline M dan Chi Neil
C dan OConnor Daniel T, “Human heart rate," Journal of
the American College of Cardiology, vol. 63, no. 4, pp. 358-
368, 2014.
[11] N. R. dan Dar Yasmin dan Thomas KaMala dan
Dimsdale Joel E, “The relationship between fatigue and
cardiac functioning," Arch Intern Med, vol. 168, no. 9, pp.
943-949, 2008.
[12] L. C. R. dan Sizilio Glucia RA dan Neto Adrio DD dan
Valentim Ricardo AM dan Guerreiro Ana MG, “A fuzzy
model for processing and monitoring vital signs in icu
patients," BioMedical Engineering OnLine, vol. 10, no. 68,
pp. 1-17, 2011.
[13] A. S.-R. dan Merino Jos Luis Miguel dan Snchez Andrs
Milln dan Snchez lvaro, “Variation of the heartbeat and
activity as an indicator of drowsiness at the wheel using a

You might also like