Professional Documents
Culture Documents
Synopsis
Synopsis
Synopsis
by
Guide:
CERTIFICATE
This is to certify that the project entitled “Android Based Heartrate
Monitoring System and Automatic Notification System” is a bonafide work
of “Ms. Aishwarya Palvi(IEN-11712032), Mr. Raj Patil (IEN-11712034),
Ms. Priyanka Chaudhari (IEN-11612003) submitted to the University of
Mumbai in partial fulfilment of the requirement for the award of the degree of
Bachelor of Engineering in Computer Engineering
__________________
Mr. Rishikesh Nikam
Guide
_________________ ___________________
Dr. Sanjay Sharma Dr. Prashant Deshmukh
Head of Department Principal
ii
NEW HORIZON INSTITUTE OF TECHNOLOGY AND
MANAGEMENT, THANE
Date:
Place:
Abstract
iii
In this paper, the design of an integrated portable device that can monitor heart rate (HR)
continuously and send notifications through short message service (SMS) over the cellular
network using Android application is presented. The primary goal of our device is to ensure
medical attention within the first few critical hours of an ailment of the patient with poor
heart condition, hence boost chances of his or her survival. In situations where there is an
absence of doctor or clinic nearby (e.g., rural area) and where the patient cannot realize their
actual poor heart condition, is where our implemented system is of paramount importance.
This paper proposes a methodology to measure a heart rate using photoplethysmogram (PPG)
— a technique that uses infrared light to detect changes in the blood flow volume in tissues.
We present a new application of the Android smartphone’s camera equipped with LED flash
which used for recording the intensity of light from the fingertip blood volume. The red
channel of RGB signals in each picture frame recorded by smartphone returned the
plethysmographic information. This contextual information will be converted into time
domain signal by using Fast Fourier Transform (FFT) for further used in heart rate estimation
process. The final results is the heart rate of each person recorded within 40 seconds. The
designed system shows the real time HR on the mobile screen through Android application
continuously and if any abnormal HR of the patient is detected, the system will immediately
send a message to the concerned doctors and relatives whose numbers were previously saved
in the Android application. This device ensures nonstop monitoring for cardiac events along
with notifying immediately when an emergency strikes.
CONTENTS
iv
1 Introduction ........................……………………………………………………….….1
5 Implementation plan………………...………………………………………………...18
References ........................................................................................................................21
LIST OF FIGURES
v
1.2 Heart Rate Monitoring Technique………………………………………………...2
2.2 Background……………………………………………………………………….6
LIST OF TABLES
vi
Introduction
Chapter 1
Introduction
Monitoring vital parameters such as heart rate, blood pressure plays a very important role in
detection, recognition the dangerous situation and prevent of any health diseases. Heart rate is
important because the heart's function is so important. The heart circulates oxygen and
nutrient-rich blood throughout the body [1]. An abnormal rate or rhythm may be discovered
during a physical exam, ECG, or other testing, even in healthy people who have no symptoms.
By far, the only viable diagnostic tool that could ascertain cardiac events is HR readings.
Henceforth, HR monitoring and alert system which is able to monitor the HR condition of a
patient is very effective in the detection of heart diseases and Photoplethysmogram (PPG) has
been employed to compute HR [3]. Currently, there are some Android applications that can
monitor HR but do nothing when hearts condition is poor. It would be a breakthrough if an app
is developed that incessantly monitors HR and if detected unusual, sends messages to all saved
mobile numbers with precise GPS location of the patient and current HR. In this regard, this
literature describes a system that determines the HR per minute in real time and then sends
SMS alert to the mobile phone in face of emergency or user requirement [1].
1
Chapter 1
The distribution of each color must greater 40 This modification thresholds constructed from
our investigation of RGB color histogram in each captured frame. These thresholds will
perform in case that LED is used. We found that the color distributing in the channels of the
error frames rules usually spread out of the ranges: 1) the red channel of each error frame has
pixel values that concentrated in the lower half of its value range, 2) the green channel of
each error frame has pixel values that less than 10 or concentrated in the higher half of its
value range and 3) the blue channel of each error frame has pixel values that concentrated in
the higher half of its value range. Any frame that has a mean and distribution of RGB color
fits in this range is determined as a correct frame will present a central region of fingertip
shown in Fig.3 (a). The correct frames will be further collected into an array. Some example
of correct and incorrect fingertip placing frame are shown in Fig.3 which obviously seen that
the red channel provides the most outstanding PPG signal.
include: login, registration, logout, profile edit, report view, data input, validate the newly
added data and generate a graph from it. When the application is launched for the first time,
the login panel is deployed. It asks for a username and a password. If the credentials provided
in the mentioned field matches with the database, the user is authenticated and the user panel
on the application is launched. In case of a new user, once the fields have been filled, it
checks into the database for the user. If the email address provided is unique, the user is
registered and then taken to the user panel, much like the login process. Once, the user is
logged in, the username and password is stored locally on the Android device using shared
preferences.
3
Chapter 2
Chapter 2
Literature Survey
4
Chapter 2
The application utilizes an imaging acquisition concept similar to that found in commercially
available pulse oximeters in which infrared light is used to determine oxygenated and
deoxygenated blood based on the blood opacity (i.e., oxygenated is brighter red than
deoxygenated which is blue/purple). Variable levels of opacity are illuminated by the camera
light and measured by the camera’s five-megapixel photodetecting lens, as it passes through
the pulsating capillary tissue beneath the surface of the finger. Measurements are tracked
overtime and analyzed until a pulsatile signal is properly detected [6]. The first step was to
determine if the image captured from the light provided by original equipment
manufacturer’s (OEM) LED flash and five-megapixel camera could be passed through
software image analysis filters to detect the appropriate wavelengths for efficient pulse
detection based on variations in opacity. The next step was to determine whether the
smartphone could process frame-by-frame image analysis in a timely and consistent manner,
in order to detect the small pulsatile color changes. An nv21 YUV planar frame format was
used to allow for efficient processing of both light and color intensity changes. Real-time
trials were used to determine an optimum settings bundle of frame capture rate (20 fps),
image pixel density , focus mode (infinity), and software image analysis filters. The next
step was to detect changes of blood flow by comparing values over a series of frames.
During this step, points were gathered and graphed to help programmers visually discern
changes of blood flow. Throughout this process, the development team compared signal
detection by the developed application with a Nonin Onyx II model 9560BT oximeter
(Nonin Medical, Plymouth, MN). Initial comparisons allowed assurance of capturing opacity
Chapter 2
changes representative of accurate pulsatile readings during the recording and graphing of
data. A history system aids the detection of HR pulses as well as accumulates the pulses to
generate beats per minute HR feedback [6]. Once the appropriate signal-to-noise ratio was
established, minor adjustments were made to ensure noise or small changes in the user’s
finger position did not disrupt the continuous monitoring of HR. Finger movements that
resulted in unobtainable HR measurement or finger removal results in vibration-based
feedback to the user to reposition the finger on the camera lens. The smartphone HR monitor
application directs each step of the process from video capture, video processing and
analysis, and feedback to the user in a graphical user interface [6].
2.2 Background
Industry experts say the widespread use of mobile apps and devices that are fully integrated
into a comprehensive healthcare and wellness information system remains a work in
progress. According to some experts, authoritative curation of mobile apps is needed to ease
physician uncertainty about adopting apps more widely for clinical use. Much more progress
is needed in developing and disseminating apps that enable healthcare providers to help
patients manage their medical conditions [7]. “We can see within five years apps moving
from novelty to mainstream,” said Murray Aitken, executive director of the IMS Institute for
Healthcare Informatics [7]. A recent report Aitken co-authored, based on a study of nearly
43,700 purported health or medical applications available on Apple's iTunes App Store,
found that only 54% of them provided results that could serve clinical purpose. Of those,
69% targeted consumers and patients while 31% were built for use by clinicians. Most of the
consumer healthcare apps were “simple in design and do little more than provide
information” according to the IMS report. Only 159 of the consumer apps could track or
capture user-entered data, and fewer than 50 relate to condition management or provide tools
and calculators for users to measure their vitals. That leaves “considerable room for growth
in this sector,” the report said [5]. Doing some market research over the medical equipment
and their related application, we did not get any useful application that can help us in regard
of reducing chronic heart disease. A custom build app can provide all those abilities that a
patient may need in order to monitor heartrate in a regular basis [7].
According to WHO, the greatest killer in the world are the cardiovascular diseases
(CVD).An estimated 17.5 million people died from CVDs in 2012, representing 31% of all
global deaths. Over three quarters of CVD deaths take place in low- and middle-income
6
Literature Survey
countries [3]. According to the latest WHO data published in May, 2014 Coronary Heart
Disease Deaths in Bangladesh reached 50,708 or 6.96% of total deaths. The age adjusted
Death Rate is 53.53 per 100,000 of population ranks Bangladesh #150 in the world [7]. As
most of the population of Bangladesh belongs to the lower income group, improvements in
diagnosis and treatment tools in a less cost are welcomed by the medical community which
inspires the growth of research in Remote Patient Monitoring (RPM). The developed system
is built based on a pulse rate sensor which will be monitored via a mobile application. So,
the system will be portable, will able to take regular readings and will offer better
monitoring from home. It will not require any distant visit for patients who have problem in
travelling. The system will generate organized data with minimum chances of fragmented
report. The result will be stored with minimum time delay as the observers will not need any
paper. The mobile application and webpage both will generate a graph view of data which
will ease the task of report generation for the doctors. So, doctors will be able to monitor
their patients on a regular basis from anywhere with a proper internet connection. The data
will be cross-checked against a predetermined data range and it will be able to provide a
minimum indication about the data which will assist the doctor in concluding his report. The
reports will be updated to the database and notify the patients, facilitating storage system on
the server [7].
7
Chapter 2
Chapter 3
3.2 Objectives
To be able to calculate the Heart Rate by calculating the blood change volume in the
fingertip.
To suggest the user a diet according to his Heart Rate and to maintain to good health
for his heart
To send notification to the concerned Doctor or relative as per stored information in
the system.
To track the location of the patient through GPS system.
3.3 Scope
This application will provide the user function to monitor his Heart Rate instantly.
The application would help to calculate the BMI of the user, using the input of weight
and height.
According to the BMI, the user will also be suggested with the diet he should
follow to maintain the BMI .
The Application also provide the user any specific diet if he needs one. For E.g. For
Weight loss or weight gain.
8
Proposed Syste
It would also help the user to create a SOS alarm and send SMS to his selected
contacts.
This Application would also suggest the user any nearby hospitals if he needs one.
9
Chapter 3
Chapter 4
Proposed System
4.1.1 Java
Java is a popular programming language. Java is used to develop mobile apps, web apps,
desktop apps, games and much more.
4.1.2 MATLAB
MATLAB is a programming and numeric computing platform used by millions of engineers
and scientists to analyze data, develop algorithms, and create models.
10
Chapter 4
4.2.2 Processor
The processor of your smartphone is the component that converts all your actions into visual
changes on the screen. For this project we require dual core of above processor.
4.2.3 Memory
Internal memory is the manufacturer-installed storage space, usually 16, 32 or 64GB, where
the operating system, pre-installed apps, and other system software is installed. Here we
need 2gb or more RAM.
Read the incoming real time BPM. Using android application of our GUI interface
anybody can check his/her BPM value anytime when he/she wants [1].
If BPM is out of the normal range (60-140) it will start a countdown of 10 seconds
[1].
If all BPMs are out of normal range within this countdown the app will assume
emergency condition [1].
An SMS will be sent to all saved numbers in app. The SMS will contain: precise
location co-ordinates (using GPS built in smart phone), approximate location [1].
22
Proposed System
The susceptibility of the PPG signal to poor blood perfusion of the peripheral tissues and
motion artifact is well known.18 In order to minimize the influence of these factors in the
subsequent phases of the PPG analysis for beat-to-beat estimation, a preprocessing stage is
required [11]. This step is comprised of:
The PPG input data is processed using a window of T0 seconds and further blocks are
processed by moving the window with mT0 (that is, m = 3/4) overlap. A band-pass filter is
then required to remove both high frequency components (such as power sources) of the
PPG signals, as well as low frequency components such as changes in capillary density and
venous blood volume, temperature variations, and so on. Figure 2a and 2b show a PPG
signal before and after filtering. The filter has a cutoff frequency at 0.4 Hz and 4 Hz. The
fundamental frequency of the HR ranges between 0.4 Hz to 3 Hz. Therefore, using a range
that is a little higher for beatto-beat estimation allows us to include harmonics that
emphasize the beat times. Sudden spikes are removed from the filtered signals using a
median filter. Then, an AGC module limits the signal level to ±V volts in order to verify the
selected peaks by checking the amplitude of the signal at a later stage. The durable PPG
measuring process for HRV unavoidably introduces another type of artifact, such as baseline
wandering. Consequently, a low-pass finite impulse response (FIR) filter is used to smooth
the array of the PPG samples in the frame (shown in Figure 2c), to remove the baseline
wandering noise, and to get a smoother signal for the delineation module [11].
13
Chapter 4
22
Proposed System
15
Chapter 4
22
Proposed System
17
Chapter 4
Chapter 5
Implementation Plan
22
5.2 Gantt Chart
19
Chapter 5
Expected Outcome
Our objective with the present work is to put forward a continuous HR monitoring and
automatic notification system over the cellular network. The monitoring system is mainly
based on an Android platform, which not only continuously displays the real time HR on the
mobile screen but also generates SMS and sends it to the saved mobile numbers when
abnormal HR is detected. Application of this system includes providing medical attention
within the initial stage of determination of unorthodox HR of patients who may be at distant
locations with no doctors or when the patient is illiterate. In this paper, a review of existing
algorithms for heart rate measuring using mobile phones will be evaluated. The objective of
this proposed algorithm is to develop Android application to measure HR in real time with
duration about 10 seconds that optimizes for any smartphones. Thus, this method will
propose a simple moving average filter with only 7 coefficients to reduce complexity when
developing on Android platform and is expected to achieves affordable accuracy with
classification stage with distant constraints and RGB threshold that outperformed some
previous works with the same 400 video samples as input data and work stably on different
android mobile devices with 50 sample tests. We are also going to use the statistical method,
the paired samples test, to calculate the difference between the heart rate result from a digital
blood pressure monitor and one from our application which uses PPG technique.
20
References
[1] Android Based Heart Rate Monitoring and Automatic Notification System(2017 IEEE
Region 10 Humanitarian Technology Conference (R10-HTC)).
[2] https://www.hindawi.com/journals/ijta/2014/625156
[4] https://gwrymca.org/blog/why-monitor-your-heart-rate-during-exercise
[5] https://ijarcce.com/wp-content/uploads/2012/03/IJARCCE4C-s-mayuri-Android-Based-
Heart-Monitoring.pdf
[6] https://www.hindawi.com/journals/ijta/2012/696324/
[9] Heart Rate Measurement System Using Mobile Devices to Alert Arrhythmias(2015 12th
International Conference on Electrical Engineering, Computing Science and Automatic
Control (CCE)).
[11] https://www.analog.com/ru/technical-articles/robust-beat-to-beat-detection-algorithm-
for-pulse-rate-variability-analysis.html
[12] M. T. Islam, S. T. Ahmed, I. Zabir, C. Shahnaz, and S. A. Fattah, “Cascade and parallel
combination (cpc) of adaptive filters for estimating heart rate during intensive physical
exercise from photoplethysmographic signal,” Healthcare Technology Letters, 2017.
21
Acknowledgment
The making of the B.E project needs co-operation and guidance of a number of people. We,
therefore consider it as our prime duty to thank all those who helped us during this venture.
We would like to thank Dr. Prashant Deshmukh (Principal), for his kind co-operation,
guidance and for providing necessary facilities during the working on this report. We
express our sincere thanks to Dr. Sanjay Sharma, (Head of Computer Department) for
his support and co-ordination.
It is our immense pleasure to express our gratitude to Mr. Rushikesh Nikam as our Guide
for providing us with constructive and positive feedbacks during the preparation of this
project. We express our gratitude to Ms. Aarthi Kamble for her valuable insights and co-
operation.
Last but not the least, we are thankful to all other staff members of Computer Department
amd our friends whose encouragement and suggestions helped us to enhance our ongoing
B.E Project. We are also thankful to our parents for their constant support and best wishes.
Thank You!
------------------------------------------------
--------------------------------------
---------------------------------------------------
Date:
22