PROJECT PRESENTATION PHASE -1

“Efficient Eye Blink Detection Method For The Disabled”

Sajid Kamran 1AT16EC123
Sanath Kumar. S 1AT16EC124
Venki. B 1AT16EC159
Suchith SP 1AT15EC132

Project Guide :
Prof. Vasanthi S
Associate Professor, Dept. of ECE, Atria I T ,
Bangalore

Department of Electronics & Communication Engineering,

Atria Institute of Technology, Bangalore
 PRESENTATION OVERVIEW
Introduction
Problem Statement
Literature Survey
Objectives
Block Diagram
Algorithm
Applications
References
 INTRODUCTION

 Speech disorders can affect the way  a person articulates sound to form words. They can be due to certain
medical ailments starting from brain damage, stroke to paralysis and several other diseases.  
     In paralysis, the ability to control muscle movement is limited even around the eye muscles and blinks are
the only way for the patient to communicate. 
     Tetraplegia is a condition where people cannot move parts below the neck. Our proposed system can
be used by these people to communicate with others.
  We use an open and close eye template for  blink pattern decisions based on correlation measurement.
    Hardly any devices have been developed that can address this issue universally and cost-effectively. 
    Here, the pattern and duration of eye-blinks are recorded, analyzed and converted to regular English
alphabets using the Morse code.
    The development of a simple and cost-effective system to aid patients suffering from speech disorders has
been the leading objective of our project. 
 LITERATURE REVIEW
Table 1 summary of literature review
Authors (Year) Title, Contributions and Observations

Kingshuk Mukherjee, Augmentative and Alternative Communication Device Based

Debdatta Chatterjee on Eye-Blink Detection and Conversion to Morse-Code to
2018 Aid Paralyzed Individuals
This paper exclusively speaks about several medical disorders that can
lead to an individual becoming paralyzed or having motor speech
disorders that inhibits speech or voice production

Tambe Samreem REVIEW ON SMART EYE BLINK SOLUTION FOR MND

Mohammed, Rajeshwari P PATIENT
2019 The growth of technology in medicine field diminish the difficulties of
patients to a immense extent. The disease name Motor Neuron Disease
(MND).[
IppeiTorii,Shunki Development of Communication Support Application with
Takami, Kaoruko Blinks
Ohtani, Naohiro Ishii
2018
 LITERATURE REVIEW
Table 2 summary of literature review

Authors (Year) Title, Contributions and Observations

Mark S. Hawley, Stuart P. “A VOICE-INPUT VOICE-

Cunningham, Phil D. OUTPUT COMMUNICATION AID FOR PEOPLE
Green, Pam Enderby, WITH SEVERE SPEECH IMPAIRMENT”
Rebecca Palmer, Siddharth
Sehgal, and Peter O’Neill
2012
Muhammad Awais, “AUTOMATED EYE BLINK DETECTION
Nasreen AND TRACKING USING TEMPLATE
Badruddin,Micheal MATCHING”
Drieberg
2013
Per Bækgaard, Michael “IN THE TWINKLING OF AN EYE:
Kai Petersen, Jakob Eg SYNCHRONIZATION OF EEG AND EYE
Larsen TRACKING BASED ON BLINK SIGNATURES”
2014
 LITERATURE REVIEW
Table 3 summary of literature review
Authors (Year) Title, Contributions and Observations

Nurul Muthmainnah Mohd “EYE MOVEMENT

Noor, Muhammad Azhan ACTIVITY THAT AFFECTED THE EYE
Muzammil Mustafa SIGNALS USING ELECTROOCULOGRAPHY
2016 (EOG) TECHNIQUE”

Tamilselvi V, Sribalaji S, “IOT BASED HEALTH

Vigneshwaran P, Vinu MONITORING SYSTEM”
P, J. GeethaRamani
2020
Lindsey K. McIntire, R. “DETECTION OF
Andy McKinley, Chuck VIGILANCE PERFORMANCE USING EYE
Goodyear, John P. BLINKS”
McIntire
2014
 PROBLEM STATEMENT
 Speech disorders is the most critical condition for human being which is
caused by brain damage, stroke to paralysis and several other diseases.
 In our project in order to avoid the above mentioned problem we use an eye
blink sensor that is used as the primary sensor for detection of eye blink.
The only way a patient has to interact with others is by eye movement. Using
this terminology we are making a model where the input will be the eye-
blinking of paralyzed patients.
Many companies are relying on expensive hardware in their devices to track a
user`s eyes. Our proposed system negates this drawback by being flexible and
cost-effective.
 Eye blink gestures are converted to morse code and the words are displayed in
the LCD and these words are also converted as audio output. 
 PROJECT OVERVIEW

 Allow paralysis victims to communicate independently.

• Many paralysis victims already use eye blinks as a form of communication. It is common for nurses
and caretakers to read a patient’s eye blinks and decode the pattern.
• The software reads a person’s eye blinks and converts them into text. This allows patients to
express their thoughts freely with complete independence.
 Be accessible to people with financial constraints.
• Many companies are developing technologies that are controlled by eye movement. These
technologies rely on expensive hardware to track a user`s eyes.
• The software runs on wide variety of low end computers Not only is this software accessible to
paralyzed people, but paralyzed people of almost all financial classes as well.
BLOCK DIAGRAM
METHODOLOGY
 The LED focuses the light on the eye which is reflected back and is
detected by the sensor.
 The average time taken for the human eye to blink is around 1/3rd of a
second.
 We used Arduino microcontroller as it extremely user friendly, flexible
and most importantly, very economical.
 The microcontroller takes the data from the IR sensor as analog input and
compares it with a previously set value and determines if the eye is open
or closed.
 The software part covers the outline of the code that has to be fed into the
Arduino microcontroller.
 The regular Morse code has been followed with a short blink
corresponding to a dot and a longer blink to a dash.
 If a match is found, it is displayed onto a LCD screen. If no match is
found, then the LCD does not report any change.
 ALGORITHM

1. READ output from IR sensor

2. COMPARE sensor output with threshold
IF (output>threshold) SET status=0 // represents closed eye
ELSE SET status=1 // represents open eye
3. IF (status=0) //eye is closed
TRACK number of successive closed eye readings //Gives measure of duration of eye blink
4. IF (status=1) //eye is open
TRACK number of successive open eye readings
IF (number>20) // no blinks for 2 seconds
ANALYZE last 5 eye blinks (durations)
5. IF last 5 blinks fall into a pattern
DISPLAY alphabet/numeric on LCD
ELSE
Take no action
6. LOOP to 1
CIRCUIT DIAGRAM
 HARDWARE AND SOFTWARE USED

Arduino Uno Microcontroller – Arduino Uno is a microcontroller board based on

the ATmega328P

IR Sensor Module –For this project we used the QRD1114 which gives very
accurate, consistent and fast responses and has been previously used for monitoring
driver drowsiness.
 HARDWARE AND SOFTWARE USED

LCD Module – The 2 X16 Parallel LCD is an 8 bit or 4 bit parallel interfaced
LCD. This unit allows the user to display text, numerical data and custom
created characters.

Speaker Module – This tech enables the system to speak out the eye blinks
made into a human voice.

Embedded C – Most of the time its not easy to build an application in

assembly language which instead you can make easily in C.
 APPLICATIONS

 The main application of this project is to provide an assistance to the paralyzed and MND patients to efficiently
communicate with others only with eye blinks.
 Military Application.
 Smart Home Application.
 EXPECTED OUTCOME
 The expected outcome of this project is to build a system which can obtain the analog signals from the eye-blinks
of a paralyzed person and convert it to digital signal and audio signal which can be read and understand by others.
 REFERENCES
• [1]  Kingshuk Mukherjee, Debdatta Chatterjee “Augmentative and Alternative Communication Device
• Based on Eye-Blink Detection and Conversion to Morse-Code to Aid Paralyzed Individuals” 2015
• International Conference on Communication, Information & Computing Technology (ICCICT), Jan.
• 16-17, Mumbai, India. 978-1-4799-5522-0/15 ©2015 IEEE.

• [2]  Tambe Samreen Mohammed, Rajeshwari P. “REVIEW ON SMART EYE BLINK SOLUTION
• FOR MND PATIENT USING PYTHON” International Journal of Scientific Development and
• Research (IJSDR) IJSDR1903061. ISSN: 2455-2631 © March 2019 IJSDR | Volume 4, Issue 3.

• [3]  Ippei Torii, Shunki Takami, Kaoruko Ohtani, Naohiro Ishii “Development of Communication
• Support Application with Blinks” IISA 2014, The 5th International Conference on Information,
• Intelligence, Systems and Applications, 7-9 July 2014 Chania, Greece. 14528133
• 10.1109/IISA.2014.6878718 ©2014 IEEE.
 REFERENCES

• [4] Mark S. Hawley, Stuart P. Cunningham, Phil D.Green, Pam Enderby, Rebecca Palmer, Siddharth Sehgal, and
Peter O’Neill 2012 “A VOICE-INPUT VOICE-OUTPUT COMMUNICATION AID FOR PEOPLE WITH
SEVERE SPEECH IMPAIRMENT”
• [5]  Muhammad Awais, Nasreen Badruddin,Micheal Drieberg 2013 “AUTOMATED EYE BLINK
DETECTION AND TRACKING USING TEMPLATE MATCHING” 
• [6]Per Bækgaard, Michael Kai Petersen, Jakob Eg Larsen 2014 “IN THE TWINKLING OF AN EYE:
SYNCHRONIZATION OF EEG AND EYE TRACKING BASED ON BLINK SIGNATURES”
• [7] Nurul Muthmainnah Mohd Noor, Muhammad Azhan Muzammil Mustafa 2016 “EYE MOVEMENT
ACTIVITY THAT AFFECTED THE EYE SIGNALS USING ELECTROOCULOGRAPHY (EOG)
TECHNIQUE” 
• [8] Tamilselvi V, Sribalaji S, Vigneshwaran P, Vinu P, J. GeethaRamani 2020 “IOT BASED HEALTH
MONITORING SYSTEM” 
• [9] Lindsey K. McIntire, R. Andy McKinley, Chuck Goodyear, John P. McIntire 2014 “DETECTION OF
VIGILANCE PERFORMANCE USING EYE BLINKS” 
 REFERENCES

• [10] Andre j Fogelton, Wanda Benesova 2018 “EYE BLINK COMPLETENESS DETECTION” 

• [11] A. Fogelson, W. Benesova 2016 “EYE BLINK DETECTION BASED ON MOTION VECTORS
ANALYSIS” 

• [12] K. Grauman, M. Betke, J. Lombardi, J. Gips, G.R. Bradski 2003 “COMMUNICATION VIA EYE
BLINKS AND EYEBROW RAISES: VIDEO- BASED HUMAN-COMPUTER INTERFACES” 

• [13] Sofia Jennifer John, Sree T. Sharmila 2018 “REAL TIME BLINK RECOGNITION FROM
VARIOUS HEAD POSE USING SINGLE EYE” 

• [14] Piotr Kowalczyk, Dariusz Sawicki 2018 “BLINK AND WINK DETECTION AS A CONTROL
TOOL IN MULTIMODAL INTERACTION” 

• [15] Aleksandra Krolak, Paweł Strumiłło 2012 “EYE- BLINK DETECTION SYSTEM FOR HUMAN–
COMPUTER INTERACTION” 
QUERIES