control system

1
 INTRODUCTION

• The project is aimed towards the design of a generic eye-gesture control system that can
effectively track eye-movements and enable the user to perform actions mapped to
specific eye movements.
• It needs to be accurate and real-time.
• The hardware for this project has to be cheap or preferably already a part of
• the systems used by the user.
• The project would be designed such that it can control the mouse cursor
• on a computer by the actions of a person’s pupils.

2
 INTRODUCTION
• The project recognizes the user’s pupil and tracks it in real-time. This
“tracking” information will then be used by a computer through a Software
which is interfaced with the mouse to make cursory movements.
• On software, a program (MATLAB code) is going to be interfaced with an
internal or an external webcam, to track the pupil’s position of the eyes, and use
this information to perform cursory movements.
• 2 algorithms are used:
• 1-Viola Jones Algorithm for face and eye detection.
• 2-Hough transform to find pupil in the eye and then drawing
• a circle around it

3
 PROBLEM STATEMENT

• Many people nowadays are falling victim to diseases that impair them
physically, like Paraplegia , as a result of which the person is unable to use his
body from neck down. The only organ that can generate different actions is
their eyes.
• Paraplegia (Spinal cord injury) 
• Every year, around the world, between 250 000 and 500 000 people suffer a spinal cord injury (SCI).
• Lupus
• The Lupus Foundation of America estimates that 1.5 million Americans, and at least five million
people worldwide, have a form of lupus.

4
 AMYOTROPHIC LATERAL SCLEROSIS
(ALS)
• Amyotrophic lateral sclerosis (ALS) is a
disorder that affects the function of nerves and
muscles. Based on U.S. population studies, a
little over 6,000 people in the U.S. are
diagnosed with ALS each year..
• According to the ALS CARE Database, 60%
of the people with ALS in the Database are
men and 93% of patients in the Database are
Caucasian.
•  The number of ALS cases across the globe will
increase from 222,801 in 2015 to 376,674 in
2040, representing an increase of 69%.

5
 RATIO OF DISABLED PERSONS 2011-2018

• In 7 billion, Total population of

518 million people reported having
a disability in Census 2011.
• Feb7 , 2018 Currently around 10%
of the world's population, or
roughly 650 million people, live
with a disability. In most of the
OECD countries, females have
higher rates of disability than males.

6
7

7
 BACKGROUND

• MIT working on a project titled “ The Sixth Sense” which aims to use eye gestures
in conjunction with the hand to provide ease of accessibility to the handicapped.
• A team over at the Princeton University has also created a general system that only
detects gestures and shows that what eye gesture was performed. The system was
designed only as a test-bed to find out how gaze gesture detection works.
• Rensselaer Polytechnic Institute has researchers working on algorithms to enhance
the use of gaze gesture based technologies and extend their usage to highly lit
environments.

8
 AIMS & OBJECTIVES

• We aim to provide a cheap eye tracking system,

• To control the cursor of a computer with eyes
• To allow the physically impaired people
• To control a computer and communicate with others systems.

9
 APPLICATION AND TOOLS

• MATLAB
• This project can be used in all computer systems having WINDOWS as its
OS with MATLAB installed.

10
 PROPOSED SOLUTION

For working on this project, we required a platform that allowed us to do image

processing and also gave access to the mouse cursor, so we had to do some
research and found that MATLAB was the best suitable platform for such a task.
The research paper is as follows:

Reference paper link: http://www.ijaiem.org/RATMIG-2013/CSE%2011%20CONTROLLING%20MOUSE%20CURSOR

%20USING%20EYE%20MOVEMENT.pdf

11
 HARDWARE

• We will be using the same webcam, that is the Microsoft

LifeCam HD-6000, but in this approach the camera won’t be
disassembled and the visible light would be used instead of the IR
LEDs.
• The camera would be placed in such a way so that when the user
will look at the laptop or computer screen it can easily detect
user’s pupil.

12
 SOFTWARE

• A GUI would have been developed to take input from the camera.
On software two modules were planned to be developed.
• One would have detected the pupil movements.
• Other would have decided which cursor movement to make for a
particular eye movement.

13
RESEARCH METHODOLOGY

14
BLOCK DIAGRAM

15
 WORK DONE IN FIRST INTERIM

• Background research
• Matlab Language
• Ordering of Webcam
• Installation of required software

16
 WORK DONE IN SECOND INTERIM

• Change in design & approach

• Research on new approach
• Work on code for eye-detection
• Ongoing debugging of eye detection code

17
 WORK DONE

• Research on approach to be used for cursor movement

• Work on the cursor movement code
• Debugging the code
• Running the combined code
• Adding diagonal movements of cursor

18
 TIMELINE

SR.NO Date Task

1. Proposal/ Defense

2. March-April’ Research on Software/Hardware

3. April-May’ Work on Software side

4. May-June’ Design & approach changes

5. June-August’ Work on Matlab

Interfacing the code with the webcam and

6. August -August’
debugging

19
 CONCLUSION

• This project focused on the analysis of the development of hands-

free PC control
• Controlling mouse cursor movements using human eyes.
• The most unique aspect of this system is that it does not require
any wearable attachments.
• A user interface by which human interact with a computer. The
user interface includes hardware and software components.
• No external hardware is attached or required.

20
REFERENCE

• http://www.ecse.rpi.edu/~cvrl/zhiwei/html/papers/cviueyetracking.pdf
• https://ch.mathworks.com/help/images/ref/imfindcircles.html
• https://ch.mathworks.com/matlabcentral/answers/100545-how-can-i-
programmatically-control-mouse-motion-and-clicks-with-matlab

21
22
23