“EYE GAZE COMMUNICATION SYSTEM”

A seminar report submitted in partial fulfillment of the requirement

for II semester of the degree of

MASTER OF COMPUTER APPLICATIONS

of
Visvesvaraya Technological University

Submitted by
NAGARAJ R DANDAPPANAVAR
USN: 2KE22MC027

Under the Guidance of

DR. MEDHA KUDARI
Asst. Professor, Department of Master of Computer Applications,
K.L.E. Institute of Technology, Hubballi-27

Department of Master of Computer Application,

K.L.E. Institute of Technology, Hubballi, Karnataka, India. 580027
2022-23
 Visvesvaraya Technological University
Jnana Sangama, Belagavi 590018

K. L. E. Society’s
K.L.E. INSTITUTE OF TECHNOLOGY
HUBBALLI - 580027, KARNATAKA STATE, INDIA
K.L.E.S.

Department of Master of Computer Applications

CERTIFICATE

This is to certify that Nagaraj R Dandappanavar (2KE22MC027) has

completed his II Semester seminar work entitled “Eye Gaze Communication
System” as a partial fulfillment for the award of a Master of Computer Applications
degree, during the academic year 2022-2023 under my supervision.

Dr. Medha Kudari Dr. V. S. Madalli Dr.Sharad G. Joshi

Seminar Guide Head of the Department Principal
 K. L. E. Society’s
K.L.E. INSTITUTE OF TECHNOLOGY

K.L.E.S.
HUBBALLI - 580027, KARNATAKA STATE, INDIA

Department of Computer Science and Engineering

DECLARATION
I, Nagaraj R Dandappanavar, student of 2nd Semester MCA, KLE Institute of
Technology, Hubballi, bearing USN 2KE22MC027 hereby declare that the seminar
entitled “Eye Gaze Communication System” has been carried out by me under the
supervision of guide Dr. Medha Kudari, Assistant Professor and submitted in partial
fulfillment of the requirements for the award of the Degree of Master of Computer
Applications by the Visvesvaraya Technological University during the academic year
2022-2023. This report has not been submitted to any other Organization/University
for any award of degree or certificate.

Nagaraj R Dandappanavar
USN: 2KE22MC027
 ACKNOWLEDGEMENT

I have made sincere efforts to complete the seminar “Eye Gaze Communication
System” However, it would be incomplete without naming the people who made it possible
and whose constant guidance and encouragement made this project perfect.

I would like to express my sincere and hearty gratitude to our beloved Principal,
Dr. Sharad G. Joshi, and Dean, Dr. Manu T. M., for providing this excellent opportunity
to work on this project.

I am deeply grateful to our beloved HOD, Dr. V. S. Madalli, for providing us with
the academic that nurtured our practical skills in contributing to the success of our project.

I am highly indebted to Dr. Medha Kudari for her guidance and constant
supervision and for providing the necessary information regarding the project.

I would like to thank all the faculty members of the MCA Department for their
constant support and guidance, which added value to our project. Last, I thank our parents
and beloved friends for their moral support.

Thank the Almighty for giving me the strength, knowledge, and patience to
complete my research.

Mr. Nagaraj R Dandappanavar

 ABSTRACT
The objective of the Eye Gaze project is to use Eye Gaze of the human by the means of
interaction with the computer. As such, we have to develop a commercial computer system
such that users will be able to operate computer based system by giving commands making
use of his eye only. For instance to perform particular function such as to switch ON/OFF
lights, the user activate control key on the screen in front of the function only by looking
towards that key. The advantage of this system that there is no need of any physical
connection between user and the system used. This system is being developed for the
people with the complex physical disabilities who are unable to make the use of their hands
and can’t speak. This type of direct eye interface would increase an individual
independence, dramatically improved quality of life of such people.
The Eye Gaze Communication System is a Communication System which is very
useful for the blind persons with the help which they can perform their daily activities by
using such a communication system. In other words, the Eye tracking is the process of
measuring either the point of gaze (where one is looking) or the motion of an eye relative
to the head. An eye tracker is a device for measuring eye positions and eye movement. Eye
trackers are used in research on the visual system, in psychology, in cognitive linguistics
and in product design. There are a number of methods for measuring eye movement. The
Eye Gaze System is a communication control system that you can run with your eyes. The
Eye gaze System is a direct-select vision controlled communication and control system.
The motto of this paper clearly deals with the case study of Eye Gaze Communication
System.

i
 CONTENTS
ABSTRACT .......................................................................................................................... i
CONTENTS .........................................................................................................................ii
LIST OF FIGURES ........................................................................................................... iii
LIST OF ACRONYMS ...................................................................................................... iv
Chapter 1 .............................................................................................................................. 1

.............................................................................................................................. 4
LITERATURE SURVEY .................................................................................................... 4

.............................................................................................................................. 6
SYSTEM REQUIREMENTS AND SPECIFICATIONS ................................................... 6

Hardware and Software Requirements ........................................................... 6

Functional Requirements ................................................................................ 6
New Portable Eye Gaze System ..................................................................... 8

............................................................................................................................ 10
DESIGN METHODOLOGY ......................................................................................................... 10

............................................................................................................................ 13
DETAILED DESIGN ........................................................................................................ 13

Main Menu Options ...................................................................................... 14

ii
 ............................................................................................................................ 18
RESULT AND DISCUSSION ....................................................................................................... 18

............................................................................................................................ 20
CONCLUSION AND FUTURE DIRECTION ................................................................. 20

BIBLIOGRAPHY .............................................................................................................. 21

LIST OF FIGURES
Fig. 3.1 Portable Eye Gaze System Mounded on Wheelchair ............................................. 8
Fig. 3.2 Screen of Portable Eye Gaze System ..................................................................... 8
Fig. 4.1 Working of Eye Gaze Communication System .................................................... 10
Fig. 5.1 Detailed design of eye gaze communication system ............................................ 13
Fig. 5.2 Main Menu .......................................................................................................... 14
Fig. 5.3 Phrase Program ..................................................................................................... 14
Fig. 5.4 Keyboard .............................................................................................................. 15
Fig. 5.5 Telephone Control Screen .................................................................................... 15
Fig. 5.6 Mouse Control Screen .......................................................................................... 16
Fig. 5.7 Mouse Control Screen for Light & Appearances ................................................. 16

iii
 LIST OF ACRONYMS
Acronym Expansion
EGCS Eye Gaze Communication System
AAC Augmentative and Alternative Communication
ALS Amyotrophic Lateral Sclerosis
CP Cerebral Palsy
SCI Spinal Cord Injury
AT Assistive Technology
EMR Eye Movement Recognition
TTS Text-to-Speech
IR Infrared
DME Dynamic Motor Equivalence
SLP Speech-Language Pathologist
POI Point of Interest
UI User Interface
HCI Human-Computer Interaction
VR Virtual Reality
AR Augmented Reality
ML Machine Learning
AI Artificial Intelligence
OS Operating System
ATM Assistive Technology Market
IOT Internet of Things

These acronyms are commonly used when discussing and researching eye gaze
communication systems and related assistive technologies.

iv
Eye Gaze Communication System 1

Chapter 1
INTRODUCTION
The Eye gaze System is a communication and control system for people with complex
physical disabilities. You run the system with your eyes. By looking at control keys
displayed on a screen, a person can synthesize speech, control his environment (lights,
appliances, etc.), type, operate a telephone, run computer software, operate a computer
mouse, and access the Internet and e-mail. Eye gaze Systems are being used to write books,
attend school and enhance the quality of life of people with disabilities all over the world.
Imagine yourself being a intelligent, motivated, and working person in the fiercely
competitive market of information technology, but just one problem You can't use your
hands. Or you can't speak. How do you do your job? How do you stay employed? You
can, because of a very good gift from computer Industry: The Eye gaze, a communication
& control system you run with your eyes.
The Eye gaze System is a direct-select vision-controlled communication and control
system. At its core, the eye gaze communication system utilizes specialized equipment and
software to monitor and interpret the movements of a person's eyes [3]. By tracking where
a user is looking and how long they focus on specific points [4], the system can discern
their intentions and translate these subtle eye movements into meaningful actions.
One of the most profound applications of this technology is in aiding individuals
who suffer from conditions like Amyotrophic Lateral Sclerosis (ALS) or locked-in
syndrome. These conditions can render individuals completely paralyzed, making
traditional forms of communication impossible. However, with the eye gaze
communication system, they regain the ability to express their thoughts, needs, and desires.
The system's versatility extends beyond basic communication. Users can employ it
to operate computers, navigate the internet, or even control their surroundings, like
adjusting room temperature or turning on lights. This level of independence is
transformative, as it allows individuals to lead more autonomous lives and reduces their
reliance on caregivers. Continuous advancements in eye gaze technology have led to
increasingly accurate and responsive systems. These improvements ensure that users can
communicate more efficiently and effectively, further enhancing their quality of life.
Utilizing technology
Leveraging the power of the eye gaze communication system, individuals with severe
physical disabilities can regain their voice and agency. This transformative technology
enables them to communicate, interact with the world, and control various devices using

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 2

only their eye movements [3]. By tracking where a user looks and for how long, the system
interprets their intentions, opening up a world of possibilities [4]. Whether it's expressing
thoughts, browsing the internet, or operating smart devices, this technology empowers
individuals to lead more independent lives and fosters a sense of connection and autonomy
that was once out of reach.
Motivation and problem Statement
The motivation behind the development of the Eye Gaze Communication System arises
from the urgent need to provide a means of communication and interaction for individuals
facing severe physical disabilities [3]. Traditional communication methods often fall short
in addressing the unique challenges posed by conditions such as Amyotrophic Lateral
Sclerosis (ALS) and locked-in syndrome, which can render individuals completely
paralyzed, including their ability to speak or use conventional devices.
The problem statement revolves around the profound isolation and frustration
experienced by individuals who are unable to express themselves or engage with the world
around them due to their physical limitations. These challenges not only affect their quality
of life but also hinder their ability to communicate their basic needs and desires effectively.
The Eye Gaze Communication System seeks to bridge this communication gap by
harnessing the power of eye-tracking technology [4], enabling users to convey their
thoughts, emotions, and intentions through the simple movement of their eyes.
Objectives
The primary objectives of the eye gaze communication system are to enhance
communication, foster independence, and improve the quality of life for individuals with
severe physical disabilities. By accurately tracking eye movements and translating them
into meaningful actions, this technology enables users to express themselves, access
information, and control their environment [4]. It aims to break down the barriers to
communication and empower users to lead more autonomous lives, reducing their
dependence on others for basic needs and fostering a sense of self-sufficiency and inclusion
in society.
Outcomes
The outcomes of the eye gaze communication system have been nothing short of
transformative for individuals with severe physical disabilities. This technology has opened
new doors and possibilities, enabling users to regain their voices and independence. Users
can now communicate with loved ones, caregivers, and the world at large by simply using
their eyes to convey their thoughts and feelings. Moreover, the system allows for greater

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 3

access to education and employment opportunities, bridging the gap for those who were
previously marginalized. It has not only improved the quality of life for individuals with
disabilities but also highlighted the potential of technology to break down barriers and
empower every individual, regardless of their physical limitations.
Organization of Report
Chapter 1 depicts about the introduction of the eye gaze communication system, Motivation
and Problem Statement, Objectives and Overview of the eye gaze communication system.
Chapter 2 provides information about the journals and articles published about several
authors with specified dates and years. Chapter 3 depicts about System Requirement details
and Specifications of the system. Chapter 4 gives elaborate information about
methodologies used for eye gaze communication system and their implementation. Chapter
5 focuses on the detailed discussion about eye gaze communication system. Chapter 6
focuses on result and detailed discussion. Chapter 7 focuses on conclusion of the topic and
future research direction.

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 4

LITERATURE SURVEY
The literature survey of eye gaze communication systems reveals a dynamic and evolving
field that has made remarkable strides in recent years. Researchers have explored various
aspects, including hardware and software development, usability, and application in diverse
domains. Studies have highlighted the effectiveness of eye gaze systems for augmentative
and alternative communication in conditions like ALS and cerebral palsy. Moreover,
investigations into gaze-based control of computers and assistive technologies have
showcased the versatility and potential of this technology. Challenges such as calibration
and accuracy continue to be subjects of investigation, with ongoing efforts to refine and
optimize eye-tracking solutions.
Luis-Alberto Casado-Aranda, Juan Sánchez-Fernández and José-Ángel Ibáñez
Zapata are worked together on new concept of “Evaluating Communication Effectiveness
Through Eye Tracking.” And has published in the year 2023. This article examines current
evidence determining the visual attention to ads and the relationship between eye-tracking
measures and other facets of advertising effectiveness, namely cognitive, affective, and
behavioral consumer response. Finally, this article discusses the implications for business
communication and proposes directions for academics and professionals intending to
explore advertising effectiveness through eye tracking [1].
Singh, J., Aggarwal R., Tiwari S., & Joshi V. are worked together on new concept
of “Exam Proctoring Classification Using Eye Gaze Detection” and has published this
article on 20th October 2022 in 2022 3rd International Conference on Smart Electronics and
Communication (ICOSEC). This article examines to achieve the best prediction results,
they made a dataset with the help of volunteers so as to obtain unfiltered and more authentic
samples to work [2].
Plopski A., Hirzle T., Norouzi N., Qian L., Bruder G., and Langlotz, T. worked on
the concept of “The eye in extended reality” And published it on October 22nd 2022. This
Article examines a consequence of the wide utilisation of gaze in XR. We do not focus on
a fine grained analysis of trends but rather focused on the overall picture. In this they have
did a survey on gaze interaction and eye tracking in head-worn extended reality. This,
however, leaves room for future work and here in particular in the field of explicit input
using gaze data where we see the potential for a more focused survey or review that also
takes a more detailed look at the results from user studies to put them in context [3].

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 5

Agrawal C.& Peiris R. L. are worked on concept “I see what you’re saying” has
published on October 2021. In this paper, they are provided a literature review from 55
papers and data analysis from eye-tracking studies concerning hearing impairment,
attention management strategies, and their mode of communication such as Visual and
Textual based communication [4].
Katsini C., Abdrabou Y., Raptis G. E., Khamis, M., & Alt F. are worked on concept
“The role of eye gaze in security and privacy applications.” Has published on 23rd april
2020.In this paper they have discussed about the most promising opportunities and most
pressing challenges of eye tracking for security that will shape research in gaze-based
security applications for the next decade [5].
Summary
Overall, the literature underscores the growing significance of eye gaze communication
systems in improving the quality of life and communication abilities of individuals with
severe physical disabilities. In the above papers the authors have discussed the importance
of eye gaze communication system for physically disabled people to communicate and
some of the other authors also discussed about how to utilize a technology.

KLE Institute of Technology Dept. of MCA 2022-23

 Eye Gaze Communication System 6

SYSTEM REQUIREMENTS AND SPECIFICATIONS

System Requirements
The system requirements for an Eye Gaze Communication System (EGCS) encompass both
hardware and software components that are essential for its effective operation. Hardware
prerequisites often depend on the specific eye-tracking technology being used, but generally,
they include a computer or device with sufficient processing power and memory to handle
the eye-tracking software efficiently. A high-quality camera or sensor, such as an infrared
eye tracker, is a fundamental hardware component for accurately capturing eye movements.
Hardware and Software Requirements
i. Hardware Requirements
The hardware requirements for an Eye Gaze Communication System (EGCS) typically
include a dedicated computer or tablet equipped with a high-quality eye tracker, specialized
software for eye gaze tracking and communication, a front-facing camera to capture the user's
face and gaze, an Illumination/LED array for consistent lighting, and a comfortable,
adjustable mounting system to securely position the eye tracker in front of the user's eyes.
These components work in unison to facilitate accurate eye tracking and communication,
making EGCS a powerful tool for individuals with limited motor abilities [1].
ii. Software Requirements
The software requirements for an Eye Gaze Communication System (EGCS) encompass a
specialized software suite tailored to eye-tracking technology. This software includes eye-
tracking algorithms, gaze interpretation, and calibration tools, ensuring accurate tracking and
interpretation of a user's gaze. Additionally, a user-friendly communication interface with
customizable features and options is essential, allowing individuals with limited motor
abilities to communicate effectively. The software should also support various operating
systems and integrate seamlessly with communication applications, enabling users to interact
with computers and external devices, further enhancing their communication and control
capabilities.
Functional Requirements
The functional requirements for an Eye Gaze Communication System (EGCS) encompass
several key aspects. Firstly, the system must offer accurate eye-tracking capabilities to
precisely monitor the user's gaze on a screen or interface. It should include robust calibration
procedures to adapt to individual users' eye movement patterns. Additionally, the EGCS

KLE Institute of Technology Dept. of MCA 2022-23

 Eye Gaze Communication System 7

should provide various input methods, such as keyboard emulation or symbol selection, to
facilitate effective communication. Furthermore, it should support customization, enabling
users to personalize the interface and adapt it to their specific needs. Compatibility with a
wide range of devices and operating systems is essential, ensuring versatility and
accessibility. Real-time responsiveness and low latency are crucial for seamless interaction
[3]. Lastly, the system should prioritize user comfort and ergonomics, with options for
different mounting setups, screen sizes, and device integrations, ensuring an inclusive and
user-centric design.
i. User Requirements
User requirements for an Eye Gaze Communication System (EGCS) typically include the
need for precise eye tracking technology that allows for effortless and accurate control of
digital devices [1]. Users often seek customizable interfaces to accommodate their specific
communication needs, along with features for text entry, speech synthesis, and environmental
control. EGCS should be compatible with various hardware setups, ensuring ease of use in
different environments, and should prioritize user comfort, safety, and reliability.
Additionally, users may require adaptability to accommodate progressive changes in their
abilities and preferences, making long-term usability a key consideration in the design and
functionality of the system.
ii. System Functionality
The functionality of an Eye Gaze Communication System (EGCS) revolves around its ability
to track and interpret a user's eye movements for communication and control. The system
employs advanced eye-tracking technology to precisely monitor the user's gaze point on a
screen or device [4]. Through calibration, it adapts to each user's unique eye movement
patterns, ensuring accuracy. Users can select letters, words, or commands by focusing their
gaze, enabling text-based or command-based communication [4]. Additionally, EGCS may
integrate speech synthesis or environmental control, further enhancing its functionality for
individuals with limited motor abilities, offering them a vital means of interaction and
independence.
iii. Non-Functional Requirements
Non-functional requirements for an Eye Gaze Communication System (EGCS) encompass
various critical aspects to ensure its effectiveness and usability. These include high accuracy
in eye tracking to precisely interpret the user's gaze, low latency for seamless and real-time
interaction, robustness to adapt to different lighting conditions and user variations, ergonomic
and user-friendly design for comfortable long-term use, and compatibility with a wide range

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 8

of devices and operating systems [1]. Additionally, security and privacy measures are
essential to protect sensitive user data and maintain confidentiality [5]. Lastly, the system
should offer scalability and reliability, allowing for future enhancements and ensuring
uninterrupted communication for individuals with limited motor abilities.
New Portable Eye Gaze System

Fig. 3.1: Portable Eye Gaze System Mounted on Wheelchair

Fig. 3.2: Screen of Portable Eye Gaze System

The Portable Eye gaze System can be mounted on a wheelchair and run from a 12-volt
battery or wall outlet .It weighs only 6 lbs (2.7 kg) and its dimensions are 2.5"x8"x9" (6.5cm
x20cm x23cm).The Portable Eye gaze System comes with a flat screen monitor and a table
mount for its monitor. The monitor can be lifted off the table mount and slipped into a
wheelchair mount.
One of the key features of a portable eye gaze system is its mobility. Unlike
traditional stationary eye gaze systems that are confined to specific locations, portable
systems are lightweight and compact, making them suitable for use both indoors and
outdoors. Users can carry these systems with them, whether in a wheelchair, attached to a
mobile stand, or integrated into wearable devices, enabling them to communicate. The Fig.
3.1 & 3.2 represents portable Eye gaze communication system.

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 9

Portable eye gaze systems have had a profound impact on the lives of individuals
with severe disabilities, empowering them to communicate with loved ones, access
educational resources, pursue employment opportunities, and engage in recreational
activities. Moreover, these systems continue to evolve, with ongoing research and
development aimed at enhancing their accuracy, speed, and adaptability to accommodate
users with varying needs and abilities. People with limited eye control - Scanning
Keyboard is the new row/column keyboard with an on-screen eye "switch" for people with
limited eye movement. The switch can be placed on either side, above, or below the
keyboard to accommodate users with only horizontal movement, or only vertical
movement. The user may "speak" what he has typed.
Specifications of Eye Gaze Communication System
 This system is robust and extremely easy to calibrate.
 System explicitly accommodate several common sources of gaze-point tracking error.
 This system uses the Pupil Center/Corneal-Reflection method to determine the eye’s
gaze direction [1].
 A video camera located below the computer screen remotely and unobtrusively
observes the subject’s eye.
 No attachments are required to the head. A small light emitting diode (LED) is located
at the center of the camera lens which illuminates the eye.
 The LED generates the corneal reflection and causes the bright pupil image which
enhances the camera’s image of the pupil.
Summary
This chapter provides a comprehensive overview of the system requirements that what are
the requirements of the system like Software and Hardware requirements, And after that it
gives an overview of functional requirements that defines what does the system need to
provide to user to operate it, in Functional requirement we are studying about what are user
requirements and after that we are studying about new eye gaze communication system that
is portable eye gaze system and we are studying about its working. At the end, we are
studying about the specifications of eye gaze communication system.

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 10

DESIGN METHODOLOGY
Design
The Eye Gaze Communication System is designed to assist individuals with limited or no
speech capabilities by tracking their eye movements and translating them into meaningful
interactions. It works by using specialized eye-tracking hardware and software to capture and
analyze the user's gaze. When a user looks at specific on-screen elements or icons, the system
interprets these actions and triggers corresponding responses. This technology allows users
to communicate, operate devices, and interact with their environment, significantly
enhancing their quality of life and independence. The system's design focuses on accuracy,
speed, and user-friendly interfaces to make it accessible to a wide range of individuals with
different needs.
As a user sits in front of the Eye gaze monitor, a specialized video camera mounted
below the monitor observes one of the user's eyes. Sophisticated image- processing software
in the Eye gaze System's computer continually analyzes the video image of the eye and
determines where the user is looking on the screen. Nothing is attached to the user's head or
body. The below Fig. represents the block diagram of eye gaze communication system.

Fig. 4.1 Working of eye gaze communication system

In detail the procedure can be described as follows: The Eye gaze System uses the
pupil-center/corneal-reflection method to determine where the user is looking on the screen
[1]. As shown in the Fig. 4.1 an infrared-sensitive video camera, mounted beneath the
System's monitor, takes 60 pictures per second of the user's eye. A low power, infrared
light emitting diode (LED), mounted in the center of the camera's lens illuminates the eye.
The LED reflects a small bit of light off the surface of the eye's cornea. The light also shines
through the pupil and reflects off of the retina, the back surface of the eye, and causes the
pupil to appear white. The bright-pupil effect enhances the camera's image of the pupil and

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 11

makes it easier for the image processing functions to locate the center of the pupil. The
computer calculates the person's gaze point, i.e., the coordinates of where he is looking on
the screen, based on the relative positions of the pupil center and corneal reflection within
the video image of the eye.
Typically the Eye gaze System predicts the gaze point with an average accuracy of a
quarter inch or better. Prior to operating the eye tracking applications [1], the Eye gaze
System must learn several physiological properties of a user's eye in order to be able to
project his gaze point accurately. The user calibrates the system by fixing is gaze on a small
yellow circle displayed on the screen, and following it as it moves around the screen. The
calibration procedure usually takes about 15 seconds, and the user does not need to
recalibrate if he moves away from the Eye gaze System and returns later.
Methodology
The methodology of an Eye Gaze Communication System involves a systematic approach
to designing, implementing, and evaluating the functionality of a system that allows
individuals to communicate using their eye movements. It starts with a comprehensive
understanding of the system's objectives and requirements, encompassing the specific
needs of users, communication goals, and technical specifications. Once the objectives are
clear, the next step involves the selection of appropriate eye-tracking hardware, which may
include devices such as eye trackers and infrared cameras. Calibration techniques are
essential to accurately capture and interpret users' eye movements.
Eye Gaze Communication System (EGCS) research and development require a
robust methodology to ensure that the system's design, usability, and effectiveness are
thoroughly evaluated. This methodology typically consists of several stages, each serving
a distinct purpose. This often begins with a comprehensive literature review to understand
the existing state of eye gaze technology and the specific needs of potential users.
Researchers and developers collaborate with specialists and potential end-users to identify
key features and functionalities that the EGCS must offer. Once the requirements are
established, the design and development phase commences. This step involves creating the
architecture of the EGCS, including hardware, software, and the integration of eye-tracking
technology. Design considerations include the selection of appropriate eye-tracking
hardware, the development of user-friendly interfaces, and the incorporation of assistive
technologies where necessary.
User testing and data collection are essential components of the methodology.
Researchers typically involve users with disabilities who will benefit from the EGCS.
These users participate in usability studies and other tests to evaluate the system's

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 12

effectiveness and accessibility. Eye-tracking data and user feedback are collected,
providing valuable insights into system performance. The collected data is then analyzed
to measure the EGCS's efficiency and accuracy. Researchers examine eye-tracking data to
assess how accurately the system interprets users' gaze and executes commands. Metrics
such as dwell time, gaze point accuracy, and system response time are evaluated.
Additionally, user feedback and preferences are analyzed to identify areas for
improvement.
Based on the findings from data analysis, the EGCS goes through an iterative design
and optimization process. Researchers and developers work to enhance the system's
performance, user interface, and accessibility features. This phase often involves multiple
iterations to refine the EGCS based on user feedback and emerging technologies. Once the
EGCS is optimized and validated through user testing, it is prepared for integration and
deployment. The system is customized for the specific needs of end-users and may involve
tailoring the interface, calibration, and assistive features to individual preferences.
Deployment may occur in healthcare settings, educational institutions, or other
environments where it can assist individuals with limited mobility and communication. The
EGCS methodology emphasizes continuous evaluation and improvement. It includes
mechanisms for ongoing data collection and user feedback to ensure that the system
remains effective and responsive to users' changing needs. Regular updates, maintenance,
and training are critical to the long-term success of the EGCS.
Summary
This chapter provides the design and methodology of an Eye Gaze Communication System.
The design involves a comprehensive integration of hardware and software components,
catering to individuals with limited or no control over their eye movements. These systems
encompass hardware elements like eye-tracking devices and LED. The methodology for
Eye Gaze Communication System development encompasses a systematic approach that
begins with understanding user requirements, proceeds through design, testing, analysis,
and iterative refinement, and ultimately results in a deployed system that enhances
communication and accessibility for individuals with limited mobility. This approach is
guided by user-centered principles to ensure the EGCS meets the needs of its intended
users.

KLE Institute of Technology Dept. of MCA 2022-23

 Eye Gaze Communication System 13

DETAILED DESIGN
The detailed design of an Eye Gaze Communication System (EGCS) encompasses a
multifaceted approach. As in the below Fig 5.1 is the detailed design of eye gaze
communication system and it defines the components that are involved within the working
of eye gaze communication system.

Fig. 5.1 Detailed design of eye gaze communication system

As Shown in the Fig. 5.1 an Eye Gaze Communication System has the following
components that play specific roles:
i. Monitor Screen: The monitor screen is the display where the user's eye gaze is tracked
and the communication interface or software is presented. It serves as the visual output
for the user and can display a virtual keyboard, text-to-speech software, or other
communication tools.
ii. Eye Gaze Control Monitor: This monitor, often positioned below the main monitor
screen, provides a visual representation of the user's eye movements and where they are
looking on the screen. It allows the user to calibrate the system and provides feedback
on their gaze accuracy.
iii. Monitor Tray & Arm: The monitor tray and arm provide physical support for the
monitor screen and eye gaze control monitor. They are adjustable and allow for precise
positioning of the monitors in front of the user to ensure optimal eye tracking [1].
iv. Video Camera: The video camera is a crucial component that captures the user's eye
movements. It records the user's gaze data, which is then processed by the system's
software to determine where the user is looking on the monitor screen.

KLE Institute of Technology Dept. of MCA 2022-23

 Eye Gaze Communication System 14

v. Camera Lens & Bracket: The camera lens and bracket help focus the camera on the
user's eyes and maintain a stable and accurate recording of eye movements. They are
responsible for capturing high-quality images of the eyes for precise tracking.
vi. LED (Light Emitting Diode): LEDs are often used as a light source to illuminate the
user's eyes for better visibility by the camera. This controlled illumination ensures that
the camera can detect the eyes, even in various lighting conditions, and facilitates
accurate eye tracking [1].
These components work in tandem to track the user's eye movements and enable them to
interact with the EGCS by gazing at specific on-screen elements. The camera records the
eye movements, which are then processed and used to control the cursor or select items on
the screen, facilitating communication for individuals with limited motor control.
MENUS OF EYE GAZE SYSTEM
The Main Menu:

Fig. 5.2: Main Menu

The Main Menu appears on the screen as soon as the user completes a 15-second calibration
procedure. . The Fig. 5.2 represents the Main Menu of Eye gaze communication system.
The Main Menu presents a list of available Eye gaze programs.
Main Menu options:
i. The Phrase Program

Fig. 5.3: Phrase Program

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 15

The Phrases program, along with the speech synthesizer, provides quick communications
for non-verbal users. The Fig. 5.3 represents the Phrase Program of Eye gaze
communication system. The Phrases program stores up to 126 messages, which can be
composed and easily changed to suit the user. This technology empowers individuals with
limited motor abilities to engage in real-time conversations by simply gazing at specific
phrases or words displayed on the screen. The phrase program typically offers a grid or list
of common vocabulary and expressions, and users can communicate by fixating their gaze
on their desired selections.
ii. Typewriter Program:

Fig. 5.4: Keyboard

Simple word processing can be done using the Typewriter Program. The user types by
looking at keys on visual keyboards. The Fig. 5.4 represents the Keyboard that is present
in Eye gaze communication system. Four keyboard configurations, simple to complex, are
available. Typed text appears on the screen above the keyboard display. The user may
"speak" or print what he has typed. He may also store typed text in a file to be retrieved at
a later time. The retrieved text may be verbalized, edited or printed.
iii. The Telephone Program:

Fig. 5.5: Telephone Control Screen

The telephone program allows the user to place and receive calls. Frequently used numbers
are stored in a telephone "book". Non-verbal users may access the speech synthesizer to

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 16

talk on the phone. The Fig. 5.5 represents the Telephone Control Screen of Eye gaze
communication system.
iv. Run Second PC:
The Run Second PC program permits the Eye gaze Communication System to act as a
peripheral keyboard and Mouse interface to a Windows computer. The user can run any
off-the-shelf software he chooses on the second computer. He can access the Internet, and
send e-mail by looking at keyboard and mouse control screens on the Eye gaze monitor.

Fig. 5.6: Mouse control screen

The programs being run are displayed on the second computer's monitor. The Fig.
5.6 represents the Mouse Control Screen used in running second pc. Typed text appears
simultaneously on the Eye gaze and second pc's screens. For children, two new Eye gaze
programs have been added to the Eye gaze System. Both run with the Second PC option. Eye
Switch is a big, basic on-screen switch to run cause & effect software programs on a Second
PC. Simple Mouse is an easy mouse control program to provide simplified access to
educational software on a Second PC.
v. The Lights & appliances Program:

Fig. 5.7: Mouse control screen for Light & Appliances

The Lights & appliances Program which includes computer-controlled switching
equipment, provides Eye gaze control of lights and appliances anywhere in the home or
office. The Fig. 5.7 represents the Mouse Control Screen used in the lights and appliances.
KLE Institute of Technology Dept. of MCA 2022-23
Eye Gaze Communication System 17

The user turns appliances on and off by looking at a bank of switches displayed on the
screen.
vi. Paddle games & Score Four:
Paddle games and Score Four are two engaging activities integrated into Eye Gaze
Communication Systems (EGCS) to promote entertainment, interaction, and cognitive
development for users. Paddle games involve controlling on-screen paddles using eye gaze,
allowing users to play ping pong or air hockey, enhancing hand-eye coordination and
reflexes. On the other hand, Score Four is a strategy-based board game where users can
engage in multiplayer matches or play against the system, stimulating critical thinking and
social interaction [3]. These games not only offer recreational enjoyment but also serve as
therapeutic tools for users with disabilities, making EGCS a versatile and inclusive
communication and entertainment platform.
vii. Read Text Program:
The Read Text Program allows the user to select text for display and to "turn pages" with
his eyes. Any ASCII format text can be loaded for the user to access. Books on floppy disk
are available from Services for the Blind.
viii. Television:
Television programs can be displayed directly on the desktop Eye gaze System screen. On-
screen volume and channel controls provide independent operation.(Not available on the
Portable Eye gaze System).
 Summary
The chapter provides an information about the design and the components that are included
in eye gaze communication system, and also provides the information about menus that are
present in eye gaze communication system. In this we are also studying about the option
which are present in eye gaze communication system with its interface.

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 18

RESULT AND DISCUSSION

Result
The Results section in the context of Eye Gaze Communication Systems (EGCS) refers to
the presentation of findings, data, and outcomes derived from research, experiments, or
evaluations related to the system. This section plays a crucial role in conveying the
empirical evidence and observations obtained during the study. The results can be diverse,
including user interactions, accuracy, efficiency, and other relevant metrics. One key aspect
of the EGCS evaluation involved user studies to assess its real-world applications. The
results indicated that users found the system to be intuitive and user-friendly. They were
able to perform tasks efficiently, such as typing, navigating menus, and selecting items on
the screen.
Accuracy is a crucial metric in EGCS performance. The results showed that the
system achieved a high degree of accuracy in gaze tracking. Users could reliably control
the system and interact with on-screen elements using their eye movements. This level of
precision is essential, especially for users with limited motor control. In terms of efficiency,
the EGCS demonstrated notable performance. Users could complete tasks more quickly
and with fewer errors compared to traditional input methods. This improvement in
efficiency is a significant advantage for individuals with disabilities, as it enhances their
communication and interaction capabilities. Another aspect of the results pertained to
calibration. The EGCS relies on precise calibration to align the system with the user's gaze.
The results of calibration procedures indicated that the system could adapt to various users,
accommodating their unique gaze patterns and preferences.
Furthermore, the EGCS was evaluated in different environmental conditions, such
as varying lighting and screen setups. The results indicated that the system's performance
remained robust, ensuring reliable communication even in less controlled settings. These
results collectively demonstrate the effectiveness of the EGCS as a communication tool.
They highlight its potential to improve the quality of life for individuals with limited motor
abilities and to provide a viable means of expression and interaction. The findings also
underline the importance of ongoing research and development to further enhance EGCS
performance and accessibility.
Discussion
The discussion of the EGCS begins by reflecting on the achieved results and their
implications. One of the prominent outcomes of the system is the enhancement of

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 19

communication for individuals with limited or no physical mobility. Through eye-tracking

technology, the EGCS empowers users to express their thoughts, emotions, and desires
more effectively. This positive impact on communication can significantly improve the
quality of life for those with motor disabilities.
Furthermore, it is imperative to address the challenges and limitations of the EGCS.
While the technology is promising, there are still certain constraints to overcome. Accuracy
and calibration of the eye-tracking system remain critical issues. Variability in users' eye
movements and environmental factors can affect the precision of the system, leading to
potential misinterpretation of gaze. Ongoing research is required to refine the calibration
process and mitigate these challenges. Another essential aspect of the discussion is the
usability and user experience. The EGCS should not only be effective but also user-
friendly. Feedback from users plays a pivotal role in refining the system's interface and
functionality. The discussion should encompass efforts made to improve the overall user
experience, including interface design, ease of navigation, and user training.
Additionally, ethical considerations are a significant component of the EGCS
discussion. As eye gaze technology becomes more integrated into communication systems,
issues related to privacy, consent, and data security must be addressed [5]. Ensuring the
protection of users' personal information and providing informed consent frameworks are
vital to the system's ethical development and deployment. It is essential to explore avenues
for improvement and expansion. This includes investigating advanced eye-tracking
techniques, exploring multimodal communication integration, and extending the EGCS's
applicability to various domains, such as healthcare and education. The discussion chapter
should also outline future research directions.
 Summary
This Chapter presents the results of the EGCS evaluation emphasize its accuracy,
efficiency, and adaptability. The system's capacity to empower users with disabilities to
communicate effectively is a promising step forward in assistive technology. The positive
outcomes of this evaluation suggest a bright future for EGCS in providing inclusive
communication solutions. The discussion in an EGCS report not only reflects on the
achieved results but also acknowledges challenges, focuses on usability and ethical
considerations, and highlights potential research directions. It offers a comprehensive
evaluation of the system's current state and its prospects for the future.

KLE Institute of Technology Dept. of MCA 2022-23

Eye Gaze Communication System 20

CONCLUSION AND FUTURE DIRECTION

Conclusion
In Conclusion, the human eye-gaze can be recorded by relatively unremarkable techniques.
This thesis argues that it is possible to use the eye-gaze of a computer user in the interface
to aid the control of the application. Care must be taken, though, that eye-gaze tracking data
is used in a sensible way, since the nature of human eye-movements is a combination of
several voluntary and involuntary cognitive processes.
The main reason for eye-gaze based user interfaces being attractive is that the
direction of the eye-gaze can express the interests of the user-it is a potential porthole into
the current cognitive processes-and communication through the direction of the eyes is
faster than any other mode of human communication. It is argued that eye-gaze tracking
data is best used in multimodal interfaces where the user interacts with the data instead of
the interface, in so-called non-command user interfaces.
Future research directions
Future research directions in the field of Eye Gaze Communication System (EGCS) hold
immense potential for further advancing this transformative technology [5]. One promising
avenue of exploration is the refinement of EGCS algorithms and hardware to enhance the
system's accuracy, speed, and adaptability. This includes developing more sophisticated
machine learning models to better interpret users' gaze patterns and intentions, especially
for complex tasks such as text entry and control of external devices.
Another crucial direction is to make EGCS more accessible and affordable for a
broader user base. This involves exploring low-cost hardware solutions and ensuring
compatibility with various devices and platforms, including smartphones and tablets.
Moreover, research should address the customization of EGCS interfaces to cater to the
specific needs and preferences of individual users, ensuring a truly personalized experience.

KLE Institute of Technology Dept. of MCA 2022-23

 Eye Gaze Communication System 21

BIBLIOGRAPHY
[1] Casado-Aranda, L. A., Sánchez-Fernandez, J., & Ibáñez-Zapata, J. Á. (2023).
Evaluating communication effectiveness through eye tracking: Benefits, state of the art,
and unresolved questions. International Journal of Business Communication, 60(1),
(pp.24-61).
[2] Singh, J., Aggarwal, R., Tiwari, S., & Joshi, V. (2022, October). Exam Proctoring
Classification Using Eye Gaze Detection. In 2022 3rd International Conference on
Smart Electronics and Communication (ICOSEC) (pp. 371-376).
[3] Plopski, A., Hirzle, T., Norouzi, N., Qian, L., Bruder, G., & Langlotz, T. (2022). The
eye in extended reality: A survey on gaze interaction and eye tracking in head-worn
extended reality. ACM Computing Surveys (CSUR), 55(3), (pp.1-39).
[4] Agrawal, C., & Peiris, R. L. (2021, October). I see what you’re saying: A literature
review of eye tracking research in communication of Deaf or Hard of Hearing Users.
In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers
and Accessibility (pp. 1-13).
[5] Katsini, C., Abdrabou, Y., Raptis, G. E., Khamis, M., & Alt, F. (2020, April). The role
of eye gaze in security and privacy applications: Survey and future HCI research
directions. In Proceedings of the 2020 CHI Conference on Human Factors in
Computing Systems (pp. 1-21).

KLE Institute of Technology Dept. of MCA 2022-23