Professional Documents
Culture Documents
61 67
61 67
61 67
Abhishek1, Abhishek Khandelwal2, Gautam Kumar Singh3, Kumar Rahul4, Shilpashree P. S.5
Email: abhishek.1si12ec004@gmail.com1,
abhishek.1si12ec005@gmail.com2,gautam.1si12ec038@gmail.com3,
rahul.1si12ec045@gmail.com4, shilpa.sit@gmail.com5
to the users laptop runs an OpenCV application threshold for the height and width of a valid eye,
designed to monitor and react to eye movements. through calibration of system for a particular
Based on a series of snapshots taken and user. If the detection results give a height and
thereafter processed, the motion of the users eyes width value lesser or greater than the threshold,
are detected and decision to move the Wheel the value is avoided and it is not considered for
Chair in a particular direction is taken. An image the decision making. 6. Motion
processing toolbox which uses Viola Jones Now after detection of the eye movements, a
Algorithm [3] is used that is capable of detecting decision algorithm needs to be considered that
eye-shaped objects based on their shape and size. helps the controller drive the motors
Further the pupil of eye is detected using accordingly:
gradient method [4] and its centre is located. a) Valid Left: The decision to turn left is
Based on the position of pupil, a movement is considered as valid if the eye turns left and stays
detected and this is communicated to the there for a cycle. This action is detected as a left
wheelchair assembly via the serial port. turn request. After that, the patient turns right to
again look forward.
B. Microcontroller controlled Wheelchair
b) Valid Right: Similarly, the decision to
Assembly
turn right is considered as valid if the eye turns
A decision based on the processing done by the right and stays there for a cycle. This action is
OpenCV application is communicate and detected as a right turn request.
received by the microcontroller. The controller c) Valid Straight: The signal to go straight
on reception forces the port pin high on which is when a person looks upwards. This is detected
the motors have been connected for desired as a forward movement request.
motion of the Wheel Chair. d) Halt: The decision to bring the wheel
C. Process Flow chair to a halt is considered when the pupil is in
1. Initialization center or the patient is looking directly into the
Initially the serial communication is set up is to camera.
be used later for the interface between OpenCV D. Eye Centre Localisation by means of
and the controller, the video capture and the Gradient A multi-stage scheme is followed that
program variables. 2. Image and Video is usually performed for feature-based eye centre
Processing localisation (see Figure 4.1), and following
Then continuous video frames is taken and the observations are made:
input is sampled and saved as screenshots. Each 1. A novel approach for eye centre
frame is then converted into black and white localisation, which defines the centre of a
frames. For accurate results, contrast stretching circular pattern as the location where most of the
is performed on each frames to make the dark image gradients intersect. Therefore, a
regions much darker and bright regions much mathematical function is shown that reaches its
brighter. maximum at the centre of the circular pattern. By
This ensures better detection of the eyes. using this mathematical formulation a fast
3. Estimation iterative scheme can be derived.
Now, after working on each frame, the eyes are 2. We incorporate prior knowledge about
to be detected. This is done by estimation of the the eye appearance and increase the robustness.
position of left as well as the right eye. Thus, a 3. We apply simple postprocessing
threshold is set and the position of the eyes are techniques to reduce problems that arise in the
detected which can be used for the further presence of glasses, reflections inside glasses, or
processing. 4. Detection prominent eyebrows. Furthermore, we evaluate
Now, the eye movements are to be detected. The the accuracy and the robustness to changes in
idea is to compare the current position of the eye lighting, contrast, and background by using the
with the previous position. The difference in the very challenging BioID database.
coordinates helps to predict the motion in the
particular eye. But sometimes, it might be
possible that only one of the either eye is
detected. In that case, the eye that is detected
correctly is preferred. 5. Error Handling
To avoid errors in detection, an error handling Figure 4.1: A face detector is applied first; based
mechanism is incorporated, which specifies a on the face location rough eye regions are
extracted (left), which are then used for a precise V. EXPERIMENTAL RESULT
estimation of each eye centre (middle and right). The objective is to guide a wheel chair prototype
The relationship is described mathematically using a person's eye's movement. The user wears
between a possible centre and the orientations of a head gear which has a web camera mounted on
all image gradients. Let c be a possible centre it (shown in Figure 5.1). Initially, the user needs
and gi the gradient vectorat position xi. Then, the to familiarize itself with the head mounted
normalised displacement vector di should have camera so that the eye movements are detected
the same orientation (except for the sign) as the properly. A new user may require some time
gradient gi (see Figure 4.2). If we use the vector with the camera to make the system detect eye
field of (image) gradients, we can exploit this movements accurately. A high definition USB
vector field by computing the dot products web camera of 1920 x 1080 pixel video
between the normalised displacement vectors resolution is used to capture the live video. The
(related to a fixed centre) and the gradient web camera continuously monitors the field of
vectors gi. The optimal centre c* of a circular view for a face at a frame
object in an image with pixel positions xi,.
i ϵ {1,...,N }, is then given by
REFERENCES
[1] Kohei Arai and Ronny Mardiyanto. Eyes
based electric wheel chair control system.
International Journal of Advanced Computer
Science and Applications, 2(12):98-105,
November 2011.
[2] Gunda Gautam, Gunda Sumanth,
Karthikeyan K C, Shyam Sundar, and
D.Venkataraman. Eye movement based
electronic wheel chair for physically challenged
persons. International Journal of Scientific and
Technology Research, 3(2):206-212, February
2014.
[3] Yi-Qing Wang. An analysis of the viola-
jones face detection algorithm. Image Processing
On Line, 4:128-148, June 2014.
[4] Fabian Timm and Erhardt Barth.
Accurate eye centre localisation by means of
gradients. Proceedings of the Int. Conference on
Computer Theory and Applications (VISAPP),
1:125-130, 2011.