Professional Documents
Culture Documents
Bionic Eye
Bionic Eye
BACHELOR OF TECHNOLOGY
In
By
APRIL 2011
CERTIFICATE
This is to certify that the Seminar Report titled BIONIC EYE: A LOOK INTO
CURRENT RESEARCH AND FUTURE PROSPECTS, submitted in partial
fulfillment of the requirements for the award of the Degree of Bachelor of
Technology in Electronics and Communication Engineering of Mahatma
Gandhi University, is a record of the seminar presented by the candidate
VISHNU
NARAYANA
PANICKER,
Department
of
Electronics
and
Mr. VAISAKHAN K R
Seminar Co-ordinator
Dept. of ECE
MGUCE,Thodupuzha
External Examiner
Place: Thodupuzha
Date:
Internal Examiner
ACKNOWLEDGEMENT
CONTENTS
List of Figures
Abstract
1. Introduction
1.1 VISUAL SYSTEM
1.2 THE EYE
1.3 ANATOMY OF EYE
1.4 HOW ARE WE ABLE TO SEE?
1.5 RETINA
1.6 RETINAL DISEASES
2
3
4
5
6
7
8
10
10
11
12
14
3. OCULAR IMPLANTS
3.1 EPI-RETINAL IMPLANTS
3.2 SUB RETINAL IMPLANTS
16
17
20
24
26
26
27
5. ON GOING DEVELOPMENTS
5.1 ARGUS III
5.2 MITS RETINAL IMPLANT
5.3 OPTOELECTRONIC RETINAL PROSTHESIS (STANFORD IMPLANT)
28
28
29
30
6. CHALLENGES
32
7. CONCLUSION
34
8. BIBLIOGRAPHY
35
LIST OF FIGURES
2. Eye-Camera Similarity
3. Anatomy Of Eye
4. The Eye
5. Retina
6. Argus II
12
18
8. Subretinal Implant
20
21
24
25
26
27
28
29
ABSTRACT
A visual prosthesis often referred to as a bionic eye or retinal implant, is an
experimental visual device intended to restore functional vision. A visual
prosthetic or bionic eye is a form of neural prosthesis intended to partially
restore lost vision or amplify existing vision. It usually takes the form of an
externally-worn camera that is attached to a stimulator on the retina, optic
nerve, or in the visual cortex, in order to produce perceptions in the visual
cortex. Bionic eye restores the vision lost due to damage of retinal cells.
The retina is a thin layer of neural tissue that lines the back wall inside the
eye. Some of these cells act to receive light, while others interpret the
information and send messages to the brain through the optic nerve. This is
part of the process that enables us to see. In damaged or dysfunctional
retina, the photoreceptors stop working, causing blindness. By some
estimates, there are more than 10 million people worldwide affected by
retinal diseases that lead to loss of vision. The absence of effective
therapeutic remedies for Retinis pigmentosa (RP) and Age-related macular
degeneration (AMD) has motivated the development of experimental
strategies to restore some degree of functional vision to affected patients.
Because the remaining retinal layers are anatomically spared, several
approaches have been designed to artificially activate this residual retina and
thereby the visual system.
Page |1
1. INTRODUCTION
Technology has done wonders for the mankind. We have seen prosthetics
that helped overcome handicaps. Bio medical engineers play a vital role in
shaping the course of these prosthetics. Now it is the turn of Artificial Vision
through Bionic Eyes.
Chips are designed specifically to imitate the characteristics of the damaged
retina, and the cones and rods of the organ of sight are implanted with a
microsurgery.
Whether it be Bio medical, Computer, Electrical, or Mechanical Engineers
all of them have a role to play in the personification of Bionic Eyes. This
multidisciplinary nature of the new technology has inspired me to present
this paper.
There is hope for the blind in the form of Bionic Eyes. This technology can
add life to their vision less eyes!
Today, we talk of artificial intelligence that has created waves of interest in
the field of robotics. When this has been possible, why not artificial vision? It
is with this dream that I present this paper on Bionic Eyes. Sooner or later,
this shall create a revolution in the field of medicine.
It is important to know few facts about the organ of sight i.e, the Eye before
we proceed towards the technicalities involved.
Page |2
The nerve system can achieve this type of high volume data transfer by
confining such capability to just part of the retina surface, whereas the
centre of the retina has a 1:1 ratio between the photoreceptors and the
transmitting elements, the far periphery has a ratio of 300:1. This results in
gradual shift in resolution and other system parameters.
At the brains highest level, the visual cortex, an impressive array of feature
extraction mechanisms can rapidly adjust the eyes position to sudden
movements in the peripherals filed of objects too small to see when
stationary. The visual system can resolve spatial depth differences by
combining signals from both eyes with a precision less than one tenth the
size of a single photoreceptor.
Page |3
Page |4
Page |5
Page |6
1.5 RETINA
The retina is the innermost layer of the wall of the eyeball. Millions of lightsensitive cells there absorb light rays and convert them to electrical signals.
Light first enters the optic (or nerve) fibre layer and the ganglion cell layer,
under which most of the nourishing blood vessels of the retina are located.
This is where the nerves begin, picking up the impulses from the retina and
transmitting them to the brain.
Light
Fig. Retina
Page |7
Page |8
Page |9
P a g e | 10
optic nerve to the brain, which is able to perceive patterns of light and dark
spots corresponding to which electrodes have been stimulated. The device
receives signals from a pair of glasses worn by the patient, which are fitted
with a camera.
The camera feeds the visual information into a separate image-processing
unit, which makes 'sense' of the image by extracting certain features. The
unit then breaks down the image into pixels and sends the information, one
pixel at a time, to the silicon chip, which then reconstructs the image. Data is
broadcasted into the body using radio waves. It's like a radio station that
only has a range of 25 millimetres.
Currently the technology is only able to transmit a 10 x 10 pixel. Participants
must be profoundly blind to be eligible those with even partial vision are
excluded due to the potential risk of visual damage.
The most recent version of the implant features an array of 60 pixels,
allowing users to distinguish between light and dark, and see certain distinct
objects. The ultimate goal, according to the research team, is to allow for
reading and face recognition by increasing the number of pixels to 1,000.
P a g e | 11
Now, a company called Second Sight has received FDA approval to begin U.S.
trials of a retinal implant system that gives blind people a limited degree of
vision.
Second Sights first generation Argus 16 implant consists of a 16 electrode
array and a relatively large implanted receiver implanted behind the ear. The
second generation Argus II is designed with a 60 electrode array and a much
smaller receiver that is implanted around the eye.
It (Argus II) is an array of electrodes that is surgically implanted onto the
retina the layer of specialised cells that normally respond to light found at
the back of the eye. This array of electrodes is able to send signals to the
brain that the persons biological retina is unable to send. Of course, the
electrode array is not very useful unless it is receiving visual data to send to
the brain. To solve this problem the patient is fitted with a pair of glasses
that contain a tiny video camera that continuously records footage of what is
in front of the patient. This video signal is sent wirelessly to a wearable
computer that first filters and processes the video signal and then feeds this
formatted data to the electrode array. A picture of the entire setup can be
seen below:
Fig. Argus II
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
P a g e | 12
The Argus II Retinal Prosthesis System can provide sight -- the detection of
light -- to people who have gone blind from degenerative eye diseases like
macular degeneration and retinitis pigmentosa. Both diseases damage the
eyes' photoreceptors, the cells at the back of the retina that perceive light
patterns and pass them on to the brain in the form of nerve impulses, where
the impulse patterns are then interpreted as images. The Argus II system
takes the place of these photoreceptors.
P a g e | 13
they were working (except that the pattern wouldn't be digitally encoded).
The electrical signals generated by the stimulated electrodes then travel as
neural signals to the visual center of the brain by way of the normal
pathways used by healthy eyes -- the optic nerves. In macular degeneration
and retinitis pigmentosa, the optical neural pathways aren't damaged. The
brain, in turn, interprets these signals as a tree and tells the subject, "You're
seeing a tree."
2.4 WORKING
Normal vision begins when light enters and moves through the eye to strike
specialized photoreceptor (light-receiving) cells in the retina called rods and
cones. These cells convert light signals to electric impulses that are sent to
the optic nerve and the brain. Retinal diseases like age-related macular
degeneration and retinitis pigmentosa destroy vision by annihilating these
cells.
With the artificial retina device, a miniature camera mounted in eyeglasses
captures images and wirelessly sends the information to a microprocessor
(worn on a belt) that converts the data to an electronic signal and transmits
it to a receiver on the eye. The receiver sends the signals through a tiny, thin
cable to the microelectrode array, stimulating it to emit pulses. The artificial
retina device thus bypasses defunct photoreceptor cells and transmits
electrical signals directly to the retinas remaining viable cells. The pulses
travel to the optic nerve and, ultimately, to the brain, which perceives
patterns of light and dark spots corresponding to the electrodes stimulated.
Patients learn to interpret these visual patterns.
It takes some training for subjects to actually see a tree. At first, they see
mostly light and dark spots. But after a while, they learn to interpret what
the brain is showing them, and they eventually perceive that pattern of light
and dark as a tree.
Researchers are already planning a third version that has a 1000 electrodes
on the retinal implant, which they believe could allow for reading, facialrecognition capabilities etc.
P a g e | 14
P a g e | 15
3. OCULAR IMPLANTS
Ocular implants are those which are placed inside the retina. It aims at the
electrical excitation of two dimensional layers of neurons within partly
degenerated retinas for restoring vision in blind people. The implantation
can be done using standard techniques from ophthalmic surgery. Neural
signals farther down the pathway are processed and modified in ways not
really understood therefore, the earlier the electronic input is fed into the
nerves the better.
There are two types of ocular implants: Epi-retinal implants and Subretinal
implants.
Fig. Section of the eye showing the retina and its layers. In conditions such
as retinitis pigmentosa and macular degeneration, the light sensing rod and
cone cells ("photoreceptors") no longer function. A retinal prosthesis can
be placed either on the retinal surface ("epi-retinal") or below the retina in
the area of damaged photoreceptors ("sub-retinal") to try to stimulate the
remaining cells.
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
P a g e | 16
P a g e | 17
CHIP DEVELOPMENT:
EPI RETINAL ENCODER
The design of an epiretinal encoder is more complicated than the sub retinal
encoder, because it has to feed the ganglion cells. Here, a retina encoder
(RE) outside the eye replaces the information processing of the retina. A
retina stimulator (RS), implanted adjacent to the retinal ganglion cell layer at
the retinal 'output', contacts a sufficient number of retinal ganglion
cells/fibers for electrical stimulation. A wireless (Radio Frequency) signaland energy transmission system provides the communication between RE
and RS. The RE, then, maps visual patterns onto impulse sequences for a
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
P a g e | 18
BIOCOMPATIBILITY:
The material used for the chips and stimulating electrodes should satisfy a
variety of criterias. They must be corrosion-proof, i.e. bio stable.
The electrodes must establish a good contact to the nerve cells within
fluids, so that the stimulating electric current can pass from the photo
elements into the tissue.
It must be possible to manufacture these materials with micro technical
methods and,
They must be biologically compatible with the nervous system.
RF TELEMETRY:
In case of the epiretinal encoder, a wireless RF telemetry system acts as a
channel between the Retinal Encoder and the retinal stimulator. Standard
semiconductor technology is used to fabricate a power and signum receiving
chip, which drives current through an electrode array and stimulate the
retinal neurons. The intraocular transceiver processing unit is separated
from the stimulator in order to take into account the heat dissipation of the
rectification and power transfer processes. Care is taken to avoid direct
contact of heat dissipating devices with the retina.
P a g e | 19
P a g e | 20
P a g e | 21
processes the part of vision. There are many benefits of using the subretinal
prostheses. Such as, the MPD directly replaces the lost or degenerated RPE
cells; the retinas remaining network is still capable of processing electrical
signals; ease of fixing the high density MPDA in the subretinal position; no
need of any external camera or external image processing equipment; and
eye movement to locate the objects is not restricted.
There are some of the limitations to the subretinal implants as well. The
single MPD is not enough to stimulate enough current. So a subretinal
implant is supported by an external energy source, such as transpupillary
infrared illumination of receivers close to the chip or electromagnetic
transfer, is currently under progress. Some of the additional developments in
this process are movement to flexible substrates to hold the subtle nature of
the retina and to decrease the light intensity.
Now, a German firm dubbed Retina Implant has scored a big win for the sub
retinal solution with a three-millimeter, 1,500 pixel microchip that gives
patients a 12 degree field of view.
P a g e | 22
Fig. Shows the major difference between epi-retinal &sub retinal approach
In general,
Epiretinal Approach involves a semiconductor based device positioned on
the surface of the retina to try to simulate the remaining overlying cells.
Subretinal Approach involves implanting the ASR chip behind the retina
to simulate the remaining viable cells.
P a g e | 23
P a g e | 24
P a g e | 25
4.1 WORKING
The MARC system, pictured in the figures will operate in the following
manner. An external camera will acquire an image, whereupon it will be
encoded into data stream which will be transmitted via RF telemetry to an
intraocular transceiver. A data signal will be transmitted by modulating the
amplitude of a higher frequency carrier signal. The signal will be rectified
and filtered, and the MARC will be capable of extracting power, data, and a
clock signal. The subsequently derived image will then be stimulated upon
the patients retina.
Outside Eye:
The video input to the marc system block is given through a CCD camera.
This image is further processed using a PDA sized image processor & to
transmit it, we do pulse width modulation in first stage and then ASK
modulation is done. This signal is further amplified using a class E power
amplifier and transmitted using RF telemetry coils.
Inside Eye:
The signal received from the RF telemetry coils is power recovered and then
these signal is ASK demodulated and the data and clock is recovered from
this signals and these signal are sent to the configuration and control block
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
P a g e | 26
of the chip which from its input decode what information has to be sent to
each of the electrodes and sends them this data. And the electrodes in turn
stimulate the cells in the eye so as to send this stimulation to the brain
through optic nerve and help brain in visualizing the image and while this
process is going on the status of each electrode is sent to the marc
diagnostics chip outside the eye.
P a g e | 27
5. ON GOING DEVELOPMENTS
5.1 ARGUS III THE ARTIFICIAL RETINA IS NEAR!
P a g e | 28
pixels. The DOE eventually wants 1000 pixels; at that point you could reliably
make out someones face.
P a g e | 29
The MIT artificial retina may have a superior casing structure, made of
titanium.
The biggest difference between the two implants is where the electrodes
attach. While the Argus array is placed on the retina, the MIT implant will be
connected subretinally. This will reduce the risk of tearing during
implantation. The MIT team wants the implant to last more than 10 years. In
most other ways, the two devices are remarkably similar.
The Argus II, as weve said before is being tested in 20 patients with
remarkable results. The MIT implant has been proven to be safe in pig eyes
for at least 10 months, and the programming algorithms have been
thoroughly tested.
P a g e | 30
working
P a g e | 31
6. CHALLENGES
Current retinal implants provide very low resolution--just a few hundred
pixels. But several thousand pixels would be required for the restoration of
functional sight. A major limiting factor in achieving high resolution concerns
the proximity of electrodes to target cells. A pixel density of 2,500 pixels per
square millimeter corresponds to a pixel size of only 20 micrometers. But for
effective stimulation, the target cell should not be more than 10
micrometers from the electrode. It is practically impossible to place
thousands of electrodes so close to cells. With subretinal implants but not
epiretinal ones, researchers discovered a phenomenon--retinal migration-that they now rely on to encourage retinal cells to move near electrodes-within 7 to 10 microns. Within three days, cells migrate to fill the spaces
between pillars and pores.
Development of a high resolution retinal prosthesis faces multiple
engineering and biological challenges, such as delivery of information to
thousands of pixels at video rate, placement of the electrodes in close
proximity to the target cells, avoidance of fibrotic encapsulation of the
implant, signal processing that compensates for the partial loss of the retinal
neural network, and many others.
Biology imposes limitations, such as the needs for a system that will not heat
cells by more than 1 degree Celsius and for electrochemical interfaces that
aren't corrosive.
There are many very many obstacles to be overcome before Bionic Eyes
become a success story. Our eyes are perhaps the most sensitive of all
organs in the human body. A nano-sized irritant can create havoc in the eye.
There are 120 million rods and 6 million cones in the retina of every
healthy human eye. Creating an artificial replacement for these is no easy
task.
Si based photo detectors have been tried in earlier attempts. But Si is
toxic to the human body and reacts unfavorably with fluids in the eye.
There are many doubts as to how the brain will react to foreign signals
generated by artificial light sensors.
Infection and negative reaction are the always-feared factors. It is
imperative that all precautionary measures need to be ascertained.
DEPARTMENT OF ELECTRONICS AND COMMUNICATION
P a g e | 32
One of the greatest challenges seems to be ensuring that the implant can
remain in the eye for decades or more without causing scarring, immune
system responses, and general degradation from daily biological wear and
tear.
These artificial retinas are still years away from becoming widespread
because they are too expensive, too clunky, and too fragile to withstand
decades of normal wear and tear.
P a g e | 33
7. CONCLUSION
This is a revolutionary piece of technology and really has the potential to
change people's lives. Artificial Eye is such a revolution in medical science
field. Its good news for patients who suffer from retinal diseases. A bionic
eye implant that could help restore the sight of millions of blind people could
be available to patients within two years.
Retinal implants are able to partially restore the vision of people with
particular forms of blindness caused by diseases such as macular
degeneration or retinitis pigmentosa. About 1.5 million people worldwide
have retinitis pigmentosa, and one in 10 people over the age of 55 have agerelated macular degeneration. The invention and implementation of artificial
eye could help those people.
But whatever be the pro and cons of this system, if this system is fully
developed it will change the lives of millions of people around the world. We
may not restore the vision fully, but we can help them to least be able to find
their way, recognize faces, read books, above all lead an independent life.
P a g e | 34
8. BIBLIOGRAPHY
www.spectrum.ieee.org
www.stanford.edu
www.bionicvision.org.au
www.visionaustralia.org
www.2-sight.com
www.cosmosmagazine.com
www.ngm.nationalgeographic.com
www.sessionmagazine.com
www.health.howstuffworks.com
www.wikipedia.org
P a g e | 35