Professional Documents
Culture Documents
Brain Gate
Brain Gate
-1-
1.1.1 Nagles Statement: I can't put it into words. It's justI use my brain. I just thought it. I said, "Cursor go up to the top right." And it did, and now I can control it all over the screen. It will give me a sense of independence. In addition to real-time analysis of neuron patterns to relay movement, the Brain gate array is also capable of recording electrical data for later analysis. A potential use of this feature would be for a neurologist to study seizure patterns in a patient with epilepsy. The 'Brain Gate' device can provide paralyzed or motor-impaired patients a mode of communication through the translation of thought into direct computer control. The technology driving this breakthrough in the Brain-Machine-Interface field has a myriad of potential applications, including the development of human augmentation for military and commercial purposes. The Brain Fate Neural Interface device consists of a tiny chip containing 100 microscopic electrodes that is surgically implanted in the brain's motor cortex. This tiny chip contains tiny spikes that will extend down about one millimeter into the brain after being implanted beneath the skull, monitoring the activity from a small group of neurons. The chip can read signals from the motor cortex, send that information to a computer via connected wires, and translate it to control the movement of a computer cursor or a robotic arm. It will now be possible for a patient with spinal cord injury to produce brain signals that relay the intention of moving the paralyzed limbs, as signals to an implanted sensor, which is then
-2-
output as electronic impulses. These impulses enable the user to operate mechanical devices with the help of a computer cursor. The whole apparatus is the size of a baby aspirin. According to Dr. John Donoghue of Cyber kinetics, there is practically no training required to use Brain Gate because the signals read by a chip implanted, for example, in the area of the motor cortex for arm movement, are the same signals that would be sent to the real arm. A user with an implanted chip can immediately begin to move a cursor with thought alone. However, because movement carries a variety of information such as velocity, direction, and acceleration, there are many neurons involved in controlling that movement. Brain Gate is only reading signals from an extremely small sample of those cells and, therefore, only receiving a fraction of the instructions. Without all of the information, the initial control of a robotic hand may not be as smooth as the natural movement of a real hand. But with practice, the user can refine those movements using signals from only that sample of cells. The Brain Gate technology platform was designed to take advantage of the fact that many patients with motor impairment have an intact brain that can produce movement commands. This may allow the Brain Gate system to create an output signal directly from the brain, bypassing the route through the nerves to the muscles that cannot be used in paralyzed people. Brain gate is currently recruiting patients with a range of neuromuscular and neurodegenerative conditions for pilot clinical trials in the United States. Cyber kinetics hopes to refine the Brain Gate in the next two years to develop a wireless device that is completely implantable and doesn't have a plug, making it safer and less visible and once the basics of brain mapping are worked out there is potential for a wide variety of further applications. Surgeon explains, "If you could detect or predict the onset of epilepsy, which would be a huge therapeutic application for people who have seizures, which leads to the idea of a 'Pacemaker for the Brain'. So eventually people may have this technology in their brains and if something starts to go wrong it will take a therapeutic action. That could be available by 2007 to 2008."
-3-
-4-
Brain Gate contains a chip that is implanted on the surface of the motor cortex area of the brain. In the pilot version of the device, a cable connects the sensor to an external signal processor in a cart that contains three computers. The computers translate hard-to detect brain signals to create the communication output using custom decoding software. When the patient is connected to the system he or she can mentally move the cursor just like a mouse would do. John Donoghue, the chair of the Department of Neuroscience at Brown University, led the original project research and went on to co-found Cyber kinetics, where he is currently chief scientific officer overseeing the clinical trial. Hugh Herr, another scientist, also helped in the development of a neural interface system. Herr became very passionate about the development of a technology that would give independence and movement back to people that were physically impaired. Herr lost both legs at a young age from frostbite. He then started research on combining both body and machine, his research has already made a significant impact for people that are physically challenged. He has helped in the development of many prosthetics. The development of the Brain Gate System brain-computer interface is to enable those with severe paralysis and other neurological conditions to live more productively and independently. Also, scientists are developing the Brain Gate Systems underlying core technology in the NeuroPort System to enable improved diagnosis and treatment for a number of neurological conditions, such as epilepsy and brain trauma. The NeuroPort System is a neural monitor designed for acute inpatient applications and labeled for temporary recording and monitoring of brain electrical activity. Brain Gate will be the first human device that has been designed to record, filter, and amplify multiple channels of simultaneously recorded neural activity at a very high spatial and temporal resolution. It has been thoroughly researched and will contribute to the diagnosis and treatment of neurological conditions in patients who have undergone a craniotomy. This will give neurologists and neurosurgeons a new resource to detect, transmit and analyze neural activity.
-5-
Dr. Steve Williams, a clinical advisor to Cyber kinetics, presented a description of the Brain Gate Controller, a next generation, standardized interface system that is under development. The development of this system would replace the initial prototype controller which has been used in the Brain Gate trial until now. The M*Power Controller is designed to allow a Brain Gate System patient to control a standard wireless computer device. The new interface is also intended to be easier to use for patients and their families, so they can access the capabilities of the system on a routine basis without reliance on a technician. These two closely linked efforts are intended to yield a Brain Gate System allowing patients significant control over their environment, the ability to readily perform numerous daily activities that are currently beyond their reach, and vastly enhance communications opportunities. For example, use of the M*Controller as an interface control, by thought alone would allow patients to perform a range of tasks including: making and receiving telephone calls, controlling remote devices, accessing the internet, and communicating via e-mail. The Brain Gate system includes hardware and software and may be used as a telecommunication device in the future. This could greatly impact a business or organization. It will give people with disabilities a chance to work at a business just like anyone else. With this technology they will be able use a wide variety of devices and may also lead to a decline in the use of hands on activities. With the development of devices such as these, one day everyone may have chips in their brain that will allow them to perform tasks without the use of their body. We have presented to you an overview of the technology known as the Brain Gate System. Above, we have described the technology, discussed how it could impact a business or organization, and how the developers are planning to take this technology to the next level. Here is a recap of the main points: Brain Gate is a neural interface system device that has a chip that reads brain activity through the use of sensors and then transmits the activities to three computers which convert the thoughts into actions. This system is used for people that are physically impaired; it helps give them the independence and the capabilities of the norm. The scientists working on Brain Gate hope to create an operating system that is safe, effective and unobtrusive. The neurologists are constantly trying to come up with more ideas to push this form of emerging technology further.
-6-
1.5 Cyberkinetics
The idea of a machine that could read peoples minds has long been a farfetched and intriguing idea for the world of technology. However, this improbable development may be becoming more and more of a reality. Cyberkinetics Inc based in Foxboro, Mass. is developing a chip that can be implanted The chip has just received FDA approval and has begun its clinical trial. It is the hope of Cyberkinetics Inc that the chip will allow patients to command a computer action by simply thinking about it. Cyberkinetics Inc is one of the leading corporations in the field of brain computer interfaces. The company was established in 2001 in an effort to commercialize advances by Brown University scientists in the field of neurology. The chief executive of the company is Tim Surgenor, and he is a leading proponent in the development of direct brain connection technology. Cyberkinetics Inc has dubbed its development of this product as the BrainGate System. This campaign is hopped to be the breakthrough technological advance in the field of computer interfacing. Not only does this system expect to aid individuals with motor impairments through supporting their use of the computer, but it also hopes to monitor the treatment of certain diseases, such as epilepsy and depression. The BrainGate System has been under research and development for more than ten years at Brown University. Cyberkinetics Inc has just recently launched a trial of this system in five severely disabled individuals. However, the system was first tested by Cyberkinetics founder, John Donoghue, on three rhesus monkeys. The system was successful with this monkey testing. One of the monkeys was able to move a computer cursor using his brain. 1.5.1 Other Companies Cyberkinetics Inc is not the only company that is working on the development of direct brain connections. Similar efforts have been made by an Atlanta based company called Neural Signals as well as the New York State Department of Health under Dr. Jonathan Wolpaw.
-7-
Neural Signals has conducted its clinical trial and is hoping to make connections similar to that of Cyberkinetics. Dr. Wolpaws research focuses on the ability to train the mind and have it adapt to new patterns of cause and effect. Although great strides have been made in both of these efforts, it is believed that Cyberkinetics Inc will be the first to conduct a long term trial with more sophisticated devices.
-8-
-9-
The differences between BCIs and Neuroprosthetics are mostly in the ways the terms are used: Neuroprosthetics typically connect the nervous system, to a device, whereas the term BCIs usually connects the brain (or nervous system) with a computer system. Practical Neuroprosthetics can be linked to any part of the nervous system, for example peripheral nerves, while the term "BCI" usually designates a narrower class of systems which interface with the central nervous system. The terms are sometimes used interchangeably and for good reason. Neuroprosthetics and BCI seek to achieve the same aims, such as restoring sight, hearing, movement, ability to communicate, and even cognitive function. Both use similar experimental methods and surgical techniques. Based on the communicative Pathway BCI is classified as follows: 1. 2. One Way BCI: Computers either accept commands from the brain or send signals to it (for example, to restore vision) but not both. Two Way BCI: Brains and external devices can exchange information in both directions but have yet to be successfully implanted in animals or humans
Brain Computer interface is of three types based on its features and are: 1. Invasive BCI 2. Partially Invasive BCI 3. Non Invasive BCI
-10-
-11-
CHAPTER 4 WORKING
The raw EEG signal requires some preprocessing before the feature extraction. This preprocessing includes removing unnecessary frequency bands, averaging the current brain activity level, transforming the measured scalp potentials to cortex potentials and denoising.
4.1 Detection
The detection of the input from the user and them translating it into an action could be considered as key part of any BCI system. This detection means to try to find out these mental tasks from the EEG signal. It can be done in time-domain, e.g. by comparing amplitudes of the EEG and in frequency-domain. This involves usually digital signal processing for sampling and band pass filtering the signal, then calculating these time -or frequency domain features and then classifying them. These classification algorithms include simple comparison of amplitudes linear and non-linear equations and artificial neural networks. By constant feedback from user to the system and vice versa, both partners gradually learn more from each other and improve the overall performance.
4.2 Control
The final part consists of applying the will of the user to the used application. The user chooses an action by controlling his brain activity, which is then detected and classified to corresponding action. Feedback is provided to user by audio-visual means e.g. when typing with virtual keyboard, letter appears to the message box etc.
-12-
4.3.1
The simulation mode is used to test the BCI. Recording is the same as simulation, with the difference that the EEG data is recorded and used as training examples. It further has 3 operations within and they are Preparation, Prerecording and Recording. 4.3.2 Training
The training is the part where the user adapts to the BCI system. This training begins with very simple exercises where the user is familiarized with mental activity which is used to relay the information to the computer. Motivation, frustration, fatigue, etc. apply also here and their effect should be taken into consideration when planning the training procedures.
4.5 Sense
Cyber kinetics unique technology is able to simultaneously sense the electrical activity of many individual neurons. Our sensor consists of a silicon array about the size of a baby aspirin that contains one hundred electrodes, each thinner than a human hair. The array is implanted on the surface of the brain. In the Brain Gate Neural Interface System, the array is implanted in the area of the brain responsible for limb movement. In other applications the array may be implanted in areas of the brain responsible for other body processes.
-13-
to a pedestal which extends through the scalp. The pedestal is connected by an external cable to a set of computers in which the data can be stored for off-line analysis or analyzed in realtime. Signal processing software algorithms analyze the electrical activity of neurons and translate it into control signals for use in various computer-based applications.
-14-
4.7 Apply
Cyber kinetics ability to generate control signals and develop computer application interfaces provides us with a platform to develop multiple clinical products. For example, using the Brain Gate Neural Interface System, a person may be able to use his thoughts to control cursor motion and/or replicate keystrokes on a computer screen. In another example, a doctor may study patterns of brain electrical activity in patients with epilepsy before, during and after seizures.
-15-
Garrett Stanley's recordings of cat vision using a BCI implanted in the lateral geniculation nucleus (top row: original image; bottom row: recording) in 1999, researchers led by Garrett Stanley at Harvard University decoded neuronal firings to reproduce images seen by cats. The team used an array of electrodes embedded in the thalamus (which integrates all of the brains sensory input) of sharp-eyed cats. Researchers targeted 177 brain cells in the thalamus lateral geniculation nucleus area, which decodes signals from the retina. The cats were shown eight short movies, and their neuron firings were recorded. Using mathematical filters, the researchers decoded the signals to generate movies of what the cats saw and were able to reconstruct recognizable scenes and moving objects. There has been rapid development in BCIs since the mid-1990s. Several groups have been able to capture complex brain motor centre signals using recordings from neural ensembles (groups of neurons) and use these to control external devices, including research groups led by Richard Andersen, John Donoghue, Phillip Kennedy, Miguel Nicolelis, and Andrew Schwartz. Later experiments by Nicolelis using rhesus monkeys, succeeded in closing the feedback loop and reproduced monkey reaching and grasping movements in a robot arm. With their deeply cleft and furrowed brains, rhesus monkeys are considered to be better models for human neurophysiology than owl monkeys. The monkeys were trained to reach and grasp objects on a computer screen by manipulating a joystick while corresponding movements by a robot arm were hidden.
-16-
-17-
the processed signal. The first controlled device may provide feedback to the patient to improve control of the second controlled device.
-18-
6.5 Darpa
The Brown University group was partially funded by the Defence Advanced Research Projects Agency (DARPA), the central research and development organisation for the US Department of Defence (DoD). DARPA has been interested in Brain-Machine-Interfaces (BMI) for a number of years for military applications like wiring fighter pilots directly to their planes to allow autonomous flight from the safety of the ground. Future developments are also envisaged in which humans could 'download' memory implants for skill enhancement, allowing actions to be performed that have not been learned directly.
-19-
7.2 Disadvantages
The disadvantage of the Brain Gate System is that at this time, while still being perfected, the switches must be frequently adjusted which is a time consuming process. As the device is perfected this will not be an issue. There is also a worry that devices such as this will normalize society. The Brain Gate Neural Interface System has not been approved by the FDA, but has been approved for IDE status, which means that it has been approved for pre-market clinical trials. There are no estimates on cost or insurance at this time. Difficulty in adaptation and learning. Limitation in information transform rate. The latest technology is 20 bits/min.
-20-
-21-
CONCLUSION
The invention of Brain gate is such a revolution in medical field. The remarkable breakthrough offers hope that people who are paralyzed will one day be able to independently operate artificial limbs, computers or wheelchairs. The idea of moving robots or prosthetic devices not by manual control, but by mere thinking (i.e., the brain activity of human subjects) has been a fascinated approach. Medical cures are unavailable for many forms of neural and muscular paralysis. The enormity of the deficits caused by paralysis is a strong motivation to pursue BMI solutions. So this idea helps many patients to control the prosthetic devices of their own by simply thinking about the task. This technology is well supported by the latest fields of Biomedical Instrumentation, Microelectronics; signal processing, Artificial Neural Networks and Robotics which has overwhelming developments. Hope these systems will be effectively implemented for many biomedical applications.
-22-
REFERENCES
1.Simeral,J.D.Kim,Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical micro electrode array, Journal of Neural Engineering,Vol.8,No.2,pp.8-11,2011. 2. Alison Abbott, Mind control robot arms,International Weekly Journal of Science, Vol.32, pp.372-375, 16 May 2012. 3. Donoughue J.P,Science of Neural Interface Systems, Annual Review of Neuroscience, Vol.32, pp.249-266, July 2011. 4. Jens Schouenborg, Brain Machine Interfaces, Place: Sweden, August 2011. 5. www.cyberkineticsinc.com 6. www.braingate2.org
-23-