SSCET 1

Technical paper presentation BRAINGATE

SYSTEM
The down 'Brain about Gate' one

(Application of human computer interaction)

contains tiny spikes that will millimetre into the brain after being implanted beneath the skull,monitoring from a small the activity of group

milestone. It was reached, in large part, through the brain gate system. This system has become paralyzed. a boon The to the Gate Brain

neurons.It will now be possible for a patient with spinal cord injury to produce brain signals that relay the intention of moving the paralyzed limbs,as signals electronic operate to an implanted These devices sensor,which is then output as impulses. mechanical impulses enable the user to with the help of a computer cursor. Matthew Nagle,a 25year-old Massachusetts man with a severe spinal cord injury,has been paralyzed from the neck down since 2001.After taking part in a clinical trial of this system,he has opened email,switched TV channels,turned on lights.He even moved a robotic hand from his wheelchair. This

System is based on Cyber kinetics platform technology to sense,transmit,analyze The is principle that with brain of and operation brain are apply the language of neurons. behind the Brain Gate System intact signals function,

generated even though they are not sent to the arms, hands and legs.The signals are interpreted and an translated alternate into Brain cursor Gate movements, offering the user pathway to control a computer with thought,just as individuals who have the ability to move their hands use a mouse.

SSCET 2

marks the first time that neural movement signals have been recorded and decoded in a human with spinal cord injury.The system is also the first to allow a human to control his surrounding environment using his mind. How does the brain control motor function? The brain is "hardwired" with connections, which are made by billions of neurons that make electricity whenever they are stimulated. The electrical patterns are called brain waves. Neurons act like the wires and gates in a computer, transmitting gathering and electrochemical

body to the central nervous system. Receptors sense things like chemicals, light, and sound and encode this information into electrochemical by the signals sensory by transmitted everything

neurons. And interneurons tie together connecting the various neurons within the brain and spinal cord. The part of the brain that controls motor skills is located at the ear of the frontal lobe. How communication contain embedded does this happen? sensors

Muscles in the body's limbs called muscle spindles that measure the length and speed of the muscles as they stretch and contract as you move. Other respond sensors in the skin to stretching and

signals over distances as far as several feet. The brain encodes information not by relying on single spreading rapidly neurons, it but by large new carry across to

pressure. Even if paralysis or disease damages the part of the brain that processes movement, the brain still makes neural signals. They're just not being sent to the arms, hands and legs. A technique called uses brain neurofeedback scalp to translate

populations of neurons, and by adapting Motor circumstances. neurons signals from the central nervous system to the muscles, skin and glands of the body, while sensory neurons carry signals from those outer parts of the

connecting sensors on the

SSCET 3

waves into information a person can learn from. The sensors register different frequencies of the signals produced wave whether in the brain. indicate is or These changes in brain patterns someone

System and a cursor is shown to the user on a computer screen that provides an alternate "BrainGate pathway". The user can use that cursor to control the computer, just as a mouse is used."

concentrating

suppressing his impulses, or whether he is relaxed or tense. NEUROPROSTHETIC DEVICE: A neuroprosthetic device known as Braingate converts brain activity into computer commands. A sensor is implanted on the brain, and electrodes are hooked up to wires that travel to a pedestal on the scalp. From there, a fiber optic cable carries the brain activity computer. PRINCIPLE: "The principle of data to a nearby

operation of the BrainGate Neural Interface System is that with intact brain function, neural signals are generated even though they are not sent to the arms, hands and legs. These signals are interpreted by the

SSCET 4

BrainGate is a brain implant system developed by the bio-tech conjunction Department University. was those who The to have company with the of Currently the chip uses 100 hair-thin electrodes that 'hear' neurons firing in specific areas of the brain, for example, the area that controls arm movement. translated The into activity is electrically device help lost Cyberkinetics in 2003 in

Neuroscience at Brown designed

control of their limbs, or other bodily functions, such as patients with amyotrophic cord injury. into lateral The the sclerosis (ALS) or spinal computer chip, which is implanted patient and converts the intention of the user into computer commands.

charged signals and are then sent and decoded using a program, which can move either a robotic arm or a computer cursor. According to the three system. confirmed injury, Cyberkinetics' patients The that website, been has have company one

implanted with the BrainGate patient has

(Matt Nagle) has a spinal cord whilst another advanced ALS. In addition to real-time analysis of neuron patterns to relay movement, the Braingate array NEURO CHIP: is also capable of recording electrical data for later analysis. A potential use of this feature would be for a neurologist to study seizure

SSCET 5

patterns epilepsy.

in a patient with

removing

unnecessary

frequency bands, averaging the current brain activity level, transforming scalp potentials . Band Alpha (_) rhyth m Beta (_) Theta (_) Delta (_) the and measured to cortex denoising. potentials with a range of and conditions States.

Braingate is currently recruiting patients neuromuscular neurodegenerative United

for pilot clinical trials in the

Frequency bands of the EEG : Frequency [Hz] 8-12 9-11 14 -30 4-7 <3 Amplit- Location -ude [_V] 10 -150 Occipital/ Parietal regions varies Precentral/ Postcentra l regions 25 typically frontal regions varies varies varies varies

DETECTION: WORKING: Operation of the BCI system is not simply listening the EEG of user in a way that lets tap this EEG in and listen what happens. The user usually generates some sort of mental activity pattern that is later detected and classified. PREPROCESSING: The raw EEG signal requires some preprocessing before the feature extraction. This preprocessing includes The detection of the input from the user and them translating it into an action could be considered as key part of any BCI system. This detection means to try to find out these mental tasks from the EEG signal. It can be done in time-domain, e.g. by comparing amplitudes of the EEG and in frequency-domain. This involves usually digital signal processing for sampling and

SSCET 6

band pass filtering the signal, then calculating these time -or frequency domain features and then classifying them. These classification algorithms include simple comparison of amplitudes linear and nonlinear equations and artificial neural networks. By constant feedback from user to the system and vice versa, both partners gradually learn more from each other and improve the overall performance. CONTROL: The final part consists of applying the will of the user to the used application. The user chooses an action by controlling his brain activity, which is then detected and classified to corresponding action. Feedback is provided to user by audio-visual means e.g. when typing with virtual keyboard, letter appears to the message box etc. TRAINING: The training is the part where the user adapts to the BCI begins system. with This very with training simple mental

activity which is used to relay the information to the computer. Motivation,

frustration, fatigue, etc. apply also here and their effect should be taken into consideration when planning the training procedures. BIO FEEDBACK: The definition of the biofeedback is biological information which is returned to the source that created it, so that source can understand it and have control over it. This biofeedback in BCI systems is usually provided by visually, e.g. the user sees cursor moving up or down or letter being selected from the alphabet.

A boon to the paralyzed -Brain Gate Neural Interface System The Massachusetts first man patient, with a

Matthew Nagle, a 25-year-old severe spinal cord injury, has

exercises where the user is familiarized

SSCET 7

been paralyzed from the neck down since 2001. Nagle is unable to move his arms and legs after he was stabbed in the neck. During 57 sessions, at New England Sinai Hospital and Nagle Rehabilitation learned to Center, open

simulated e-mail, draw circular shapes using a paint program on the computer and play a simple videogame, "neural Pong," using only his thoughts. He could change the channel and adjust the volume on a television, even while conversing. He was ultimately able to open and close the fingers of a prosthetic hand and use a robotic limb to grasp and move objects. Despite a decline in neural signals after few months, Nagle remained an active participant in the trial and continued to aid the clinical team in producing valuable feedback concerning the BrainGate` technology. NAGLES STATEMENT: I can't put it into words. It's justI use my brain. I just thought it. I said, "Cursor go up to the top right." And it did, and now I can control it all over the screen. It will give me a sense of independence.

SSCET 8

OTHER APPLICATIONS:

neuronal firings to reproduce images seen by cats. The team used an array of electrodes embedded in the thalamus (which integrates all of the brains sensory input) of sharpeyed cats. Researchers targeted 177 brain cells in the thalamus lateral geniculate nucleus area, which decodes signals from the retina. The cats were shown

Rats

implanted

with

eight short movies, and their neuron firings were recorded. Using mathematical filters, the researchers decoded the signals to generate movies of what the cats saw and were able to reconstruct recognisable scenes and moving objects.

BCIs in Theodore Berger's experiments.Several laboratories have managed to record signals from monkey and rat cerebral cortexes in order to operate BCIs to carry out movement. Monkeys have navigated computer cursors on screen and commanded robotic arms to perform simple tasks simply by thinking about the task and without any motor output. Other research on cats has decoded visual signals. Garrett Stanley's recordings of cat vision using a BCI implanted in the lateral geniculate nucleus (top row: original image; bottom row: recording) in 1999, researchers led by Garrett Stanley at Harvard University decoded

In the 1980s, Apostolos Georgopoulos at Johns Hopkins University mathematical found a relationship

between the (based on a cosine function). He also found that dispersed groups of neurons in different areas of the brain

SSCET 9

collectively controlled motor commands but was only able to record the firings of neurons in one area at a time because of technical limitations imposed by his equipment.[4] There has been rapid development in BCIs since the mid-1990s.[5] Several groups have been able to capture complex brain motor centre signals using recordings from neural ensembles (groups of neurons) and use these to control external devices, including research groups led by Richard Andersen, John Donoghue, Phillip Kennedy, Miguel Nicolelis, and Andrew Schwartz.

the

feedback

loop

and

reproduced monkey reaching and grasping movements in a robot arm. With their deeply cleft and furrowed brains, rhesus monkeys are considered to be better models for human neurophysiology than owl monkeys. The monkeys were trained to reach and grasp objects on a computer screen by manipulating while a joystick corresponding

movements by a robot arm were hidden.The monkeys were later shown the robot directly and learned to control it by viewing its movements. The BCI used velocity predictions to control reaching movements and simultaneously predicted hand gripping force. Other labs that develop BCIs and algorithms that decode neuron signals include John Donoghue from Brown University, Andrew Schwartz from the University and were of Pittsburgh researchers Richard able to

Diagram

of

the

BCI

developed by Miguel Nicolelis and collegues for use on Rhesus monkeys Later experiments by Nicolelis using rhesus monkeys, succeeded in closing

Andersen from Caltech. These produce working BCIs even though they recorded signals from far fewer neurons than

SSCET 10

Nicolelis

(1530

neurons group rhesus

Biomedical

Instrumentation, signal

versus 50200 neurons). Donoghue's reported training

Microelectronics,

processing, Artificial Neural Networks and Robotics which has developments. implemented overwhelming Hope for these many

monkeys to use a BCI to track visual targets on a computer screen loop with BCI).[10] or without assistance of a joystick (closedSchwartzss's group created a BCI for threedimensional tracking in virtual reality and also reproduced BCI control in a robotic arm. CONCLUSION: The idea of moving robots or prosthetic devices not by manual control, but by mere thinking (i.e., the brain activity of human subjects) has been a fascinated approach. Medical cures are unavailable for many forms of neural and muscular by paralysis. is a The strong BMI enormity of the deficits caused paralysis to motivation pursue

systems will be effectively Biomedical applications. REFERENCES 1)Graun, Christian ; Gerken, Jens ; Jetter, Hans-Christian ; Kaonig,Werner Centred Research Technology European Digital Library ECDL and for ; Reiterer, Metadata 2005: Digital on Advanced Harald: MedioVis - a UserBrowser.In:

Libraries, Proceedingsof the 9th Conference Libraries, Springer

Verlag, September 2005. 2)[Heilig u. a. 2008] Heilig, Mathias ; Demarmels, Mischa ; Konig, Werner A. ; Gerken, Jens ; Rexhausen, Sebastian ; Jetter, Hans-Christian ; Reiterer, Harald: MedioVis: visual information seeking in digital libraries. In: AVI '08: Proceedings ofthe working Advanced conference visual on

solutions. So this idea helps many patients to control the prosthetic devices of their own by simply thinking about the task. This technology is well supported by the latest fields of

interfaces.

SSCET 11

New

York,

NY,

USA

ACM,Mai 2008, S. 490{491. 3)http://portal.acm.org/citation. cfm?id=1385569.1385671. { ISBN 0-978-60558-141-5 4)[Huffman 2008] Huffman, Scott: Search evaluation at Google. Website.September2008.{URL http://googleblog.blogspot.com/ 2008/09/ search-evaluation-atgoogle.html