02268nas a2200409 4500008004100000022001400041245011100055210006900166260001200235300001100247490000600258520108700264653001501351653001001366653001001376653001801386653002001404653003601424653003701460653003201497653002601529653002701555653001301582653001101595653002601606653001101632653000901643653001601652653001301668653002201681653002801703100001801731700002301749700001901772700001901791856004801810 2011 eng d a1741-255200aDecoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans.0 aDecoding vowels and consonants in spoken and imagined words usin c08/2011 a0460280 v83 a

Several stories in the popular media have speculated that it may be possible to infer from the brain which word a person is speaking or even thinking. While recent studies have demonstrated that brain signals can give detailed information about actual and imagined actions, such as different types of limb movements or spoken words, concrete experimental evidence for the possibility to 'read the mind', i.e. to interpret internally-generated speech, has been scarce. In this study, we found that it is possible to use signals recorded from the surface of the brain (electrocorticography) to discriminate the vowels and consonants embedded in spoken and in imagined words, and we defined the cortical areas that held the most information about discrimination of vowels and consonants. The results shed light on the distinct mechanisms associated with production of vowels and consonants, and could provide the basis for brain-based communication using imagined speech.

10aAdolescent10aAdult10aBrain10aBrain Mapping10aCerebral Cortex10aCommunication Aids for Disabled10aData Interpretation, Statistical10aDiscrimination (Psychology)10aElectrodes, Implanted10aElectroencephalography10aEpilepsy10aFemale10aFunctional Laterality10aHumans10aMale10aMiddle Aged10aMovement10aSpeech Perception10aUser-Computer Interface1 aPei, Xiao-Mei1 aBarbour, Dennis, L1 aLeuthardt, E C1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2175036903279nas a2200337 4500008004100000022001400041245011400055210006900169260001200238300001200250490000700262520231800269653001502587653001002602653001002612653001802622653002702640653001102667653001102678653000902689653001602698653004102714653002002755100001802775700001902793700002202812700001902834700002102853700001902874856004802893 2011 eng d a1095-957200aSpatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition.0 aSpatiotemporal dynamics of electrocorticographic high gamma acti c02/2011 a2960-720 v543 a

Language is one of the defining abilities of humans. Many studies have characterized the neural correlates of different aspects of language processing. However, the imaging techniques typically used in these studies were limited in either their temporal or spatial resolution. Electrocorticographic (ECoG) recordings from the surface of the brain combine high spatial with high temporal resolution and thus could be a valuable tool for the study of neural correlates of language function. In this study, we defined the spatiotemporal dynamics of ECoG activity during a word repetition task in nine human subjects. ECoG was recorded while each subject overtly or covertly repeated words that were presented either visually or auditorily. ECoG amplitudes in the high gamma (HG) band confidently tracked neural changes associated with stimulus presentation and with the subject's verbal response. Overt word production was primarily associated with HG changes in the superior and middle parts of temporal lobe, Wernicke's area, the supramarginal gyrus, Broca's area, premotor cortex (PMC), primary motor cortex. Covert word production was primarily associated with HG changes in superior temporal lobe and the supramarginal gyrus. Acoustic processing from both auditory stimuli as well as the subject's own voice resulted in HG power changes in superior temporal lobe and Wernicke's area. In summary, this study represents a comprehensive characterization of overt and covert speech using electrophysiological imaging with high spatial and temporal resolution. It thereby complements the findings of previous neuroimaging studies of language and thus further adds to current understanding of word processing in humans.

10aAdolescent10aAdult10aBrain10aBrain Mapping10aElectroencephalography10aFemale10aHumans10aMale10aMiddle Aged10aSignal Processing, Computer-Assisted10aVerbal Behavior1 aPei, Xiao-Mei1 aLeuthardt, E C1 aGaona, Charles, M1 aBrunner, Peter1 aWolpaw, Jonathan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2102978403803nas a2200433 4500008004100000022001400041024002500055245010000080210006900180260001200249300001100261490000600272520257600278653001002854653001002864653001802874653002502892653002702917653002202944653002802966653001102994653001103005653001603016653000903032653001603041653001403057653003403071653002803105100001903133700002203152700001803174700002103192700001803213700002903231700001803260700002403278700001903302856004803321 2011 eng d a1741-2552 aNIHMSID: NIHMS48176700aUsing the electrocorticographic speech network to control a brain-computer interface in humans.0 aUsing the electrocorticographic speech network to control a brai c06/2011 a0360040 v83 a

Electrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.

10aAdult10aBrain10aBrain Mapping10aComputer Peripherals10aElectroencephalography10aEvoked Potentials10aFeedback, Physiological10aFemale10aHumans10aImagination10aMale10aMiddle Aged10aNerve Net10aSpeech Production Measurement10aUser-Computer Interface1 aLeuthardt, E C1 aGaona, Charles, M1 aSharma, Mohit1 aSzrama, Nicholas1 aRoland, Jarod1 aFreudenberg, Zachary, V.1 aSolisb, Jamie1 aBreshears, Jonathan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2147163801656nas a2200337 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520066900243653001000912653001800922653003300940653002700973653001101000653003001011653001301041653003601054100001801090700001901108700002701127700002201154700001301176700001901189700002301208700002001231700001901251856004801270 2010 eng d a1525-506900aProceedings of the first international workshop on advances in electrocorticography.0 aProceedings of the first international workshop on advances in e c10/2010 a204-150 v193 a

In October 2009, a group of neurologists, neurosurgeons, computational neuroscientists, and engineers congregated to present novel developments transforming human electrocorticography (ECoG) beyond its established relevance in clinical epileptology. The contents of the proceedings advanced the role of ECoG in seizure detection and prediction, neurobehavioral research, functional mapping, and brain-computer interface technology. The meeting established the foundation for future work on the methodology and application of surface brain recordings.

10aBrain10aBrain Mapping10aDiagnosis, Computer-Assisted10aElectroencephalography10aHumans10aInternational Cooperation10aSeizures10aSignal Detection, Psychological1 aRitaccio, A L1 aBrunner, Peter1 aCervenka, Mackenzie, C1 aCrone, Nathan, E.1 aGuger, C1 aLeuthardt, E C1 aOostenveld, Robert1 aStacey, William1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2088938402156nas a2200337 4500008004100000022001400041245008300055210006900138260001200207300000700219490000700226520120000233653001001433653002001443653001101463653002401474653001701498653001301515653002301528653002401551653002801575653001301603653004101616653002801657100001901685700001901704700001801723700001601741700001301757856004801770 2009 eng d a1092-068400aEvolution of brain-computer interfaces: going beyond classic motor physiology.0 aEvolution of braincomputer interfaces going beyond classic motor c07/2009 aE40 v273 a

The notion that a computer can decode brain signals to infer the intentions of a human and then enact those intentions directly through a machine is becoming a realistic technical possibility. These types of devices are known as brain-computer interfaces (BCIs). The evolution of these neuroprosthetic technologies could have significant implications for patients with motor disabilities by enhancing their ability to interact and communicate with their environment. The cortical physiology most investigated and used for device control has been brain signals from the primary motor cortex. To date, this classic motor physiology has been an effective substrate for demonstrating the potential efficacy of BCI-based control. However, emerging research now stands to further enhance our understanding of the cortical physiology underpinning human intent and provide further signals for more complex brain-derived control. In this review, the authors report the current status of BCIs and detail the emerging research trends that stand to augment clinical applications in the future.

10aBrain10aCerebral Cortex10aHumans10aMan-Machine Systems10aMotor Cortex10aMovement10aMovement Disorders10aNeuronal Plasticity10aProstheses and Implants10aResearch10aSignal Processing, Computer-Assisted10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aRoland, Jarod1 aRouse, Adam1 aMoran, D uhttp://www.ncbi.nlm.nih.gov/pubmed/1956989203287nas a2200265 4500008004100000022001400041245007900055210006900134260001200203300002600215490000700241520252600248653001002774653001102784653002402795653001302819653001702832653002802849653002802877100001902905700001902924700001302943700001702956856004802973 2006 eng d a1524-404000aThe emerging world of motor neuroprosthetics: a neurosurgical perspective.0 aemerging world of motor neuroprosthetics a neurosurgical perspec c07/2006 a1-14; discussion 1-140 v593 a

A MOTOR NEUROPROSTHETIC device, or brain computer interface, is a machine that can take some type of signal from the brain and convert that information into overt device control such that it reflects the intentions of the user's brain. In essence, these constructs can decode the electrophysiological signals representing motor intent. With the parallel evolution of neuroscience, engineering, and rapid computing, the era of clinical neuroprosthetics is approaching as a practical reality for people with severe motor impairment. Patients with such diseases as spinal cord injury, stroke, limb loss, and neuromuscular disorders may benefit through the implantation of these brain computer interfaces that serve to augment their ability to communicate and interact with their environment. In the upcoming years, it will be important for the neurosurgeon to understand what a brain computer interface is, its fundamental principle of operation, and what the salient surgical issues are when considering implantation. We review the current state of the field of motor neuroprosthetics research, the early clinical applications, and the essential considerations from a neurosurgical perspective for the future.

10aBrain10aHumans10aMan-Machine Systems10aMovement10aNeurosurgery10aProstheses and Implants10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aMoran, D1 aOjemann, J G uhttp://www.ncbi.nlm.nih.gov/pubmed/1682329403554nas a2200361 4500008004100000022001400041245007800055210006900133260001200202300001000214490000600224520253800230653001002768653001002778653003602788653002502824653003302849653002602882653002702908653002202935653001102957653001102968653001602979653000902995653002303004653002803027100001903055700001903074700002103093700001703114700001303131856004803144 2004 eng d a1741-256000aA brain-computer interface using electrocorticographic signals in humans.0 abraincomputer interface using electrocorticographic signals in h c06/2004 a63-710 v13 a

Brain-computer interfaces (BCIs) enable users to control devices with electroencephalographic (EEG) activity from the scalp or with single-neuron activity from within the brain. Both methods have disadvantages: EEG has limited resolution and requires extensive training, while single-neuron recording entails significant clinical risks and has limited stability. We demonstrate here for the first time that electrocorticographic (ECoG) activity recorded from the surface of the brain can enable users to control a one-dimensional computer cursor rapidly and accurately. We first identified ECoG signals that were associated with different types of motor and speech imagery. Over brief training periods of 3-24 min, four patients then used these signals to master closed-loop control and to achieve success rates of 74-100% in a one-dimensional binary task. In additional open-loop experiments, we found that ECoG signals at frequencies up to 180 Hz encoded substantial information about the direction of two-dimensional joystick movements. Our results suggest that an ECoG-based BCI could provide for people with severe motor disabilities a non-muscular communication and control option that is more powerful than EEG-based BCIs and is potentially more stable and less traumatic than BCIs that use electrodes penetrating the brain.

10aAdult10aBrain10aCommunication Aids for Disabled10aComputer Peripherals10aDiagnosis, Computer-Assisted10aElectrodes, Implanted10aElectroencephalography10aEvoked Potentials10aFemale10aHumans10aImagination10aMale10aMovement Disorders10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aWolpaw, Jonathan1 aOjemann, J G1 aMoran, D uhttp://www.ncbi.nlm.nih.gov/pubmed/15876624