TY - JOUR T1 - Decoding covert spatial attention using electrocorticographic (ECoG) signals in humans. JF - Neuroimage Y1 - 2012 A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - Amy Daitch A1 - Leuthardt, E C A1 - A L Ritaccio A1 - Pesaran, Bijan A1 - Gerwin Schalk KW - covert attention KW - electrocorticography (ECoG) KW - visual spatial attention AB -

This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.

VL - 60 UR - http://www.ncbi.nlm.nih.gov/pubmed/22366333 IS - 4 ER - TY - JOUR T1 - Electrocorticographic (ECoG) Correlates of Human Arm Movements. JF - Exp Brain Res Y1 - 2012 A1 - Nicholas R Anderson A1 - Blakely, Timothy A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, Daniel W KW - arm tuning KW - brain-computer interfaces KW - cosine tuning KW - Electrocorticography KW - Motor Cortex KW - subdural electroencephalography AB - Invasive and non-invasive brain-computer interface (BCI) studies have long focused on the motor cortex for kinematic control of artificial devices. Most of these studies have used single-neuron recordings or electroencephalography (EEG). Electrocorticography (ECoG) is a relatively new recording modality in BCI research that has primarily been built on successes in EEG recordings. We built on prior experiments related to single-neuron recording and quantitatively compare the extent to which different brain regions reflect kinematic tuning parameters of hand speed, direction, and velocity in both a reaching and tracing task in humans. Hand and arm movement experiments using ECoG have shown positive results before, but the tasks were not designed to tease out which kinematics are encoded. In non-human primates, the relationships among these kinematics have been more carefully documented, and we sought to begin elucidating that relationship in humans using ECoG. The largest modulation in ECoG activity for direction, speed, and velocity representation was found in the primary motor cortex. We also found consistent cosine tuning across both tasks, to hand direction and velocity in the high gamma band (70-160 Hz). Thus, the results of this study clarify the neural substrates involved in encoding aspects of motor preparation and execution and confirm the important role of the motor cortex in BCI applications. VL - 223 UR - http://www.ncbi.nlm.nih.gov/pubmed/23001369 IS - 1 ER - TY - JOUR T1 - Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task. JF - Front Hum Neurosci Y1 - 2012 A1 - Leuthardt, E C A1 - Pei, Xiao-Mei A1 - Breshears, Jonathan A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Zachary V. Freudenberg A1 - Barbour, Dennis L A1 - Gerwin Schalk KW - cortex KW - Electrocorticography KW - gamma rhythms KW - human KW - Speech AB -

Several scientists have proposed different models for cortical processing of speech. Classically, the regions participating in language were thought to be modular with a linear sequence of activations. More recently, modern theoretical models have posited a more hierarchical and distributed interaction of anatomic areas for the various stages of speech processing. Traditional imaging techniques can only define the location or time of cortical activation, which impedes the further evaluation and refinement of these models. In this study, we take advantage of recordings from the surface of the brain [electrocorticography (ECoG)], which can accurately detect the location and timing of cortical activations, to study the time course of ECoG high gamma (HG) modulations during an overt and covert word repetition task for different cortical areas. For overt word production, our results show substantial perisylvian cortical activations early in the perceptual phase of the task that were maintained through word articulation. However, this broad activation is attenuated during the expressive phase of covert word repetition. Across the different repetition tasks, the utilization of the different cortical sites within the perisylvian region varied in the degree of activation dependent on which stimulus was provided (auditoryor visual cue) and whether the word was to be spoken or imagined. Taken together, the data support current models of speech that have been previously described with functional imaging. Moreover, this study demonstrates that the broad perisylvian speech network activates early and maintains suprathreshold activation throughout the word repetition task that appears to be modulated by the demands of different conditions.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/22563311 ER - TY - JOUR T1 - Brain-computer interfaces using electrocorticographic signals. JF - IEEE Rev Biomed Eng Y1 - 2011 A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Brain-computer interface (BCI) KW - brain-machine interface (BMI) KW - electrocorticography (ECoG) AB -

Many studies over the past two decades have shown that people and animals can use brain signals to convey their intent to a computer using brain-computer interfaces (BCIs). BCI systems measure specific features of brain activity and translate them into control signals that drive an output. The sensor modalities that have most commonly been used in BCI studies have been electroencephalographic (EEG) recordings from the scalp and single-neuron recordings from within the cortex. Over the past decade, an increasing number of studies has explored the use of electrocorticographic (ECoG) activity recorded directly from the surface of the brain. ECoG has attracted substantial and increasing interest, because it has been shown to reflect specific details of actual and imagined actions, and because its technical characteristics should readily support robust and chronic implementations of BCI systems in humans. This review provides general perspectives on the ECoG platform; describes the different electrophysiological features that can be detected in ECoG; elaborates on the signal acquisition issues, protocols, and online performance of ECoG-based BCI studies to date; presents important limitations of current ECoG studies; discusses opportunities for further research; and finally presents a vision for eventual clinical implementation. In summary, the studies presented to date strongly encourage further research using the ECoG platform for basic neuroscientific research, as well as for translational neuroprosthetic applications.

VL - 4 UR - http://www.ncbi.nlm.nih.gov/pubmed/22273796 ER - TY - JOUR T1 - Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2011 A1 - Pei, Xiao-Mei A1 - Barbour, Dennis L A1 - Leuthardt, E C A1 - Gerwin Schalk KW - Adolescent KW - Adult KW - Brain KW - Brain Mapping KW - Cerebral Cortex KW - Communication Aids for Disabled KW - Data Interpretation, Statistical KW - Discrimination (Psychology) KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Functional Laterality KW - Humans KW - Male KW - Middle Aged KW - Movement KW - Speech Perception KW - User-Computer Interface AB -

Several stories in the popular media have speculated that it may be possible to infer from the brain which word a person is speaking or even thinking. While recent studies have demonstrated that brain signals can give detailed information about actual and imagined actions, such as different types of limb movements or spoken words, concrete experimental evidence for the possibility to 'read the mind', i.e. to interpret internally-generated speech, has been scarce. In this study, we found that it is possible to use signals recorded from the surface of the brain (electrocorticography) to discriminate the vowels and consonants embedded in spoken and in imagined words, and we defined the cortical areas that held the most information about discrimination of vowels and consonants. The results shed light on the distinct mechanisms associated with production of vowels and consonants, and could provide the basis for brain-based communication using imagined speech.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/21750369 IS - 4 ER - TY - JOUR T1 - Neural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans. JF - Front Hum Neurosci Y1 - 2011 A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - Amy Daitch A1 - Leuthardt, E C A1 - A L Ritaccio A1 - Pesaran, Bijan A1 - Gerwin Schalk KW - covert attention KW - Electrocorticography KW - intention KW - motor response KW - visual-spatial attention AB -

Attention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/22046153 ER - TY - JOUR T1 - Nonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex. JF - J Neurosci Y1 - 2011 A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Zachary V. Freudenberg A1 - Breshears, Jonathan A1 - Bundy, David T A1 - Roland, Jarod A1 - Barbour, Dennis L A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Analysis of Variance KW - Brain Mapping KW - Brain Waves KW - Cerebral Cortex KW - Cognition Disorders KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Female KW - Humans KW - Male KW - Middle Aged KW - Neuropsychological Tests KW - Nonlinear Dynamics KW - Photic Stimulation KW - Reaction Time KW - Spectrum Analysis KW - Time Factors KW - Vocabulary AB -

High-gamma-band (>60 Hz) power changes in cortical electrophysiology are a reliable indicator of focal, event-related cortical activity. Despite discoveries of oscillatory subthreshold and synchronous suprathreshold activity at the cellular level, there is an increasingly popular view that high-gamma-band amplitude changes recorded from cellular ensembles are the result of asynchronous firing activity that yields wideband and uniform power increases. Others have demonstrated independence of power changes in the low- and high-gamma bands, but to date, no studies have shown evidence of any such independence above 60 Hz. Based on nonuniformities in time-frequency analyses of electrocorticographic (ECoG) signals, we hypothesized that induced high-gamma-band (60-500 Hz) power changes are more heterogeneous than currently understood. Using single-word repetition tasks in six human subjects, we showed that functional responsiveness of different ECoG high-gamma sub-bands can discriminate cognitive task (e.g., hearing, reading, speaking) and cortical locations. Power changes in these sub-bands of the high-gamma range are consistently present within single trials and have statistically different time courses within the trial structure. Moreover, when consolidated across all subjects within three task-relevant anatomic regions (sensorimotor, Broca's area, and superior temporal gyrus), these behavior- and location-dependent power changes evidenced nonuniform trends across the population. Together, the independence and nonuniformity of power changes across a broad range of frequencies suggest that a new approach to evaluating high-gamma-band cortical activity is necessary. These findings show that in addition to time and location, frequency is another fundamental dimension of high-gamma dynamics.

VL - 31 UR - http://www.ncbi.nlm.nih.gov/pubmed/21307246 IS - 6 ER - TY - JOUR T1 - Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition. JF - Neuroimage Y1 - 2011 A1 - Pei, Xiao-Mei A1 - Leuthardt, E C A1 - Charles M Gaona A1 - Peter Brunner A1 - Jonathan Wolpaw A1 - Gerwin Schalk KW - Adolescent KW - Adult KW - Brain KW - Brain Mapping KW - Electroencephalography KW - Female KW - Humans KW - Male KW - Middle Aged KW - Signal Processing, Computer-Assisted KW - Verbal Behavior AB -

Language is one of the defining abilities of humans. Many studies have characterized the neural correlates of different aspects of language processing. However, the imaging techniques typically used in these studies were limited in either their temporal or spatial resolution. Electrocorticographic (ECoG) recordings from the surface of the brain combine high spatial with high temporal resolution and thus could be a valuable tool for the study of neural correlates of language function. In this study, we defined the spatiotemporal dynamics of ECoG activity during a word repetition task in nine human subjects. ECoG was recorded while each subject overtly or covertly repeated words that were presented either visually or auditorily. ECoG amplitudes in the high gamma (HG) band confidently tracked neural changes associated with stimulus presentation and with the subject's verbal response. Overt word production was primarily associated with HG changes in the superior and middle parts of temporal lobe, Wernicke's area, the supramarginal gyrus, Broca's area, premotor cortex (PMC), primary motor cortex. Covert word production was primarily associated with HG changes in superior temporal lobe and the supramarginal gyrus. Acoustic processing from both auditory stimuli as well as the subject's own voice resulted in HG power changes in superior temporal lobe and Wernicke's area. In summary, this study represents a comprehensive characterization of overt and covert speech using electrophysiological imaging with high spatial and temporal resolution. It thereby complements the findings of previous neuroimaging studies of language and thus further adds to current understanding of word processing in humans.

VL - 54 UR - http://www.ncbi.nlm.nih.gov/pubmed/21029784 IS - 4 ER - TY - JOUR T1 - Using the electrocorticographic speech network to control a brain-computer interface in humans. JF - J Neural Eng Y1 - 2011 A1 - Leuthardt, E C A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Szrama, Nicholas A1 - Roland, Jarod A1 - Zachary V. Freudenberg A1 - Solisb, Jamie A1 - Breshears, Jonathan A1 - Gerwin Schalk KW - Adult KW - Brain KW - Brain Mapping KW - Computer Peripherals KW - Electroencephalography KW - Evoked Potentials KW - Feedback, Physiological KW - Female KW - Humans KW - Imagination KW - Male KW - Middle Aged KW - Nerve Net KW - Speech Production Measurement KW - User-Computer Interface AB -

Electrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/21471638 IS - 3 ER - TY - JOUR T1 - Electrocorticographic frequency alteration mapping for extraoperative localization of speech cortex. JF - Neurosurgery Y1 - 2010 A1 - Wu, Melinda A1 - Wisneski, Kimberly A1 - Gerwin Schalk A1 - Sharma, Mohit A1 - Roland, Jarod A1 - Breshears, Jonathan A1 - Charles M Gaona A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Chi-Square Distribution KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Mass Spectrometry KW - Middle Aged KW - Photic Stimulation KW - Speech KW - Verbal Behavior KW - Young Adult AB -

OBJECTIVE: 

Electrocortical stimulation (ECS) has long been established for delineating eloquent cortex in extraoperative mapping. However, ECS is still coarse and inefficient in delineating regions of functional cortex and can be hampered by afterdischarges. Given these constraints, an adjunct approach to defining motor cortex is the use of electrocorticographic (ECoG) signal changes associated with active regions of cortex. The broad range of frequency oscillations are categorized into 2 main groups with respect to sensorimotor cortex: low-frequency bands (LFBs) and high-frequency bands (HFBs). The LFBs tend to show a power reduction, whereas the HFBs show power increases with cortical activation. These power changes associated with activated cortex could potentially provide a powerful tool in delineating areas of speech cortex. We explore ECoG signal alterations as they occur with activated region of speech cortex and its potential in clinical brain mapping applications.

METHODS: 

We evaluated 7 patients who underwent invasive monitoring for seizure localization. Each had extraoperative ECS mapping to identify speech cortex. Additionally, all subjects performed overt speech tasks with an auditory or a visual cue to identify associated frequency power changes in regard to location and degree of concordance with ECS results.

RESULTS: 

Electrocorticographic frequency alteration mapping (EFAM) had an 83.9% sensitivity and a 40.4% specificity in identifying any language site when considering both frequency bands and both stimulus cues. Electrocorticographic frequency alteration mapping was more sensitive in identifying the Wernicke area (100%) than the Broca area (72.2%). The HFB is uniquely suited to identifying the Wernicke area, whereas a combination of the HFB and LFB is important for Broca localization.

CONCLUSION: 

The concordance between stimulation and spectral power changes demonstrates the possible utility of EFAM as an adjunct method to improve the efficiency and resolution of identifying speech cortex.

VL - 66 UR - http://www.ncbi.nlm.nih.gov/pubmed/20087111 IS - 2 ER - TY - JOUR T1 - Passive real-time identification of speech and motor cortex during an awake craniotomy. JF - Epilepsy Behav Y1 - 2010 A1 - Roland, Jarod A1 - Peter Brunner A1 - Johnston, James A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Brain Mapping KW - Brain Neoplasms KW - Cerebral Cortex KW - Craniotomy KW - Electric Stimulation KW - Electroencephalography KW - Humans KW - Neurologic Examination AB -

Precise localization of eloquent cortex is a clinical necessity prior to surgical resections adjacent to speech or motor cortex. In the intraoperative setting, this traditionally requires inducing temporary lesions by direct electrocortical stimulation (DECS). In an attempt to increase efficiency and potentially reduce the amount of necessary stimulation, we used a passive mapping procedure in the setting of an awake craniotomy for tumor in two patients resection. We recorded electrocorticographic (ECoG) signals from exposed cortex while patients performed simple cue-directed motor and speech tasks. SIGFRIED, a procedure for real-time event detection, was used to identify areas of cortical activation by detecting task-related modulations in the ECoG high gamma band. SIGFRIED's real-time output quickly localized motor and speech areas of cortex similar to those identified by DECS. In conclusion, real-time passive identification of cortical function using SIGFRIED may serve as a useful adjunct to cortical stimulation mapping in the intraoperative setting.

VL - 18 UR - http://www.ncbi.nlm.nih.gov/pubmed/20478745 IS - 1-2 ER - TY - JOUR T1 - Proceedings of the first international workshop on advances in electrocorticography. JF - Epilepsy Behav Y1 - 2010 A1 - A L Ritaccio A1 - Peter Brunner A1 - Cervenka, Mackenzie C A1 - Nathan E. Crone A1 - Guger, C A1 - Leuthardt, E C A1 - Oostenveld, Robert A1 - Stacey, William A1 - Gerwin Schalk KW - Brain KW - Brain Mapping KW - Diagnosis, Computer-Assisted KW - Electroencephalography KW - Humans KW - International Cooperation KW - Seizures KW - Signal Detection, Psychological AB -

In October 2009, a group of neurologists, neurosurgeons, computational neuroscientists, and engineers congregated to present novel developments transforming human electrocorticography (ECoG) beyond its established relevance in clinical epileptology. The contents of the proceedings advanced the role of ECoG in seizure detection and prediction, neurobehavioral research, functional mapping, and brain-computer interface technology. The meeting established the foundation for future work on the methodology and application of surface brain recordings.

VL - 19 UR - http://www.ncbi.nlm.nih.gov/pubmed/20889384 IS - 3 ER - TY - JOUR T1 - Evolution of brain-computer interfaces: going beyond classic motor physiology. JF - Neurosurg Focus Y1 - 2009 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Roland, Jarod A1 - Rouse, Adam A1 - Moran, D KW - Brain KW - Cerebral Cortex KW - Humans KW - Man-Machine Systems KW - Motor Cortex KW - Movement KW - Movement Disorders KW - Neuronal Plasticity KW - Prostheses and Implants KW - Research KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB -

The notion that a computer can decode brain signals to infer the intentions of a human and then enact those intentions directly through a machine is becoming a realistic technical possibility. These types of devices are known as brain-computer interfaces (BCIs). The evolution of these neuroprosthetic technologies could have significant implications for patients with motor disabilities by enhancing their ability to interact and communicate with their environment. The cortical physiology most investigated and used for device control has been brain signals from the primary motor cortex. To date, this classic motor physiology has been an effective substrate for demonstrating the potential efficacy of BCI-based control. However, emerging research now stands to further enhance our understanding of the cortical physiology underpinning human intent and provide further signals for more complex brain-derived control. In this review, the authors report the current status of BCIs and detail the emerging research trends that stand to augment clinical applications in the future.

VL - 27 UR - http://www.ncbi.nlm.nih.gov/pubmed/19569892 IS - 1 ER - TY - JOUR T1 - Microscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces. JF - Neurosurg Focus Y1 - 2009 A1 - Leuthardt, E C A1 - Zachary V. Freudenberg A1 - Bundy, David T A1 - Roland, Jarod KW - brain-computer interface KW - Electrocorticography KW - Motor Cortex AB -

OBJECT: 

There is a growing interest in the use of recording from the surface of the brain, known as electrocorticography (ECoG), as a practical signal platform for brain-computer interface application. The signal has a combination of high signal quality and long-term stability that may be the ideal intermediate modality for future application. The research paradigm for studying ECoG signals uses patients requiring invasive monitoring for seizure localization. The implanted arrays span cortex areas on the order of centimeters. Currently, it is unknown what level of motor information can be discerned from small regions of human cortex with microscale ECoG recording.

METHODS: 

In this study, a patient requiring invasive monitoring for seizure localization underwent concurrent implantation with a 16-microwire array (1-mm electrode spacing) placed over primary motor cortex. Microscale activity was recorded while the patient performed simple contra- and ipsilateral wrist movements that were monitored in parallel with electromyography. Using various statistical methods, linear and nonlinear relationships between these microcortical changes and recorded electromyography activity were defined.

RESULTS: 

Small regions of primary motor cortex (< 5 mm) carry sufficient information to separate multiple aspects of motor movements (that is, wrist flexion/extension and ipsilateral/contralateral movements).

CONCLUSIONS: 

These findings support the conclusion that small regions of cortex investigated by ECoG recording may provide sufficient information about motor intentions to support brain-computer interface operations in the future. Given the small scale of the cortical region required, the requisite implanted array would be minimally invasive in terms of surgical placement of the electrode array.

VL - 27 UR - http://dx.doi.org/10.3171/2009.4.FOCUS0980 IS - 1 ER - TY - JOUR T1 - A practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans. JF - Epilepsy Behav Y1 - 2009 A1 - Peter Brunner A1 - A L Ritaccio A1 - Lynch, Timothy M A1 - Emrich, Joseph F A1 - Adam J Wilson A1 - Williams, Justin C A1 - Aarnoutse, Erik J A1 - Ramsey, Nick F A1 - Leuthardt, E C A1 - H Bischof A1 - Gerwin Schalk KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Electric Stimulation KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Middle Aged KW - Practice Guidelines as Topic KW - Signal Processing, Computer-Assisted KW - Young Adult AB -

Functional mapping of eloquent cortex is often necessary prior to invasive brain surgery, but current techniques that derive this mapping have important limitations. In this article, we demonstrate the first comprehensive evaluation of a rapid, robust, and practical mapping system that uses passive recordings of electrocorticographic signals. This mapping procedure is based on the BCI2000 and SIGFRIED technologies that we have been developing over the past several years. In our study, we evaluated 10 patients with epilepsy from four different institutions and compared the results of our procedure with the results derived using electrical cortical stimulation (ECS) mapping. The results show that our procedure derives a functional motor cortical map in only a few minutes. They also show a substantial concurrence with the results derived using ECS mapping. Specifically, compared with ECS maps, a next-neighbor evaluation showed no false negatives, and only 0.46 and 1.10% false positives for hand and tongue maps, respectively. In summary, we demonstrate the first comprehensive evaluation of a practical and robust mapping procedure that could become a new tool for planning of invasive brain surgeries.

VL - 15 UR - http://www.ncbi.nlm.nih.gov/pubmed/19366638 IS - 3 ER - TY - CHAP T1 - General Clinical Issues Relevant to Brain-Computer Interfaces. T2 - Neuroengineering Y1 - 2008 A1 - Leuthardt, E C A1 - Ojemann, J G A1 - Gerwin Schalk A1 - Moran, D ED - Daniel DiLorenzo JF - Neuroengineering PB - Taylor and Francis Group CY - Boca Raton ER - TY - JOUR T1 - Real-time detection of event-related brain activity. JF - Neuroimage Y1 - 2008 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Peter Brunner A1 - Ojemann, J G A1 - Lester A Gerhardt A1 - Jonathan Wolpaw KW - Adult KW - Algorithms KW - Brain Mapping KW - Computer Systems KW - Diagnosis, Computer-Assisted KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Female KW - Humans KW - Male KW - Pattern Recognition, Automated KW - Reproducibility of Results KW - Sensitivity and Specificity AB -

The complexity and inter-individual variation of brain signals impedes real-time detection of events in raw signals. To convert these complex signals into results that can be readily understood, current approaches usually apply statistical methods to data from known conditions after all data have been collected. The capability to provide meaningful visualization of complex brain signals without the requirement to initially collect data from all conditions would provide a new tool, essentially a new imaging technique, that would open up new avenues for the study of brain function. Here we show that a new analysis approach, called SIGFRIED, can overcome this serious limitation of current methods. SIGFRIED can visualize brain signal changes without requiring prior data collection from all conditions. This capacity is particularly well suited to applications in which comprehensive prior data collection is impossible or impractical, such as intraoperative localization of cortical function or detection of epileptic seizures.

VL - 43 UR - http://www.ncbi.nlm.nih.gov/pubmed/18718544 IS - 2 ER - TY - JOUR T1 - Two-dimensional movement control using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2008 A1 - Gerwin Schalk A1 - Miller, K.J. A1 - Nicholas R Anderson A1 - Adam J Wilson A1 - Smyth, Matt A1 - Ojemann, J G A1 - Moran, D A1 - Jonathan Wolpaw A1 - Leuthardt, E C KW - Adolescent KW - Adult KW - Brain Mapping KW - Data Interpretation, Statistical KW - Drug Resistance KW - Electrocardiography KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Movement KW - User-Computer Interface AB -

We show here that a brain-computer interface (BCI) using electrocorticographic activity (ECoG) and imagined or overt motor tasks enables humans to control a computer cursor in two dimensions. Over a brief training period of 12-36 min, each of five human subjects acquired substantial control of particular ECoG features recorded from several locations over the same hemisphere, and achieved average success rates of 53-73% in a two-dimensional four-target center-out task in which chance accuracy was 25%. Our results support the expectation that ECoG-based BCIs can combine high performance with technical and clinical practicality, and also indicate promising directions for further research.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/18310813 IS - 1 ER - TY - JOUR T1 - Unique cortical physiology associated with ipsilateral hand movements and neuroprosthetic implications. JF - Stroke Y1 - 2008 A1 - Wisneski, Kimberly A1 - Nicholas R Anderson A1 - Gerwin Schalk A1 - Smyth, Matt A1 - Moran, D A1 - Leuthardt, E C KW - Adolescent KW - Adult KW - Artificial Limbs KW - Bionics KW - Brain Mapping KW - Child KW - Dominance, Cerebral KW - Electroencephalography KW - Female KW - Hand KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement KW - Paresis KW - Prosthesis Design KW - Psychomotor Performance KW - Stroke KW - User-Computer Interface KW - Volition AB -

BACKGROUND AND PURPOSE: 

Brain computer interfaces (BCIs) offer little direct benefit to patients with hemispheric stroke because current platforms rely on signals derived from the contralateral motor cortex (the same region injured by the stroke). For BCIs to assist hemiparetic patients, the implant must use unaffected cortex ipsilateral to the affected limb. This requires the identification of distinct electrophysiological features from the motor cortex associated with ipsilateral hand movements.

METHODS: 

In this study we studied 6 patients undergoing temporary placement of intracranial electrode arrays. Electrocorticographic (ECoG) signals were recorded while the subjects engaged in specific ipsilateral or contralateral hand motor tasks. Spectral changes were identified with regards to frequency, location, and timing.

RESULTS: 

Ipsilateral hand movements were associated with electrophysiological changes that occur in lower frequency spectra, at distinct anatomic locations, and earlier than changes associated with contralateral hand movements. In a subset of 3 patients, features specific to ipsilateral and contralateral hand movements were used to control a cursor on a screen in real time. In ipsilateral derived control this was optimal with lower frequency spectra.

CONCLUSIONS: 

There are distinctive cortical electrophysiological features associated with ipsilateral movements which can be used for device control. These findings have implications for patients with hemispheric stroke because they offer a potential methodology for which a single hemisphere can be used to enhance the function of a stroke induced hemiparesis.

VL - 39 UR - http://www.ncbi.nlm.nih.gov/pubmed/18927456 IS - 12 ER - TY - JOUR T1 - Decoding two-dimensional movement trajectories using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2007 A1 - Gerwin Schalk A1 - Kubánek, J A1 - Miller, John W A1 - Nicholas R Anderson A1 - Leuthardt, E C A1 - Ojemann, J G A1 - Limbrick, D A1 - Moran, D A1 - Lester A Gerhardt A1 - Jonathan Wolpaw KW - Adult KW - Algorithms KW - Arm KW - Brain Mapping KW - Cerebral Cortex KW - Electroencephalography KW - Evoked Potentials, Motor KW - Female KW - Humans KW - Male KW - Movement AB -

Signals from the brain could provide a non-muscular communication and control system, a brain-computer interface (BCI), for people who are severely paralyzed. A common BCI research strategy begins by decoding kinematic parameters from brain signals recorded during actual arm movement. It has been assumed that these parameters can be derived accurately only from signals recorded by intracortical microelectrodes, but the long-term stability of such electrodes is uncertain. The present study disproves this widespread assumption by showing in humans that kinematic parameters can also be decoded from signals recorded by subdural electrodes on the cortical surface (ECoG) with an accuracy comparable to that achieved in monkey studies using intracortical microelectrodes. A new ECoG feature labeled the local motor potential (LMP) provided the most information about movement. Furthermore, features displayed cosine tuning that has previously been described only for signals recorded within the brain. These results suggest that ECoG could be a more stable and less invasive alternative to intracortical electrodes for BCI systems, and could also prove useful in studies of motor function.

VL - 4 UR - http://www.ncbi.nlm.nih.gov/pubmed/17873429 IS - 3 ER - TY - JOUR T1 - Electrocorticographic Frequency Alteration Mapping: A Clinical Technique for Mapping the Motor Cortex. JF - Neurosurgery Y1 - 2007 A1 - Leuthardt, E C A1 - Miller, John W A1 - Nicholas R Anderson A1 - Gerwin Schalk A1 - Dowling, Joshua A1 - Miller, John W A1 - Moran, D A1 - Ojemann, J G KW - Adult KW - Biological Clocks KW - Brain Mapping KW - Electric Stimulation KW - Electrodes, Implanted KW - Electroencephalography KW - Female KW - Hand KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Oscillometry KW - Signal Processing, Computer-Assisted KW - Tongue AB -

OBJECTIVE: 

Electrocortical stimulation (ECS) has been well established for delineating the eloquent cortex. However, ECS is still coarse and inefficient in delineating regions of the functional cortex and can be hampered by after-discharges. Given these constraints, an adjunct approach to defining the motor cortex is the use of electrocorticographic signal changes associated with active regions of the cortex. The broad range of frequency oscillations are categorized into two main groups with respect to the sensorimotor cortex: low and high frequency bands. The low frequency bands tend to show a power reduction with cortical activation, whereas the high frequency bands show power increases. These power changes associated with the activated cortex could potentially provide a powerful tool in delineating areas of the motor cortex. We explore electrocorticographic signal alterations as they occur with activated regions of the motor cortex, as well as its potential in clinical brain mapping applications.

METHODS: 

We evaluated seven patients who underwent invasive monitoring for seizure localization. Each patient had extraoperative ECS mapping to identify the motor cortex. All patients also performed overt hand and tongue motor tasks to identify associated frequency power changes in regard to location and degree of concordance with ECS results that localized either hand or tongue motor function.

RESULTS: 

The low frequency bands had a high sensitivity (88.9-100%) and a lower specificity (79.0-82.6%) for identifying electrodes with either hand or tongue ECS motor responses. The high frequency bands had a lower sensitivity (72.7-88.9%) and a higher specificity (92.4-94.9%) in correlation with the same respective ECS positive electrodes.

CONCLUSION: 

The concordance between stimulation and spectral power changes demonstrate the possible utility of electrocorticographic frequency alteration mapping as an adjunct method to improve the efficiency and resolution of identifying the motor cortex.

VL - 60 UR - http://www.ncbi.nlm.nih.gov/pubmed/17415162 IS - 4 Suppl 2 ER - TY - JOUR T1 - Spectral Changes in Cortical Surface Potentials During Motor Movement. JF - J Neurosci Y1 - 2007 A1 - Miller, John W A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Rao, Rajesh P N A1 - Nicholas R Anderson A1 - Moran, D A1 - Miller, John W A1 - Ojemann, J G KW - Adult KW - Brain Mapping KW - Female KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement AB -

In the first large study of its kind, we quantified changes in electrocorticographic signals associated with motor movement across 22 subjects with subdural electrode arrays placed for identification of seizure foci. Patients underwent a 5-7 d monitoring period with array placement, before seizure focus resection, and during this time they participated in the study. An interval-based motor-repetition task produced consistent and quantifiable spectral shifts that were mapped on a Talairach-standardized template cortex. Maps were created independently for a high-frequency band (HFB) (76-100 Hz) and a low-frequency band (LFB) (8-32 Hz) for several different movement modalities in each subject. The power in relevant electrodes consistently decreased in the LFB with movement, whereas the power in the HFB consistently increased. In addition, the HFB changes were more focal than the LFB changes. Sites of power changes corresponded to stereotactic locations in sensorimotor cortex and to the results of individual clinical electrical cortical mapping. Sensorimotor representation was found to be somatotopic, localized in stereotactic space to rolandic cortex, and typically followed the classic homunculus with limited extrarolandic representation.

VL - 27 UR - http://www.ncbi.nlm.nih.gov/pubmed/17329441 IS - 9 ER - TY - JOUR T1 - Electrocorticography-based brain computer interface--the Seattle experience. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Leuthardt, E C A1 - Miller, John W A1 - Gerwin Schalk A1 - Rao, Rajesh P N A1 - Ojemann, J G KW - Cerebral Cortex KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Humans KW - Therapy, Computer-Assisted KW - User-Computer Interface KW - Washington AB -

Electrocorticography (ECoG) has been demonstrated to be an effective modality as a platform for brain-computer interfaces (BCIs). Through our experience with ten subjects, we further demonstrate evidence to support the power and flexibility of this signal for BCI usage. In a subset of four patients, closed-loop BCI experiments were attempted with the patient receiving online feedback that consisted of one-dimensional cursor movement controlled by ECoG features that had shown correlation with various real and imagined motor and speech tasks. All four achieved control, with final target accuracies between 73%-100%. We assess the methods for achieving control and the manner in which enhancing online control can be accomplished by rescreening during online tasks. Additionally, we assess the relevant issues of the current experimental paradigm in light of their clinical constraints.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792292 IS - 2 ER - TY - JOUR T1 - The emerging world of motor neuroprosthetics: a neurosurgical perspective. JF - Neurosurgery Y1 - 2006 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Moran, D A1 - Ojemann, J G KW - Brain KW - Humans KW - Man-Machine Systems KW - Movement KW - Neurosurgery KW - Prostheses and Implants KW - User-Computer Interface AB -

A MOTOR NEUROPROSTHETIC device, or brain computer interface, is a machine that can take some type of signal from the brain and convert that information into overt device control such that it reflects the intentions of the user's brain. In essence, these constructs can decode the electrophysiological signals representing motor intent. With the parallel evolution of neuroscience, engineering, and rapid computing, the era of clinical neuroprosthetics is approaching as a practical reality for people with severe motor impairment. Patients with such diseases as spinal cord injury, stroke, limb loss, and neuromuscular disorders may benefit through the implantation of these brain computer interfaces that serve to augment their ability to communicate and interact with their environment. In the upcoming years, it will be important for the neurosurgeon to understand what a brain computer interface is, its fundamental principle of operation, and what the salient surgical issues are when considering implantation. We review the current state of the field of motor neuroprosthetics research, the early clinical applications, and the essential considerations from a neurosurgical perspective for the future.

VL - 59 UR - http://www.ncbi.nlm.nih.gov/pubmed/16823294 IS - 1 ER - TY - CONF T1 - Towards two-dimensional cursor control using electrocorticographic signals. T2 - Proceedings to the 11th International Conference on Human-Computer Interaction Y1 - 2005 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, D A1 - Miller, K.J. A1 - Ojemann, J G A1 - Jonathan Wolpaw JF - Proceedings to the 11th International Conference on Human-Computer Interaction ER - TY - Generic T1 - Towards two-dimensional cursor control using electrocorticographic signals T2 - Proceedings to the 11th International Conference on Human-Computer Interaction Y1 - 2005 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, D A1 - Miller, K.J. A1 - Ojemann, J G A1 - Jonathan Wolpaw JF - Proceedings to the 11th International Conference on Human-Computer Interaction ER - TY - JOUR T1 - A brain-computer interface using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2004 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Ojemann, J G A1 - Moran, D KW - Adult KW - Brain KW - Communication Aids for Disabled KW - Computer Peripherals KW - Diagnosis, Computer-Assisted KW - Electrodes, Implanted KW - Electroencephalography KW - Evoked Potentials KW - Female KW - Humans KW - Imagination KW - Male KW - Movement Disorders KW - User-Computer Interface AB -

Brain-computer interfaces (BCIs) enable users to control devices with electroencephalographic (EEG) activity from the scalp or with single-neuron activity from within the brain. Both methods have disadvantages: EEG has limited resolution and requires extensive training, while single-neuron recording entails significant clinical risks and has limited stability. We demonstrate here for the first time that electrocorticographic (ECoG) activity recorded from the surface of the brain can enable users to control a one-dimensional computer cursor rapidly and accurately. We first identified ECoG signals that were associated with different types of motor and speech imagery. Over brief training periods of 3-24 min, four patients then used these signals to master closed-loop control and to achieve success rates of 74-100% in a one-dimensional binary task. In additional open-loop experiments, we found that ECoG signals at frequencies up to 180 Hz encoded substantial information about the direction of two-dimensional joystick movements. Our results suggest that an ECoG-based BCI could provide for people with severe motor disabilities a non-muscular communication and control option that is more powerful than EEG-based BCIs and is potentially more stable and less traumatic than BCIs that use electrodes penetrating the brain.

VL - 1 UR - http://www.ncbi.nlm.nih.gov/pubmed/15876624 IS - 2 ER -