01823nas a2200253 4500008004100000022001400041245009200055210006900147260001200216300001200228490000700240520106200247653002101309653003201330653002901362100002001391700001901411700001601430700001901446700001801465700001901483700001901502856004801521 2012 eng d a1095-957200aDecoding covert spatial attention using electrocorticographic (ECoG) signals in humans.0 aDecoding covert spatial attention using electrocorticographic EC c05/2012 a2285-930 v603 a
This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.
10acovert attention10aelectrocorticography (ECoG)10avisual spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2236633302208nas a2200265 4500008004100000022001400041245006800055210006500123260001200188300000900200490000800209520143000217653001501647653003001662653001801692653002501710653001701735653003601752100002601788700002101814700001901835700001901854700002101873856004801894 2012 eng d a1432-110600aElectrocorticographic (ECoG) Correlates of Human Arm Movements.0 aElectrocorticographic ECoG Correlates of Human Arm Movements c11/2012 a1-100 v2233 aInvasive and non-invasive brain-computer interface (BCI) studies have long focused on the motor cortex for kinematic control of artificial devices. Most of these studies have used single-neuron recordings or electroencephalography (EEG). Electrocorticography (ECoG) is a relatively new recording modality in BCI research that has primarily been built on successes in EEG recordings. We built on prior experiments related to single-neuron recording and quantitatively compare the extent to which different brain regions reflect kinematic tuning parameters of hand speed, direction, and velocity in both a reaching and tracing task in humans. Hand and arm movement experiments using ECoG have shown positive results before, but the tasks were not designed to tease out which kinematics are encoded. In non-human primates, the relationships among these kinematics have been more carefully documented, and we sought to begin elucidating that relationship in humans using ECoG. The largest modulation in ECoG activity for direction, speed, and velocity representation was found in the primary motor cortex. We also found consistent cosine tuning across both tasks, to hand direction and velocity in the high gamma band (70-160 Hz). Thus, the results of this study clarify the neural substrates involved in encoding aspects of motor preparation and execution and confirm the important role of the motor cortex in BCI applications.10aarm tuning10abrain-computer interfaces10acosine tuning10aElectrocorticography10aMotor Cortex10asubdural electroencephalography1 aAnderson, Nicholas, R1 aBlakely, Timothy1 aSchalk, Gerwin1 aLeuthardt, E C1 aMoran, Daniel, W uhttp://www.ncbi.nlm.nih.gov/pubmed/2300136902945nas a2200289 4500008004100000022001400041245010600055210006900161260001200230300000700242490000600249520210500255653001102360653002502371653001802396653001002414653001102424100001902435700001802454700002402472700002202496700001802518700002902536700002302565700001902588856004802607 2012 eng d a1662-516100aTemporal evolution of gamma activity in human cortex during an overt and covert word repetition task.0 aTemporal evolution of gamma activity in human cortex during an o c05/2012 a990 v63 aSeveral scientists have proposed different models for cortical processing of speech. Classically, the regions participating in language were thought to be modular with a linear sequence of activations. More recently, modern theoretical models have posited a more hierarchical and distributed interaction of anatomic areas for the various stages of speech processing. Traditional imaging techniques can only define the location or time of cortical activation, which impedes the further evaluation and refinement of these models. In this study, we take advantage of recordings from the surface of the brain [electrocorticography (ECoG)], which can accurately detect the location and timing of cortical activations, to study the time course of ECoG high gamma (HG) modulations during an overt and covert word repetition task for different cortical areas. For overt word production, our results show substantial perisylvian cortical activations early in the perceptual phase of the task that were maintained through word articulation. However, this broad activation is attenuated during the expressive phase of covert word repetition. Across the different repetition tasks, the utilization of the different cortical sites within the perisylvian region varied in the degree of activation dependent on which stimulus was provided (auditoryor visual cue) and whether the word was to be spoken or imagined. Taken together, the data support current models of speech that have been previously described with functional imaging. Moreover, this study demonstrates that the broad perisylvian speech network activates early and maintains suprathreshold activation throughout the word repetition task that appears to be modulated by the demands of different conditions.
10acortex10aElectrocorticography10agamma rhythms10ahuman10aSpeech1 aLeuthardt, E C1 aPei, Xiao-Mei1 aBreshears, Jonathan1 aGaona, Charles, M1 aSharma, Mohit1 aFreudenberg, Zachary, V.1 aBarbour, Dennis, L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2256331102258nas a2200193 4500008004100000022001400041245006700055210006500122260001200187300001100199490000600210520166100216653003501877653003401912653003201946100001901978700001901997856004802016 2011 eng d a1941-118900aBrain-computer interfaces using electrocorticographic signals.0 aBraincomputer interfaces using electrocorticographic signals c10/2011 a140-540 v43 aMany studies over the past two decades have shown that people and animals can use brain signals to convey their intent to a computer using brain-computer interfaces (BCIs). BCI systems measure specific features of brain activity and translate them into control signals that drive an output. The sensor modalities that have most commonly been used in BCI studies have been electroencephalographic (EEG) recordings from the scalp and single-neuron recordings from within the cortex. Over the past decade, an increasing number of studies has explored the use of electrocorticographic (ECoG) activity recorded directly from the surface of the brain. ECoG has attracted substantial and increasing interest, because it has been shown to reflect specific details of actual and imagined actions, and because its technical characteristics should readily support robust and chronic implementations of BCI systems in humans. This review provides general perspectives on the ECoG platform; describes the different electrophysiological features that can be detected in ECoG; elaborates on the signal acquisition issues, protocols, and online performance of ECoG-based BCI studies to date; presents important limitations of current ECoG studies; discusses opportunities for further research; and finally presents a vision for eventual clinical implementation. In summary, the studies presented to date strongly encourage further research using the ECoG platform for basic neuroscientific research, as well as for translational neuroprosthetic applications.
10aBrain-computer interface (BCI)10abrain-machine interface (BMI)10aelectrocorticography (ECoG)1 aSchalk, Gerwin1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/2227379602268nas a2200409 4500008004100000022001400041245011100055210006900166260001200235300001100247490000600258520108700264653001501351653001001366653001001376653001801386653002001404653003601424653003701460653003201497653002601529653002701555653001301582653001101595653002601606653001101632653000901643653001601652653001301668653002201681653002801703100001801731700002301749700001901772700001901791856004801810 2011 eng d a1741-255200aDecoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans.0 aDecoding vowels and consonants in spoken and imagined words usin c08/2011 a0460280 v83 aSeveral stories in the popular media have speculated that it may be possible to infer from the brain which word a person is speaking or even thinking. While recent studies have demonstrated that brain signals can give detailed information about actual and imagined actions, such as different types of limb movements or spoken words, concrete experimental evidence for the possibility to 'read the mind', i.e. to interpret internally-generated speech, has been scarce. In this study, we found that it is possible to use signals recorded from the surface of the brain (electrocorticography) to discriminate the vowels and consonants embedded in spoken and in imagined words, and we defined the cortical areas that held the most information about discrimination of vowels and consonants. The results shed light on the distinct mechanisms associated with production of vowels and consonants, and could provide the basis for brain-based communication using imagined speech.
10aAdolescent10aAdult10aBrain10aBrain Mapping10aCerebral Cortex10aCommunication Aids for Disabled10aData Interpretation, Statistical10aDiscrimination (Psychology)10aElectrodes, Implanted10aElectroencephalography10aEpilepsy10aFemale10aFunctional Laterality10aHumans10aMale10aMiddle Aged10aMovement10aSpeech Perception10aUser-Computer Interface1 aPei, Xiao-Mei1 aBarbour, Dennis, L1 aLeuthardt, E C1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2175036902535nas a2200277 4500008004100000022001400041245009300055210006900148260001200217300000700229490000600236520172900242653002101971653002501992653001402017653001902031653002902050100002002079700001902099700001602118700001902134700001802153700001902171700001902190856004802209 2011 eng d a1662-516100aNeural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans.0 aNeural Correlates of Covert Attention in Electrocorticographic E c09/2011 a890 v53 aAttention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.
10acovert attention10aElectrocorticography10aintention10amotor response10avisual-spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2204615303596nas a2200505 4500008004100000022001400041245010700055210006900162260001200231300001300243490000700256520217800263653002502441653001502466653001002481653002502491653001802516653001602534653002002550653002402570653002702594653001302621653002202634653001102656653001102667653000902678653001602687653002902703653002302732653002302755653001802778653002202796653001702818653001502835100002202850700001802872700002902890700002402919700002002943700001802963700002302981700001903004700001903023856004803042 2011 eng d a1529-240100aNonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex.0 aNonuniform highgamma 60500 Hz power changes dissociate cognitive c02/2011 a2091-1000 v313 aHigh-gamma-band (>60 Hz) power changes in cortical electrophysiology are a reliable indicator of focal, event-related cortical activity. Despite discoveries of oscillatory subthreshold and synchronous suprathreshold activity at the cellular level, there is an increasingly popular view that high-gamma-band amplitude changes recorded from cellular ensembles are the result of asynchronous firing activity that yields wideband and uniform power increases. Others have demonstrated independence of power changes in the low- and high-gamma bands, but to date, no studies have shown evidence of any such independence above 60 Hz. Based on nonuniformities in time-frequency analyses of electrocorticographic (ECoG) signals, we hypothesized that induced high-gamma-band (60-500 Hz) power changes are more heterogeneous than currently understood. Using single-word repetition tasks in six human subjects, we showed that functional responsiveness of different ECoG high-gamma sub-bands can discriminate cognitive task (e.g., hearing, reading, speaking) and cortical locations. Power changes in these sub-bands of the high-gamma range are consistently present within single trials and have statistically different time courses within the trial structure. Moreover, when consolidated across all subjects within three task-relevant anatomic regions (sensorimotor, Broca's area, and superior temporal gyrus), these behavior- and location-dependent power changes evidenced nonuniform trends across the population. Together, the independence and nonuniformity of power changes across a broad range of frequencies suggest that a new approach to evaluating high-gamma-band cortical activity is necessary. These findings show that in addition to time and location, frequency is another fundamental dimension of high-gamma dynamics.
10aAcoustic Stimulation10aAdolescent10aAdult10aAnalysis of Variance10aBrain Mapping10aBrain Waves10aCerebral Cortex10aCognition Disorders10aElectroencephalography10aEpilepsy10aEvoked Potentials10aFemale10aHumans10aMale10aMiddle Aged10aNeuropsychological Tests10aNonlinear Dynamics10aPhotic Stimulation10aReaction Time10aSpectrum Analysis10aTime Factors10aVocabulary1 aGaona, Charles, M1 aSharma, Mohit1 aFreudenberg, Zachary, V.1 aBreshears, Jonathan1 aBundy, David, T1 aRoland, Jarod1 aBarbour, Dennis, L1 aSchalk, Gerwin1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/2130724603279nas a2200337 4500008004100000022001400041245011400055210006900169260001200238300001200250490000700262520231800269653001502587653001002602653001002612653001802622653002702640653001102667653001102678653000902689653001602698653004102714653002002755100001802775700001902793700002202812700001902834700002102853700001902874856004802893 2011 eng d a1095-957200aSpatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition.0 aSpatiotemporal dynamics of electrocorticographic high gamma acti c02/2011 a2960-720 v543 aLanguage is one of the defining abilities of humans. Many studies have characterized the neural correlates of different aspects of language processing. However, the imaging techniques typically used in these studies were limited in either their temporal or spatial resolution. Electrocorticographic (ECoG) recordings from the surface of the brain combine high spatial with high temporal resolution and thus could be a valuable tool for the study of neural correlates of language function. In this study, we defined the spatiotemporal dynamics of ECoG activity during a word repetition task in nine human subjects. ECoG was recorded while each subject overtly or covertly repeated words that were presented either visually or auditorily. ECoG amplitudes in the high gamma (HG) band confidently tracked neural changes associated with stimulus presentation and with the subject's verbal response. Overt word production was primarily associated with HG changes in the superior and middle parts of temporal lobe, Wernicke's area, the supramarginal gyrus, Broca's area, premotor cortex (PMC), primary motor cortex. Covert word production was primarily associated with HG changes in superior temporal lobe and the supramarginal gyrus. Acoustic processing from both auditory stimuli as well as the subject's own voice resulted in HG power changes in superior temporal lobe and Wernicke's area. In summary, this study represents a comprehensive characterization of overt and covert speech using electrophysiological imaging with high spatial and temporal resolution. It thereby complements the findings of previous neuroimaging studies of language and thus further adds to current understanding of word processing in humans.
10aAdolescent10aAdult10aBrain10aBrain Mapping10aElectroencephalography10aFemale10aHumans10aMale10aMiddle Aged10aSignal Processing, Computer-Assisted10aVerbal Behavior1 aPei, Xiao-Mei1 aLeuthardt, E C1 aGaona, Charles, M1 aBrunner, Peter1 aWolpaw, Jonathan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2102978403803nas a2200433 4500008004100000022001400041024002500055245010000080210006900180260001200249300001100261490000600272520257600278653001002854653001002864653001802874653002502892653002702917653002202944653002802966653001102994653001103005653001603016653000903032653001603041653001403057653003403071653002803105100001903133700002203152700001803174700002103192700001803213700002903231700001803260700002403278700001903302856004803321 2011 eng d a1741-2552 aNIHMSID: NIHMS48176700aUsing the electrocorticographic speech network to control a brain-computer interface in humans.0 aUsing the electrocorticographic speech network to control a brai c06/2011 a0360040 v83 aElectrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.
10aAdult10aBrain10aBrain Mapping10aComputer Peripherals10aElectroencephalography10aEvoked Potentials10aFeedback, Physiological10aFemale10aHumans10aImagination10aMale10aMiddle Aged10aNerve Net10aSpeech Production Measurement10aUser-Computer Interface1 aLeuthardt, E C1 aGaona, Charles, M1 aSharma, Mohit1 aSzrama, Nicholas1 aRoland, Jarod1 aFreudenberg, Zachary, V.1 aSolisb, Jamie1 aBreshears, Jonathan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2147163804454nas a2200433 4500008004100000022001400041245010500055210006900160260001200229300001100241490000700252520325900259653002503518653001503543653001003558653001803568653002003586653002803606653002703634653001303661653001103674653001103685653000903696653002203705653001603727653002303743653001103766653002003777653001603797100001603813700002303829700001903852700001803871700001803889700002403907700002203931700001903953856004803972 2010 eng d a1524-404000aElectrocorticographic frequency alteration mapping for extraoperative localization of speech cortex.0 aElectrocorticographic frequency alteration mapping for extraoper c02/2010 aE407-90 v663 aElectrocortical stimulation (ECS) has long been established for delineating eloquent cortex in extraoperative mapping. However, ECS is still coarse and inefficient in delineating regions of functional cortex and can be hampered by afterdischarges. Given these constraints, an adjunct approach to defining motor cortex is the use of electrocorticographic (ECoG) signal changes associated with active regions of cortex. The broad range of frequency oscillations are categorized into 2 main groups with respect to sensorimotor cortex: low-frequency bands (LFBs) and high-frequency bands (HFBs). The LFBs tend to show a power reduction, whereas the HFBs show power increases with cortical activation. These power changes associated with activated cortex could potentially provide a powerful tool in delineating areas of speech cortex. We explore ECoG signal alterations as they occur with activated region of speech cortex and its potential in clinical brain mapping applications.
We evaluated 7 patients who underwent invasive monitoring for seizure localization. Each had extraoperative ECS mapping to identify speech cortex. Additionally, all subjects performed overt speech tasks with an auditory or a visual cue to identify associated frequency power changes in regard to location and degree of concordance with ECS results.
Electrocorticographic frequency alteration mapping (EFAM) had an 83.9% sensitivity and a 40.4% specificity in identifying any language site when considering both frequency bands and both stimulus cues. Electrocorticographic frequency alteration mapping was more sensitive in identifying the Wernicke area (100%) than the Broca area (72.2%). The HFB is uniquely suited to identifying the Wernicke area, whereas a combination of the HFB and LFB is important for Broca localization.
The concordance between stimulation and spectral power changes demonstrates the possible utility of EFAM as an adjunct method to improve the efficiency and resolution of identifying speech cortex.
10aAcoustic Stimulation10aAdolescent10aAdult10aBrain Mapping10aCerebral Cortex10aChi-Square Distribution10aElectroencephalography10aEpilepsy10aFemale10aHumans10aMale10aMass Spectrometry10aMiddle Aged10aPhotic Stimulation10aSpeech10aVerbal Behavior10aYoung Adult1 aWu, Melinda1 aWisneski, Kimberly1 aSchalk, Gerwin1 aSharma, Mohit1 aRoland, Jarod1 aBreshears, Jonathan1 aGaona, Charles, M1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/2008711103481nas a2200289 4500008004100000022001400041245009200055210006900147260001200216300001000228490000700238520264000245653001802885653002002903653002002923653001502943653002502958653002702983653001103010653002703021100001803048700001903066700002003085700001903105700001903124856004803143 2010 eng d a1525-506900aPassive real-time identification of speech and motor cortex during an awake craniotomy.0 aPassive realtime identification of speech and motor cortex durin c05/2010 a123-80 v183 aPrecise localization of eloquent cortex is a clinical necessity prior to surgical resections adjacent to speech or motor cortex. In the intraoperative setting, this traditionally requires inducing temporary lesions by direct electrocortical stimulation (DECS). In an attempt to increase efficiency and potentially reduce the amount of necessary stimulation, we used a passive mapping procedure in the setting of an awake craniotomy for tumor in two patients resection. We recorded electrocorticographic (ECoG) signals from exposed cortex while patients performed simple cue-directed motor and speech tasks. SIGFRIED, a procedure for real-time event detection, was used to identify areas of cortical activation by detecting task-related modulations in the ECoG high gamma band. SIGFRIED's real-time output quickly localized motor and speech areas of cortex similar to those identified by DECS. In conclusion, real-time passive identification of cortical function using SIGFRIED may serve as a useful adjunct to cortical stimulation mapping in the intraoperative setting.
10aBrain Mapping10aBrain Neoplasms10aCerebral Cortex10aCraniotomy10aElectric Stimulation10aElectroencephalography10aHumans10aNeurologic Examination1 aRoland, Jarod1 aBrunner, Peter1 aJohnston, James1 aSchalk, Gerwin1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/2047874501656nas a2200337 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520066900243653001000912653001800922653003300940653002700973653001101000653003001011653001301041653003601054100001801090700001901108700002701127700002201154700001301176700001901189700002301208700002001231700001901251856004801270 2010 eng d a1525-506900aProceedings of the first international workshop on advances in electrocorticography.0 aProceedings of the first international workshop on advances in e c10/2010 a204-150 v193 aIn October 2009, a group of neurologists, neurosurgeons, computational neuroscientists, and engineers congregated to present novel developments transforming human electrocorticography (ECoG) beyond its established relevance in clinical epileptology. The contents of the proceedings advanced the role of ECoG in seizure detection and prediction, neurobehavioral research, functional mapping, and brain-computer interface technology. The meeting established the foundation for future work on the methodology and application of surface brain recordings.
10aBrain10aBrain Mapping10aDiagnosis, Computer-Assisted10aElectroencephalography10aHumans10aInternational Cooperation10aSeizures10aSignal Detection, Psychological1 aRitaccio, A L1 aBrunner, Peter1 aCervenka, Mackenzie, C1 aCrone, Nathan, E.1 aGuger, C1 aLeuthardt, E C1 aOostenveld, Robert1 aStacey, William1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2088938402156nas a2200337 4500008004100000022001400041245008300055210006900138260001200207300000700219490000700226520120000233653001001433653002001443653001101463653002401474653001701498653001301515653002301528653002401551653002801575653001301603653004101616653002801657100001901685700001901704700001801723700001601741700001301757856004801770 2009 eng d a1092-068400aEvolution of brain-computer interfaces: going beyond classic motor physiology.0 aEvolution of braincomputer interfaces going beyond classic motor c07/2009 aE40 v273 aThe notion that a computer can decode brain signals to infer the intentions of a human and then enact those intentions directly through a machine is becoming a realistic technical possibility. These types of devices are known as brain-computer interfaces (BCIs). The evolution of these neuroprosthetic technologies could have significant implications for patients with motor disabilities by enhancing their ability to interact and communicate with their environment. The cortical physiology most investigated and used for device control has been brain signals from the primary motor cortex. To date, this classic motor physiology has been an effective substrate for demonstrating the potential efficacy of BCI-based control. However, emerging research now stands to further enhance our understanding of the cortical physiology underpinning human intent and provide further signals for more complex brain-derived control. In this review, the authors report the current status of BCIs and detail the emerging research trends that stand to augment clinical applications in the future.
10aBrain10aCerebral Cortex10aHumans10aMan-Machine Systems10aMotor Cortex10aMovement10aMovement Disorders10aNeuronal Plasticity10aProstheses and Implants10aResearch10aSignal Processing, Computer-Assisted10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aRoland, Jarod1 aRouse, Adam1 aMoran, D uhttp://www.ncbi.nlm.nih.gov/pubmed/1956989203691nas a2200193 4500008004100000245013500041210006900176260001200245490000700257520302900264653002903293653002503322653001703347100001903364700002903383700002003412700001803432856004703450 2009 eng d00aMicroscale recording from human motor cortex: implications for minimally invasive electrocorticographic brain-computer interfaces.0 aMicroscale recording from human motor cortex implications for mi c07/20090 v273 aThere is a growing interest in the use of recording from the surface of the brain, known as electrocorticography (ECoG), as a practical signal platform for brain-computer interface application. The signal has a combination of high signal quality and long-term stability that may be the ideal intermediate modality for future application. The research paradigm for studying ECoG signals uses patients requiring invasive monitoring for seizure localization. The implanted arrays span cortex areas on the order of centimeters. Currently, it is unknown what level of motor information can be discerned from small regions of human cortex with microscale ECoG recording.
In this study, a patient requiring invasive monitoring for seizure localization underwent concurrent implantation with a 16-microwire array (1-mm electrode spacing) placed over primary motor cortex. Microscale activity was recorded while the patient performed simple contra- and ipsilateral wrist movements that were monitored in parallel with electromyography. Using various statistical methods, linear and nonlinear relationships between these microcortical changes and recorded electromyography activity were defined.
Small regions of primary motor cortex (< 5 mm) carry sufficient information to separate multiple aspects of motor movements (that is, wrist flexion/extension and ipsilateral/contralateral movements).
These findings support the conclusion that small regions of cortex investigated by ECoG recording may provide sufficient information about motor intentions to support brain-computer interface operations in the future. Given the small scale of the cortical region required, the requisite implanted array would be minimally invasive in terms of surgical placement of the electrode array.
10abrain-computer interface10aElectrocorticography10aMotor Cortex1 aLeuthardt, E C1 aFreudenberg, Zachary, V.1 aBundy, David, T1 aRoland, Jarod uhttp://dx.doi.org/10.3171/2009.4.FOCUS098002591nas a2200433 4500008004100000022001400041245012500055210006900180260001200249300001100261490000700272520133300279653001001612653001801622653002001640653002501660653002601685653002701711653001301738653001101751653001101762653000901773653001601782653003301798653004101831653001601872100001901888700001801907700002201925700002201947700002001969700002401989700002302013700002002036700001902056700001502075700001902090856004802109 2009 eng d a1525-506900aA practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans.0 apractical procedure for realtime functional mapping of eloquent c07/2009 a278-860 v153 aFunctional mapping of eloquent cortex is often necessary prior to invasive brain surgery, but current techniques that derive this mapping have important limitations. In this article, we demonstrate the first comprehensive evaluation of a rapid, robust, and practical mapping system that uses passive recordings of electrocorticographic signals. This mapping procedure is based on the BCI2000 and SIGFRIED technologies that we have been developing over the past several years. In our study, we evaluated 10 patients with epilepsy from four different institutions and compared the results of our procedure with the results derived using electrical cortical stimulation (ECS) mapping. The results show that our procedure derives a functional motor cortical map in only a few minutes. They also show a substantial concurrence with the results derived using ECS mapping. Specifically, compared with ECS maps, a next-neighbor evaluation showed no false negatives, and only 0.46 and 1.10% false positives for hand and tongue maps, respectively. In summary, we demonstrate the first comprehensive evaluation of a practical and robust mapping procedure that could become a new tool for planning of invasive brain surgeries.
10aAdult10aBrain Mapping10aCerebral Cortex10aElectric Stimulation10aElectrodes, Implanted10aElectroencephalography10aEpilepsy10aFemale10aHumans10aMale10aMiddle Aged10aPractice Guidelines as Topic10aSignal Processing, Computer-Assisted10aYoung Adult1 aBrunner, Peter1 aRitaccio, A L1 aLynch, Timothy, M1 aEmrich, Joseph, F1 aWilson, Adam, J1 aWilliams, Justin, C1 aAarnoutse, Erik, J1 aRamsey, Nick, F1 aLeuthardt, E C1 aBischof, H1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/1936663800563nas a2200145 4500008004100000245006700041210006500108260004100173100001900214700001700233700001900250700001300269700002200282856011300304 2008 eng d00aGeneral Clinical Issues Relevant to Brain-Computer Interfaces.0 aGeneral Clinical Issues Relevant to BrainComputer Interfaces aBoca RatonbTaylor and Francis Group1 aLeuthardt, E C1 aOjemann, J G1 aSchalk, Gerwin1 aMoran, D1 aDiLorenzo, Daniel uhttps://www.neurotechcenter.org/publications/2008/general-clinical-issues-relevant-brain-computer-interfaces03145nas a2200373 4500008004100000022001400041245005700055210005400112260001200166300001000178490000700188520212100195653001002316653001502326653001802341653002102359653003302380653002702413653001302440653002202453653001102475653001102486653000902497653003502506653003102541653003202572100001902604700001902623700001902642700001702661700002402678700002102702856004802723 2008 eng d a1095-957200aReal-time detection of event-related brain activity.0 aRealtime detection of eventrelated brain activity c11/2008 a245-90 v433 aThe complexity and inter-individual variation of brain signals impedes real-time detection of events in raw signals. To convert these complex signals into results that can be readily understood, current approaches usually apply statistical methods to data from known conditions after all data have been collected. The capability to provide meaningful visualization of complex brain signals without the requirement to initially collect data from all conditions would provide a new tool, essentially a new imaging technique, that would open up new avenues for the study of brain function. Here we show that a new analysis approach, called SIGFRIED, can overcome this serious limitation of current methods. SIGFRIED can visualize brain signal changes without requiring prior data collection from all conditions. This capacity is particularly well suited to applications in which comprehensive prior data collection is impossible or impractical, such as intraoperative localization of cortical function or detection of epileptic seizures.
10aAdult10aAlgorithms10aBrain Mapping10aComputer Systems10aDiagnosis, Computer-Assisted10aElectroencephalography10aEpilepsy10aEvoked Potentials10aFemale10aHumans10aMale10aPattern Recognition, Automated10aReproducibility of Results10aSensitivity and Specificity1 aSchalk, Gerwin1 aLeuthardt, E C1 aBrunner, Peter1 aOjemann, J G1 aGerhardt, Lester, A1 aWolpaw, Jonathan uhttp://www.ncbi.nlm.nih.gov/pubmed/1871854402662nas a2200409 4500008004100000022001400041245008400055210006900139260001200208300001000220490000600230520153900236653001501775653001001790653001801800653003701818653002001855653002401875653002601899653002701925653001301952653001101965653001101976653000901987653001301996653002802009100001902037700001602056700002602072700002002098700001602118700001702134700001302151700002102164700001902185856004802204 2008 eng d a1741-256000aTwo-dimensional movement control using electrocorticographic signals in humans.0 aTwodimensional movement control using electrocorticographic sign c03/2008 a75-840 v53 aWe show here that a brain-computer interface (BCI) using electrocorticographic activity (ECoG) and imagined or overt motor tasks enables humans to control a computer cursor in two dimensions. Over a brief training period of 12-36 min, each of five human subjects acquired substantial control of particular ECoG features recorded from several locations over the same hemisphere, and achieved average success rates of 53-73% in a two-dimensional four-target center-out task in which chance accuracy was 25%. Our results support the expectation that ECoG-based BCIs can combine high performance with technical and clinical practicality, and also indicate promising directions for further research.
10aAdolescent10aAdult10aBrain Mapping10aData Interpretation, Statistical10aDrug Resistance10aElectrocardiography10aElectrodes, Implanted10aElectroencephalography10aEpilepsy10aFemale10aHumans10aMale10aMovement10aUser-Computer Interface1 aSchalk, Gerwin1 aMiller, K J1 aAnderson, Nicholas, R1 aWilson, Adam, J1 aSmyth, Matt1 aOjemann, J G1 aMoran, D1 aWolpaw, Jonathan1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/1831081304121nas a2200457 4500008004100000022001400041245010800055210006900163260001200232300001100244490000700255520290000262653001503162653001003177653002103187653001203208653001803220653001003238653002403248653002703272653001103299653000903310653001103319653000903330653001603339653001703355653001303372653001203385653002203397653002803419653001103447653002803458653001303486100002303499700002603522700001903548700001603567700001303583700001903596856004803615 2008 eng d a1524-462800aUnique cortical physiology associated with ipsilateral hand movements and neuroprosthetic implications.0 aUnique cortical physiology associated with ipsilateral hand move c12/2008 a3351-90 v393 aBrain computer interfaces (BCIs) offer little direct benefit to patients with hemispheric stroke because current platforms rely on signals derived from the contralateral motor cortex (the same region injured by the stroke). For BCIs to assist hemiparetic patients, the implant must use unaffected cortex ipsilateral to the affected limb. This requires the identification of distinct electrophysiological features from the motor cortex associated with ipsilateral hand movements.
In this study we studied 6 patients undergoing temporary placement of intracranial electrode arrays. Electrocorticographic (ECoG) signals were recorded while the subjects engaged in specific ipsilateral or contralateral hand motor tasks. Spectral changes were identified with regards to frequency, location, and timing.
Ipsilateral hand movements were associated with electrophysiological changes that occur in lower frequency spectra, at distinct anatomic locations, and earlier than changes associated with contralateral hand movements. In a subset of 3 patients, features specific to ipsilateral and contralateral hand movements were used to control a cursor on a screen in real time. In ipsilateral derived control this was optimal with lower frequency spectra.
There are distinctive cortical electrophysiological features associated with ipsilateral movements which can be used for device control. These findings have implications for patients with hemispheric stroke because they offer a potential methodology for which a single hemisphere can be used to enhance the function of a stroke induced hemiparesis.
10aAdolescent10aAdult10aArtificial Limbs10aBionics10aBrain Mapping10aChild10aDominance, Cerebral10aElectroencephalography10aFemale10aHand10aHumans10aMale10aMiddle Aged10aMotor Cortex10aMovement10aParesis10aProsthesis Design10aPsychomotor Performance10aStroke10aUser-Computer Interface10aVolition1 aWisneski, Kimberly1 aAnderson, Nicholas, R1 aSchalk, Gerwin1 aSmyth, Matt1 aMoran, D1 aLeuthardt, E C uhttp://www.ncbi.nlm.nih.gov/pubmed/1892745602357nas a2200385 4500008004100000022001400041245009800055210006900153260001200222300001100234490000600245520131000251653001001561653001501571653000801586653001801594653002001612653002701632653002901659653001101688653001101699653000901710653001301719100001901732700001601751700002001767700002601787700001901813700001701832700001601849700001301865700002401878700002101902856004801923 2007 eng d a1741-256000aDecoding two-dimensional movement trajectories using electrocorticographic signals in humans.0 aDecoding twodimensional movement trajectories using electrocorti c09/2007 a264-750 v43 aSignals from the brain could provide a non-muscular communication and control system, a brain-computer interface (BCI), for people who are severely paralyzed. A common BCI research strategy begins by decoding kinematic parameters from brain signals recorded during actual arm movement. It has been assumed that these parameters can be derived accurately only from signals recorded by intracortical microelectrodes, but the long-term stability of such electrodes is uncertain. The present study disproves this widespread assumption by showing in humans that kinematic parameters can also be decoded from signals recorded by subdural electrodes on the cortical surface (ECoG) with an accuracy comparable to that achieved in monkey studies using intracortical microelectrodes. A new ECoG feature labeled the local motor potential (LMP) provided the most information about movement. Furthermore, features displayed cosine tuning that has previously been described only for signals recorded within the brain. These results suggest that ECoG could be a more stable and less invasive alternative to intracortical electrodes for BCI systems, and could also prove useful in studies of motor function.
10aAdult10aAlgorithms10aArm10aBrain Mapping10aCerebral Cortex10aElectroencephalography10aEvoked Potentials, Motor10aFemale10aHumans10aMale10aMovement1 aSchalk, Gerwin1 aKubánek, J1 aMiller, John, W1 aAnderson, Nicholas, R1 aLeuthardt, E C1 aOjemann, J G1 aLimbrick, D1 aMoran, D1 aGerhardt, Lester, A1 aWolpaw, Jonathan uhttp://www.ncbi.nlm.nih.gov/pubmed/1787342904391nas a2200409 4500008004100000022001400041245010700055210006900162260001200231300002900243490000700272520323000279653001003509653002203519653001803541653002503559653002603584653002703610653001103637653000903648653001103657653000903668653001603677653001703693653001703710653004103727653001103768100001903779700002003798700002603818700001903844700002003863700002003883700001303903700001703916856004803933 2007 eng d a1524-404000aElectrocorticographic Frequency Alteration Mapping: A Clinical Technique for Mapping the Motor Cortex.0 aElectrocorticographic Frequency Alteration Mapping A Clinical Te c04/2007 a260-70; discussion 270-10 v603 aElectrocortical stimulation (ECS) has been well established for delineating the eloquent cortex. However, ECS is still coarse and inefficient in delineating regions of the functional cortex and can be hampered by after-discharges. Given these constraints, an adjunct approach to defining the motor cortex is the use of electrocorticographic signal changes associated with active regions of the cortex. The broad range of frequency oscillations are categorized into two main groups with respect to the sensorimotor cortex: low and high frequency bands. The low frequency bands tend to show a power reduction with cortical activation, whereas the high frequency bands show power increases. These power changes associated with the activated cortex could potentially provide a powerful tool in delineating areas of the motor cortex. We explore electrocorticographic signal alterations as they occur with activated regions of the motor cortex, as well as its potential in clinical brain mapping applications.
We evaluated seven patients who underwent invasive monitoring for seizure localization. Each patient had extraoperative ECS mapping to identify the motor cortex. All patients also performed overt hand and tongue motor tasks to identify associated frequency power changes in regard to location and degree of concordance with ECS results that localized either hand or tongue motor function.
The low frequency bands had a high sensitivity (88.9-100%) and a lower specificity (79.0-82.6%) for identifying electrodes with either hand or tongue ECS motor responses. The high frequency bands had a lower sensitivity (72.7-88.9%) and a higher specificity (92.4-94.9%) in correlation with the same respective ECS positive electrodes.
The concordance between stimulation and spectral power changes demonstrate the possible utility of electrocorticographic frequency alteration mapping as an adjunct method to improve the efficiency and resolution of identifying the motor cortex.
10aAdult10aBiological Clocks10aBrain Mapping10aElectric Stimulation10aElectrodes, Implanted10aElectroencephalography10aFemale10aHand10aHumans10aMale10aMiddle Aged10aMotor Cortex10aOscillometry10aSignal Processing, Computer-Assisted10aTongue1 aLeuthardt, E C1 aMiller, John, W1 aAnderson, Nicholas, R1 aSchalk, Gerwin1 aDowling, Joshua1 aMiller, John, W1 aMoran, D1 aOjemann, J G uhttp://www.ncbi.nlm.nih.gov/pubmed/1741516202238nas a2200325 4500008004100000022001400041245007500055210006900130260001200199300001200211490000700223520137400230653001001604653001801614653001101632653001101643653000901654653001601663653001701679653001301696100002001709700001901729700001901748700002101767700002601788700001301814700002001827700001701847856004801864 2007 eng d a1529-240100aSpectral Changes in Cortical Surface Potentials During Motor Movement.0 aSpectral Changes in Cortical Surface Potentials During Motor Mov c02/2007 a2424-320 v273 aIn the first large study of its kind, we quantified changes in electrocorticographic signals associated with motor movement across 22 subjects with subdural electrode arrays placed for identification of seizure foci. Patients underwent a 5-7 d monitoring period with array placement, before seizure focus resection, and during this time they participated in the study. An interval-based motor-repetition task produced consistent and quantifiable spectral shifts that were mapped on a Talairach-standardized template cortex. Maps were created independently for a high-frequency band (HFB) (76-100 Hz) and a low-frequency band (LFB) (8-32 Hz) for several different movement modalities in each subject. The power in relevant electrodes consistently decreased in the LFB with movement, whereas the power in the HFB consistently increased. In addition, the HFB changes were more focal than the LFB changes. Sites of power changes corresponded to stereotactic locations in sensorimotor cortex and to the results of individual clinical electrical cortical mapping. Sensorimotor representation was found to be somatotopic, localized in stereotactic space to rolandic cortex, and typically followed the classic homunculus with limited extrarolandic representation.
10aAdult10aBrain Mapping10aFemale10aHumans10aMale10aMiddle Aged10aMotor Cortex10aMovement1 aMiller, John, W1 aLeuthardt, E C1 aSchalk, Gerwin1 aRao, Rajesh, P N1 aAnderson, Nicholas, R1 aMoran, D1 aMiller, John, W1 aOjemann, J G uhttp://www.ncbi.nlm.nih.gov/pubmed/1732944101844nas a2200289 4500008004100000022001400041245008100055210006900136260001200205300001000217490000700227520100900234653002001243653002701263653001301290653002201303653001101325653003101336653002801367653001501395100001901410700002001429700001901449700002101468700001701489856004801506 2006 eng d a1534-432000aElectrocorticography-based brain computer interface--the Seattle experience.0 aElectrocorticographybased brain computer interfacethe Seattle ex c06/2006 a194-80 v143 aElectrocorticography (ECoG) has been demonstrated to be an effective modality as a platform for brain-computer interfaces (BCIs). Through our experience with ten subjects, we further demonstrate evidence to support the power and flexibility of this signal for BCI usage. In a subset of four patients, closed-loop BCI experiments were attempted with the patient receiving online feedback that consisted of one-dimensional cursor movement controlled by ECoG features that had shown correlation with various real and imagined motor and speech tasks. All four achieved control, with final target accuracies between 73%-100%. We assess the methods for achieving control and the manner in which enhancing online control can be accomplished by rescreening during online tasks. Additionally, we assess the relevant issues of the current experimental paradigm in light of their clinical constraints.
10aCerebral Cortex10aElectroencephalography10aEpilepsy10aEvoked Potentials10aHumans10aTherapy, Computer-Assisted10aUser-Computer Interface10aWashington1 aLeuthardt, E C1 aMiller, John, W1 aSchalk, Gerwin1 aRao, Rajesh, P N1 aOjemann, J G uhttp://www.ncbi.nlm.nih.gov/pubmed/1679229203287nas a2200265 4500008004100000022001400041245007900055210006900134260001200203300002600215490000700241520252600248653001002774653001102784653002402795653001302819653001702832653002802849653002802877100001902905700001902924700001302943700001702956856004802973 2006 eng d a1524-404000aThe emerging world of motor neuroprosthetics: a neurosurgical perspective.0 aemerging world of motor neuroprosthetics a neurosurgical perspec c07/2006 a1-14; discussion 1-140 v593 aA MOTOR NEUROPROSTHETIC device, or brain computer interface, is a machine that can take some type of signal from the brain and convert that information into overt device control such that it reflects the intentions of the user's brain. In essence, these constructs can decode the electrophysiological signals representing motor intent. With the parallel evolution of neuroscience, engineering, and rapid computing, the era of clinical neuroprosthetics is approaching as a practical reality for people with severe motor impairment. Patients with such diseases as spinal cord injury, stroke, limb loss, and neuromuscular disorders may benefit through the implantation of these brain computer interfaces that serve to augment their ability to communicate and interact with their environment. In the upcoming years, it will be important for the neurosurgeon to understand what a brain computer interface is, its fundamental principle of operation, and what the salient surgical issues are when considering implantation. We review the current state of the field of motor neuroprosthetics research, the early clinical applications, and the essential considerations from a neurosurgical perspective for the future.
10aBrain10aHumans10aMan-Machine Systems10aMovement10aNeurosurgery10aProstheses and Implants10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aMoran, D1 aOjemann, J G uhttp://www.ncbi.nlm.nih.gov/pubmed/1682329400585nas a2200157 4500008004100000245008000041210006900121260000900190100001900199700001900218700001300237700001600250700001700266700002100283856012300304 2005 eng d00aTowards two-dimensional cursor control using electrocorticographic signals.0 aTowards twodimensional cursor control using electrocorticographi c20051 aSchalk, Gerwin1 aLeuthardt, E C1 aMoran, D1 aMiller, K J1 aOjemann, J G1 aWolpaw, Jonathan uhttps://www.neurotechcenter.org/publications/2005/towards-two-dimensional-cursor-control-using-electrocorticographic-000561nas a2200145 4500008004100000245007900041210006900120100001900189700001900208700001300227700001600240700001700256700002100273856012100294 2005 eng d00aTowards two-dimensional cursor control using electrocorticographic signals0 aTowards twodimensional cursor control using electrocorticographi1 aSchalk, Gerwin1 aLeuthardt, E C1 aMoran, D1 aMiller, K J1 aOjemann, J G1 aWolpaw, Jonathan uhttps://www.neurotechcenter.org/publications/2005/towards-two-dimensional-cursor-control-using-electrocorticographic03554nas a2200361 4500008004100000022001400041245007800055210006900133260001200202300001000214490000600224520253800230653001002768653001002778653003602788653002502824653003302849653002602882653002702908653002202935653001102957653001102968653001602979653000902995653002303004653002803027100001903055700001903074700002103093700001703114700001303131856004803144 2004 eng d a1741-256000aA brain-computer interface using electrocorticographic signals in humans.0 abraincomputer interface using electrocorticographic signals in h c06/2004 a63-710 v13 aBrain-computer interfaces (BCIs) enable users to control devices with electroencephalographic (EEG) activity from the scalp or with single-neuron activity from within the brain. Both methods have disadvantages: EEG has limited resolution and requires extensive training, while single-neuron recording entails significant clinical risks and has limited stability. We demonstrate here for the first time that electrocorticographic (ECoG) activity recorded from the surface of the brain can enable users to control a one-dimensional computer cursor rapidly and accurately. We first identified ECoG signals that were associated with different types of motor and speech imagery. Over brief training periods of 3-24 min, four patients then used these signals to master closed-loop control and to achieve success rates of 74-100% in a one-dimensional binary task. In additional open-loop experiments, we found that ECoG signals at frequencies up to 180 Hz encoded substantial information about the direction of two-dimensional joystick movements. Our results suggest that an ECoG-based BCI could provide for people with severe motor disabilities a non-muscular communication and control option that is more powerful than EEG-based BCIs and is potentially more stable and less traumatic than BCIs that use electrodes penetrating the brain.
10aAdult10aBrain10aCommunication Aids for Disabled10aComputer Peripherals10aDiagnosis, Computer-Assisted10aElectrodes, Implanted10aElectroencephalography10aEvoked Potentials10aFemale10aHumans10aImagination10aMale10aMovement Disorders10aUser-Computer Interface1 aLeuthardt, E C1 aSchalk, Gerwin1 aWolpaw, Jonathan1 aOjemann, J G1 aMoran, D uhttp://www.ncbi.nlm.nih.gov/pubmed/15876624