TY - JOUR T1 - Contralesional Brain-Computer Interface Control of a Powered Exoskeleton for Motor Recovery in Chronic Stroke Survivors. JF - Stroke Y1 - 2017 A1 - Bundy, David T. A1 - Souders, Lauren A1 - Baranyai, Kelly A1 - Leonard, Laura A1 - Gerwin Schalk A1 - Coker, Robert A1 - Moran, Daniel W. A1 - Huskey, Thy A1 - Leuthardt, Eric C. AB - There are few effective therapies to achieve functional recovery from motor-related disabilities affecting the upper limb after stroke. This feasibility study tested whether a powered exoskeleton driven by a brain-computer interface (BCI), using neural activity from the unaffected cortical hemisphere, could affect motor recovery in chronic hemiparetic stroke survivors. This novel system was designed and configured for a home-based setting to test the feasibility of BCI-driven neurorehabilitation in outpatient environments. UR - http://www.ncbi.nlm.nih.gov/pubmed/28550098 ER - TY - JOUR T1 - Facephenes and rainbows: Causal evidence for functional and anatomical specificity of face and color processing in the human brain JF - Proc. Natl. Acad. Sci. U.S.A. Y1 - 2017 A1 - Gerwin Schalk A1 - Kapeller, C. A1 - Guger, C. A1 - Ogawa, H. A1 - Hiroshima, S. A1 - Lafer-Sousa, R. A1 - Saygin, Z. M. A1 - Kamada, K. A1 - Kanwisher, N. KW - cortical specificity; electrical stimulation; fusiform face area AB - Neuroscientists have long debated whether some regions of the human brain are exclusively engaged in a single specific mental process. Consistent with this view, fMRI has revealed cortical regions that respond selectively to certain stimulus classes such as faces. However, results from multivoxel pattern analyses (MVPA) challenge this view by demonstrating that category-selective regions often contain information about "nonpreferred" stimulus dimensions. But is this nonpreferred information causally relevant to behavior? Here we report a rare opportunity to test this question in a neurosurgical patient implanted for clinical reasons with strips of electrodes along his fusiform gyri. Broadband gamma electrocorticographic responses in multiple adjacent electrodes showed strong selectivity for faces in a region corresponding to the fusiform face area (FFA), and preferential responses to color in a nearby site, replicating earlier reports. To test the causal role of these regions in the perception of nonpreferred dimensions, we then electrically stimulated individual sites while the patient viewed various objects. When stimulated in the FFA, the patient reported seeing an illusory face (or "facephene"), independent of the object viewed. Similarly, stimulation of color-preferring sites produced illusory "rainbows." Crucially, the patient reported no change in the object viewed, apart from the facephenes and rainbows apparently superimposed on them. The functional and anatomical specificity of these effects indicate that some cortical regions are exclusively causally engaged in a single specific mental process, and prompt caution about the widespread assumption that any information scientists can decode from the brain is causally relevant to behavior. VL - 114 UR - http://www.pnas.org/content/114/46/12285 ER - TY - JOUR T1 - Spatiotemporal dynamics of word retrieval in speech production revealed by cortical high-frequency band activity. JF - Proceedings of the National Academy of Sciences of the United States of America Y1 - 2017 A1 - Riès, Stephanie K. A1 - Dhillon, Rummit K. A1 - Clarke, Alex A1 - King-Stephens, David A1 - Laxer, Kenneth D. A1 - Weber, Peter B. A1 - Kuperman, Rachel A. A1 - Auguste, Kurtis I. A1 - Peter Brunner A1 - Gerwin Schalk A1 - Lin, Jack J. A1 - Parvizi, Josef A1 - Crone, Nathan E. A1 - Dronkers, Nina F. A1 - Robert T. Knight AB - Word retrieval is core to language production and relies on complementary processes: the rapid activation of lexical and conceptual representations and word selection, which chooses the correct word among semantically related competitors. Lexical and conceptual activation is measured by semantic priming. In contrast, word selection is indexed by semantic interference and is hampered in semantically homogeneous (HOM) contexts. We examined the spatiotemporal dynamics of these complementary processes in a picture naming task with blocks of semantically heterogeneous (HET) or HOM stimuli. We used electrocorticography data obtained from frontal and temporal cortices, permitting detailed spatiotemporal analysis of word retrieval processes. A semantic interference effect was observed with naming latencies longer in HOM versus HET blocks. Cortical response strength as indexed by high-frequency band (HFB) activity (70-150 Hz) amplitude revealed effects linked to lexical-semantic activation and word selection observed in widespread regions of the cortical mantle. Depending on the subsecond timing and cortical region, HFB indexed semantic interference (i.e., more activity in HOM than HET blocks) or semantic priming effects (i.e., more activity in HET than HOM blocks). These effects overlapped in time and space in the left posterior inferior temporal gyrus and the left prefrontal cortex. The data do not support a modular view of word retrieval in speech production but rather support substantial overlap of lexical-semantic activation and word selection mechanisms in the brain. UR - http://www.ncbi.nlm.nih.gov/pubmed/28533406 ER - TY - JOUR T1 - Alpha power indexes task-related networks on large and small scales: A multimodal ECoG study in humans and a non-human primate. JF - NeuroImage Y1 - 2016 A1 - de Pesters, A. A1 - Coon, W. G. A1 - Peter Brunner A1 - Gunduz, A. A1 - A L Ritaccio A1 - Brunet, N. M. A1 - de Weerd, P. A1 - Roberts, M. J. A1 - Oostenveld, R. A1 - Fries, P. A1 - Gerwin Schalk AB - Performing different tasks, such as generating motor movements or processing sensory input, requires the recruitment of specific networks of neuronal populations. Previous studies suggested that power variations in the alpha band (8-12Hz) may implement such recruitment of task-specific populations by increasing cortical excitability in task-related areas while inhibiting population-level cortical activity in task-unrelated areas (Klimesch et al., 2007; Jensen and Mazaheri, 2010). However, the precise temporal and spatial relationships between the modulatory function implemented by alpha oscillations and population-level cortical activity remained undefined. Furthermore, while several studies suggested that alpha power indexes task-related populations across large and spatially separated cortical areas, it was largely unclear whether alpha power also differentially indexes smaller networks of task-related neuronal populations. Here we addressed these questions by investigating the temporal and spatial relationships of electrocorticographic (ECoG) power modulations in the alpha band and in the broadband gamma range (70-170Hz, indexing population-level activity) during auditory and motor tasks in five human subjects and one macaque monkey. In line with previous research, our results confirm that broadband gamma power accurately tracks task-related behavior and that alpha power decreases in task-related areas. More importantly, they demonstrate that alpha power suppression lags population-level activity in auditory areas during the auditory task, but precedes it in motor areas during the motor task. This suppression of alpha power in task-related areas was accompanied by an increase in areas not related to the task. In addition, we show for the first time that these differential modulations of alpha power could be observed not only across widely distributed systems (e.g., motor vs. auditory system), but also within the auditory system. Specifically, alpha power was suppressed in the locations within the auditory system that most robustly responded to particular sound stimuli. Altogether, our results provide experimental evidence for a mechanism that preferentially recruits task-related neuronal populations by increasing cortical excitability in task-related cortical areas and decreasing cortical excitability in task-unrelated areas. This mechanism is implemented by variations in alpha power and is common to humans and the non-human primate under study. These results contribute to an increasingly refined understanding of the mechanisms underlying the selection of the specific neuronal populations required for task execution. VL - 134 UR - http://www.ncbi.nlm.nih.gov/pubmed/27057960 ER - TY - JOUR T1 - Electrocorticographic mapping of expressive language function without requiring the patient to speak: A report of three cases. JF - Epilepsy & behavior case reports Y1 - 2016 A1 - de Pesters, Adriana A1 - Taplin, AmiLyn M. A1 - Adamo, Matthew A. A1 - A L Ritaccio A1 - Gerwin Schalk AB - Patients requiring resective brain surgery often undergo functional brain mapping during perioperative planning to localize expressive language areas. Currently, all established protocols to perform such mapping require substantial time and patient participation during verb generation or similar tasks. These issues can make language mapping impractical in certain clinical circumstances (e.g., during awake craniotomies) or with certain populations (e.g., pediatric patients). Thus, it is important to develop new techniques that reduce mapping time and the requirement for active patient participation. Several neuroscientific studies reported that the mere auditory presentation of speech stimuli can engage not only receptive but also expressive language areas. Here, we tested the hypothesis that submission of electrocorticographic (ECoG) recordings during a short speech listening task to an appropriate analysis procedure can identify eloquent expressive language cortex without requiring the patient to speak. VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/27408803 ER - TY - JOUR T1 - Intraoperative mapping of expressive language cortex using passive real-time electrocorticography. JF - Epilepsy & behavior case reports Y1 - 2016 A1 - Taplin, AmiLyn M. A1 - de Pesters, Adriana A1 - Peter Brunner A1 - Hermes, Dora A1 - Dalfino, John C. A1 - Adamo, Matthew A. A1 - A L Ritaccio A1 - Gerwin Schalk AB - In this case report, we investigated the utility and practicality of passive intraoperative functional mapping of expressive language cortex using high-resolution electrocorticography (ECoG). The patient presented here experienced new-onset seizures caused by a medium-grade tumor in very close proximity to expressive language regions. In preparation of tumor resection, the patient underwent multiple functional language mapping procedures. We examined the relationship of results obtained with intraoperative high-resolution ECoG, extraoperative ECoG utilizing a conventional subdural grid, extraoperative electrical cortical stimulation (ECS) mapping, and functional magnetic resonance imaging (fMRI). Our results demonstrate that intraoperative mapping using high-resolution ECoG is feasible and, within minutes, produces results that are qualitatively concordant to those achieved by extraoperative mapping modalities. They also suggest that functional language mapping of expressive language areas with ECoG may prove useful in many intraoperative conditions given its time efficiency and safety. Finally, they demonstrate that integration of results from multiple functional mapping techniques, both intraoperative and extraoperative, may serve to improve the confidence in or precision of functional localization when pathology encroaches upon eloquent language cortex. VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/27408802 ER - TY - JOUR T1 - A method to establish the spatiotemporal evolution of task-related cortical activity from electrocorticographic signals in single trials. JF - Journal of neuroscience methods Y1 - 2016 A1 - Coon, W. G. A1 - Gerwin Schalk AB - Progress in neuroscience depends substantially on the ability to establish the detailed spatial and temporal sequence of neuronal population-level activity across large areas of the brain. Because there is substantial inter-trial variability in neuronal activity, traditional techniques that rely on signal averaging obscure where and when neuronal activity occurs. Thus, up to the present, it has been difficult to examine the detailed progression of neuronal activity across large areas of the brain. VL - 271 UR - http://www.ncbi.nlm.nih.gov/pubmed/27427301 ER - TY - JOUR T1 - Neural correlate of the construction of sentence meaning. JF - Proceedings of the National Academy of Sciences of the United States of America Y1 - 2016 A1 - Fedorenko, Evelina A1 - Scott, Terri L. A1 - Peter Brunner A1 - Coon, William G. A1 - Pritchett, Brianna A1 - Gerwin Schalk A1 - Kanwisher, Nancy AB - The neural processes that underlie your ability to read and understand this sentence are unknown. Sentence comprehension occurs very rapidly, and can only be understood at a mechanistic level by discovering the precise sequence of underlying computational and neural events. However, we have no continuous and online neural measure of sentence processing with high spatial and temporal resolution. Here we report just such a measure: intracranial recordings from the surface of the human brain show that neural activity, indexed by $\gamma$-power, increases monotonically over the course of a sentence as people read it. This steady increase in activity is absent when people read and remember nonword-lists, despite the higher cognitive demand entailed, ruling out accounts in terms of generic attention, working memory, and cognitive load. Response increases are lower for sentence structure without meaning (``Jabberwocky'' sentences) and word meaning without sentence structure (word-lists), showing that this effect is not explained by responses to syntax or word meaning alone. Instead, the full effect is found only for sentences, implicating compositional processes of sentence understanding, a striking and unique feature of human language not shared with animal communication systems. This work opens up new avenues for investigating the sequence of neural events that underlie the construction of linguistic meaning. VL - 113 UR - http://www.ncbi.nlm.nih.gov/pubmed/27671642 ER - TY - JOUR T1 - Oscillatory phase modulates the timing of neuronal activations and resulting behavior. JF - NeuroImage Y1 - 2016 A1 - Coon, W. G. A1 - Gunduz, A. A1 - Peter Brunner A1 - A L Ritaccio A1 - Pesaran, B. A1 - Gerwin Schalk AB - Human behavioral response timing is highly variable from trial to trial. While it is generally understood that behavioral variability must be due to trial-by-trial variations in brain function, it is still largely unknown which physiological mechanisms govern the timing of neural activity as it travels through networks of neuronal populations, and how variations in the timing of neural activity relate to variations in the timing of behavior. In our study, we submitted recordings from the cortical surface to novel analytic techniques to chart the trajectory of neuronal population activity across the human cortex in single trials, and found joint modulation of the timing of this activity and of consequent behavior by neuronal oscillations in the alpha band (8-12Hz). Specifically, we established that the onset of population activity tends to occur during the trough of oscillatory activity, and that deviations from this preferred relationship are related to changes in the timing of population activity and the speed of the resulting behavioral response. These results indicate that neuronal activity incurs variable delays as it propagates across neuronal populations, and that the duration of each delay is a function of the instantaneous phase of oscillatory activity. We conclude that the results presented in this paper are supportive of a general model for variability in the effective speed of information transmission in the human brain and for variability in the timing of human behavior. VL - 133 UR - http://www.ncbi.nlm.nih.gov/pubmed/26975551 ER - TY - JOUR T1 - Proceedings of the Eighth International Workshop on Advances in Electrocorticography. JF - Epilepsy & behavior : E&B Y1 - 2016 A1 - A L Ritaccio A1 - Williams, Justin A1 - Denison, Tim A1 - Foster, Brett L. A1 - Starr, Philip A. A1 - Gunduz, Aysegul A1 - Zijlmans, Maeike A1 - Gerwin Schalk AB - Excerpted proceedings of the Eighth International Workshop on Advances in Electrocorticography (ECoG), which convened October 15-16, 2015 in Chicago, IL, are presented. The workshop series has become the foremost gathering to present current basic and clinical research in subdural brain signal recording and analysis. VL - 64 UR - http://www.ncbi.nlm.nih.gov/pubmed/27780085 ER - TY - JOUR T1 - Spatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task. JF - PloS one Y1 - 2016 A1 - Brumberg, Jonathan S. A1 - Krusienski, Dean J. A1 - Chakrabarti, Shreya A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - A L Ritaccio A1 - Gerwin Schalk AB - How the human brain plans, executes, and monitors continuous and fluent speech has remained largely elusive. For example, previous research has defined the cortical locations most important for different aspects of speech function, but has not yet yielded a definition of the temporal progression of involvement of those locations as speech progresses either overtly or covertly. In this paper, we uncovered the spatio-temporal evolution of neuronal population-level activity related to continuous overt speech, and identified those locations that shared activity characteristics across overt and covert speech. Specifically, we asked subjects to repeat continuous sentences aloud or silently while we recorded electrical signals directly from the surface of the brain (electrocorticography (ECoG)). We then determined the relationship between cortical activity and speech output across different areas of cortex and at sub-second timescales. The results highlight a spatio-temporal progression of cortical involvement in the continuous speech process that initiates utterances in frontal-motor areas and ends with the monitoring of auditory feedback in superior temporal gyrus. Direct comparison of cortical activity related to overt versus covert conditions revealed a common network of brain regions involved in speech that may implement orthographic and phonological processing. Our results provide one of the first characterizations of the spatiotemporal electrophysiological representations of the continuous speech process, and also highlight the common neural substrate of overt and covert speech. These results thereby contribute to a refined understanding of speech functions in the human brain. VL - 11 UR - http://www.ncbi.nlm.nih.gov/pubmed/27875590 ER - TY - JOUR T1 - Spontaneous Decoding of the Timing and Content of Human Object Perception from Cortical Surface Recordings Reveals Complementary Information in the Event-Related Potential and Broadband Spectral Change. JF - PLoS computational biology Y1 - 2016 A1 - Miller, Kai J. A1 - Gerwin Schalk A1 - Hermes, Dora A1 - Ojemann, Jeffrey G. A1 - Rao, Rajesh P. N. KW - Visual Perception AB - The link between object perception and neural activity in visual cortical areas is a problem of fundamental importance in neuroscience. Here we show that electrical potentials from the ventral temporal cortical surface in humans contain sufficient information for spontaneous and near-instantaneous identification of a subject's perceptual state. Electrocorticographic (ECoG) arrays were placed on the subtemporal cortical surface of seven epilepsy patients. Grayscale images of faces and houses were displayed rapidly in random sequence. We developed a template projection approach to decode the continuous ECoG data stream spontaneously, predicting the occurrence, timing and type of visual stimulus. In this setting, we evaluated the independent and joint use of two well-studied features of brain signals, broadband changes in the frequency power spectrum of the potential and deflections in the raw potential trace (event-related potential; ERP). Our ability to predict both the timing of stimulus onset and the type of image was best when we used a combination of both the broadband response and ERP, suggesting that they capture different and complementary aspects of the subject's perceptual state. Specifically, we were able to predict the timing and type of 96% of all stimuli, with less than 5% false positive rate and a {\textasciitilde}20ms error in timing. VL - 12 UR - http://www.ncbi.nlm.nih.gov/pubmed/26820899 ER - TY - JOUR T1 - Word pair classification during imagined speech using direct brain recordings. JF - Scientific reports Y1 - 2016 A1 - Martin, Stéphanie A1 - Peter Brunner A1 - Iturrate, Iñaki A1 - Millán, José Del R. A1 - Gerwin Schalk A1 - Robert T. Knight A1 - Pasley, Brian N. AB - People that cannot communicate due to neurological disorders would benefit from an internal speech decoder. Here, we showed the ability to classify individual words during imagined speech from electrocorticographic signals. In a word imagery task, we used high gamma (70-150þinspaceHz) time features with a support vector machine model to classify individual words from a pair of words. To account for temporal irregularities during speech production, we introduced a non-linear time alignment into the SVM kernel. Classification accuracy reached 88% in a two-class classification framework (50% chance level), and average classification accuracy across fifteen word-pairs was significant across five subjects (meanþinspace=þinspace58%; pþinspace<þinspace0.05). We also compared classification accuracy between imagined speech, overt speech and listening. As predicted, higher classification accuracy was obtained in the listening and overt speech conditions (meanþinspace=þinspace89% and 86%, respectively; pþinspace<þinspace0.0001), where speech stimuli were directly presented. The results provide evidence for a neural representation for imagined words in the temporal lobe, frontal lobe and sensorimotor cortex, consistent with previous findings in speech perception and production. These data represent a proof of concept study for basic decoding of speech imagery, and delineate a number of key challenges to usage of speech imagery neural representations for clinical applications. VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/27165452 ER - TY - JOUR T1 - Brain-to-text: Decoding spoken sentences from phone representations in the brain. JF - Journal of Neural Engineering Y1 - 2015 A1 - Herff, C. A1 - Heger, D. A1 - Pesters, Adriana de A1 - Telaar, D. A1 - Peter Brunner A1 - Gerwin Schalk A1 - Schultz, T. KW - automatic speech recognition KW - brain-computer interface KW - broadband gamma KW - ECoG KW - Electrocorticography KW - pattern recognition KW - speech decoding KW - speech production AB - It has long been speculated whether communication between humans and machines based on natural speech related cortical activity is possible. Over the past decade, studies have suggested that it is feasible to recognize isolated aspects of speech from neural signals, such as auditory features, phones or one of a few isolated words. However, until now it remained an unsolved challenge to decode continuously spoken speech from the neural substrate associated with speech and language processing. Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings.Specifically, we implemented a system, which we call Brain-To-Text that models single phones, employs techniques from automatic speech recognition (ASR), and thereby transforms brain activity while speaking into the corresponding textual representation. Our results demonstrate that our system can achieve word error rates as low as 25% and phone error rates below 50%. Additionally, our approach contributes to the current understanding of the neural basis of continuous speech production by identifying those cortical regions that hold substantial information about individual phones. In conclusion, the Brain-To- Text system described in this paper represents an important step toward human-machine communication based on imagined speech. UR - http://journal.frontiersin.org/article/10.3389/fnins.2015.00217/abstract ER - TY - JOUR T1 - Cortical alpha activity predicts the confidence in an impending action. JF - Front. Neurosci Y1 - 2015 A1 - Kubánek, J A1 - Jeremy Jeremy Hill A1 - Snyder, Lawrence H. A1 - Gerwin Schalk KW - certainty KW - EEG KW - human KW - neural correlates KW - perceptual decision-making AB - When we make a decision, we experience a degree of confidence that our choice may lead to a desirable outcome. Recent studies in animals have probed the subjective aspects of the choice confidence using confidence-reporting tasks. These studies showed that estimates of the choice confidence substantially modulate neural activity in multiple regions of the brain. Building on these findings, we investigated the neural representation of the confidence in a choice in humans who explicitly reported the confidence in their choice. Subjects performed a perceptual decision task in which they decided between choosing a button press or a saccade while we recorded EEG activity. Following each choice, subjects indicated whether they were sure or unsure about the choice. We found that alpha activity strongly encodes a subject's confidence level in a forthcoming button press choice. The neural effect of the subjects' confidence was independent of the reaction time and independent of the sensory input modeled as a decision variable. Furthermore, the effect is not due to a general cognitive state, such as reward expectation, because the effect was specifically observed during button press choices and not during saccade choices. The neural effect of the confidence in the ensuing button press choice was strong enough that we could predict, from independent single trial neural signals, whether a subject was going to be sure or unsure of an ensuing button press choice. In sum, alpha activity in human cortex provides a window into the commitment to make a hand movement. UR - http://journal.frontiersin.org/article/10.3389/fnins.2015.00243/abstract ER - TY - JOUR T1 - The effects of spatial filtering and artifacts on electrocorticographic signals. JF - Journal of neural engineering Y1 - 2015 A1 - Liu, Y. A1 - Coon, W. G. A1 - de Pesters, A. A1 - Peter Brunner A1 - Gerwin Schalk KW - Young Adult AB - Electrocorticographic (ECoG) signals contain noise that is common to all channels and noise that is specific to individual channels. Most published ECoG studies use common average reference (CAR) spatial filters to remove common noise, but CAR filters may introduce channel-specific noise into other channels. To address this concern, scientists often remove artifactual channels prior to data analysis. However, removing these channels depends on expert-based labeling and may also discard useful data. Thus, the effects of spatial filtering and artifacts on ECoG signals have been largely unknown. This study aims to quantify these effects and thereby address this gap in knowledge. VL - 12 UR - http://www.ncbi.nlm.nih.gov/pubmed/26268446 ER - TY - JOUR T1 - Electrocorticographic representations of segmental features in continuous speech. JF - Front Hum Neurosci Y1 - 2015 A1 - Lotte, Fabien A1 - Jonathan S Brumberg A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - A L Ritaccio A1 - Guan, Cuntai A1 - Gerwin Schalk KW - electrocorticography (ECoG) KW - manner of articulation KW - place of articulation KW - speech processing KW - voicing AB - Acoustic speech output results from coordinated articulation of dozens of muscles, bones and cartilages of the vocal mechanism. While we commonly take the fluency and speed of our speech productions for granted, the neural mechanisms facilitating the requisite muscular control are not completely understood. Previous neuroimaging and electrophysiology studies of speech sensorimotor control has typically concentrated on speech sounds (i.e., phonemes, syllables and words) in isolation; sentence-length investigations have largely been used to inform coincident linguistic processing. In this study, we examined the neural representations of segmental features (place and manner of articulation, and voicing status) in the context of fluent, continuous speech production. We used recordings from the cortical surface [electrocorticography (ECoG)] to simultaneously evaluate the spatial topography and temporal dynamics of the neural correlates of speech articulation that may mediate the generation of hypothesized gestural or articulatory scores. We found that the representation of place of articulation involved broad networks of brain regions during all phases of speech production: preparation, execution and monitoring. In contrast, manner of articulation and voicing status were dominated by auditory cortical responses after speech had been initiated. These results provide a new insight into the articulatory and auditory processes underlying speech production in terms of their motor requirements and acoustic correlates. VL - 9 UR - http://www.ncbi.nlm.nih.gov/pubmed/25759647 ER - TY - JOUR T1 - A general framework for dynamic cortical function: the function-through-biased-oscillations (FBO) hypothesis. JF - Front. Hum. Neurosci. Y1 - 2015 A1 - Gerwin Schalk KW - communication-through-coherence KW - gating-by-inhibition KW - information routing KW - oscillations KW - oscillatory modulation AB - A central goal of neuroscience is to determine how the brain’s relatively static anatomy can support dynamic cortical function, i.e., cortical function that varies according to task demands. In pursuit of this goal, scientists have produced a large number of experimental results and established influential conceptual frameworks, in particular communication-through-coherence (CTC) and gating-by-inhibition (GBI), but these data and frameworks have not provided a parsimonious view of the principles that underlie cortical function. Here I synthesize these existing experimental results and the CTC and GBI frameworks, and propose the function-through-biased-oscillations (FBO) hypothesis as a model to understand dynamic cortical function. The FBO hypothesis suggests that oscillatory voltage amplitude is the principal measurement that directly reflects cortical excitability, that asymmetries in voltage amplitude explain a range of brain signal phenomena, and that predictive variations in such asymmetric oscillations provide a simple and general model for information routing that can help to explain dynamic cortical function. VL - 9 UR - http://journal.frontiersin.org/article/10.3389/fnhum.2015.00352/abstract IS - 352 ER - TY - JOUR T1 - Identifying the Attended Speaker Using Electrocorticographic (ECoG) Signals. JF - Journal of Neural Engineering Y1 - 2015 A1 - Dijkstra, K. A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - Coon, W.G. A1 - A L Ritaccio A1 - Farquhar, Jason A1 - Gerwin Schalk KW - auditory attention KW - Brain-computer interface (BCI) KW - Cocktail Party KW - electrocorticography (ECoG) AB - People affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control. Thus, they cannot use traditional assistive communication devices that depend on muscle control, or brain-computer interfaces (BCIs) that depend on the ability to control gaze. While auditory and tactile BCIs can provide communication to such individuals, their use typically entails an artificial mapping between the stimulus and the communication intent. This makes these BCIs difficult to learn and use. In this study, we investigated the use of selective auditory attention to natural speech as an avenue for BCI communication. In this approach, the user communicates by directing his/her attention to one of two simultaneously presented speakers. We used electrocorticographic (ECoG) signals in the gamma band (70–170 Hz) to infer the identity of attended speaker, thereby removing the need to learn such an artificial mapping. Our results from twelve human subjects show that a single cortical location over superior temporal gyrus or pre-motor cortex is typically sufficient to identify the attended speaker within 10 s and with 77% accuracy (50% accuracy due to chance). These results lay the groundwork for future studies that may determine the real-time performance of BCIs based on selective auditory attention to speech. UR - https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776341/ ER - TY - CHAP T1 - Near-Instantaneous Classification of Perceptual States from Cortical Surface Recordings T2 - Brain-Computer Interface Research: A State-of-the-Art Summary Y1 - 2015 A1 - Miller, Kai J A1 - Gerwin Schalk A1 - Hermes, Dora A1 - Ojemann, Jeffrey G A1 - Rao, Rajesh P N KW - broadband power KW - Electrocorticography KW - event-related potential KW - fusiform cortex KW - human vision AB - Human visual processing is of such complexity that, despite decades of focused research, many basic questions remain unanswered. Although we know that the inferotemporal cortex is a key region in object recognition, we don’t fully understand its physiologic role in brain function, nor do we have the full set of tools to explore this question. Here we show that electrical potentials from the surface of the human brain contain enough information to decode a subject’s perceptual state accurately, and with fine temporal precision. Electrocorticographic (ECoG) arrays were placed over the inferotemporal cortical areas of seven subjects. Pictures of faces and houses were quickly presented while each subject performed a simple visual task. Results showed that two well-known types of brain signals—event-averaged broadband power and event-averaged raw potential—can independently or together be used to classify the presented image. When applied to continuously recorded brain activity, our decoding technique could accurately predict whether each stimulus was a face, house, or neither, with  20 ms timing error. These results provide a roadmap for improved brain-computer interfacing tools to help neurosurgeons, research scientists, engineers, and, ultimately, patients. JF - Brain-Computer Interface Research: A State-of-the-Art Summary PB - Springer International Publishing CY - New York City, NY SN - 978-3-319-25188-2 UR - http://link.springer.com/chapter/10.1007/978-3-319-25190-5_10 ER - TY - JOUR T1 - NeuralAct: A Tool to Visualize Electrocortical (ECoG) Activity on a Three-Dimensional Model of the Cortex. JF - Neuroinformatics Y1 - 2015 A1 - Kubanek, Jan A1 - Gerwin Schalk KW - Brain KW - DOT KW - ECoG KW - EEG KW - imaging KW - Matlab KW - MEG AB -

Electrocorticography (ECoG) records neural signals directly from the surface of the cortex. Due to its high temporal and favorable spatial resolution, ECoG has emerged as a valuable new tool in acquiring cortical activity in cognitive and systems neuroscience. Many studies using ECoG visualized topographies of cortical activity or statistical tests on a three-dimensional model of the cortex, but a dedicated tool for this function has not yet been described. In this paper, we describe the NeuralAct package that serves this purpose. This package takes as input the 3D coordinates of the recording sensors, a cortical model in the same coordinate system (e.g., Talairach), and the activation data to be visualized at each sensor. It then aligns the sensor coordinates with the cortical model, convolves the activation data with a spatial kernel, and renders the resulting activations in color on the cortical model. The NeuralAct package can plot cortical activations of an individual subject as well as activations averaged over subjects. It is capable to render single images as well as sequences of images. The software runs under Matlab and is stable and robust. We here provide the tool and describe its visualization capabilities and procedures. The provided package contains thoroughly documented code and includes a simple demo that guides the researcher through the functionality of the tool.

VL - 13 UR - http://www.ncbi.nlm.nih.gov/pubmed/25381641 IS - 2 ER - TY - JOUR T1 - The Plurality of Human Brain-Computer Interfacing. JF - Proceedings of the IEEE Y1 - 2015 A1 - Mueller-Putz, G. A1 - Millán, José del R A1 - Gerwin Schalk A1 - Mueller, K.R. KW - Brain-computer interface (BCI) AB - The articles in this special issue focus on brain-computer interfacing. The papers are dedicated to this growing and diversifying research enterprise, and features important review articles as well as some important current examples of research in this area. The field of brain-computer interface (BCI) research began to develop about 25 years ago and transformed from initially isolated demonstrations by a few groups into a large scientific enterprise that is currently producing hundreds of peer-reviewed articles and several dedicated conferences and workshops each year. This level of productivity is reflective of the large and continually growing enthusiasm by the scientific community, funding agencies, and the public. UR - http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7115302 ER - TY - JOUR T1 - Proceedings of the Seventh International Workshop on Advances in Electrocorticography. JF - Epilepsy & behavior : E&B Y1 - 2015 A1 - A L Ritaccio A1 - Matsumoto, Riki A1 - Morrell, Martha A1 - Kamada, Kyousuke A1 - Koubeissi, Mohamad A1 - Poeppel, David A1 - Lachaux, Jean-Philippe A1 - Yanagisawa, Yakufumi A1 - Hirata, Masayuki A1 - Guger, Christoph A1 - Gerwin Schalk KW - Humans AB - The Seventh International Workshop on Advances in Electrocorticography (ECoG) convened in Washington, DC, on November 13-14, 2014. Electrocorticography-based research continues to proliferate widely across basic science and clinical disciplines. The 2014 workshop highlighted advances in neurolinguistics, brain-computer interface, functional mapping, and seizure termination facilitated by advances in the recording and analysis of the ECoG signal. The following proceedings document summarizes the content of this successful multidisciplinary gathering. VL - 51 UR - http://www.ncbi.nlm.nih.gov/pubmed/26322594 ER - TY - CHAP T1 - Towards an Auditory Attention BCI T2 - Brain-Computer Interface Research: A State-of-the-Art Summary Y1 - 2015 A1 - Peter Brunner A1 - Dijkstra, K. A1 - Coon, W.G. A1 - Mellinger, Jürgen A1 - A L Ritaccio A1 - Gerwin Schalk AB - People affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control and are no longer able to gesture or speak. For this population, an auditory BCI is one of only a few remaining means of communication. All currently used auditory BCIs require a relatively artificial mapping between a stimulus and a communication output. This mapping is cumbersome to learn and use. Recent studies suggest that electrocorticographic (ECoG) signals in the gamma band (i.e., 70–170 Hz) can be used to infer the identity of auditory speech stimuli, effectively removing the need to learn such an artificial mapping. However, BCI systems that use this physiological mechanism for communication purposes have not yet been described. In this study, we explore this possibility by implementing a BCI2000-based real-time system that uses ECoG signals to identify the attended speaker. JF - Brain-Computer Interface Research: A State-of-the-Art Summary PB - Springer International Publishing CY - New York City, NY SN - 978-3-319-25188-2 UR - http://link.springer.com/chapter/10.1007%2F978-3-319-25190-5_4 ER - TY - JOUR T1 - Assessing dynamics, spatial scale, and uncertainty in task-related brain network analyses. JF - Frontiers in Computational Neuroscience Y1 - 2014 A1 - Stephen, Emily P A1 - Lepage, Kyle Q A1 - Eden, Uri T A1 - Peter Brunner A1 - Gerwin Schalk A1 - Jonathan S Brumberg A1 - Guenther, Frank H A1 - Kramer, Mark A KW - canonical correlation KW - coherence KW - ECoG KW - EEG KW - functional connectivity KW - MEG AB - The brain is a complex network of interconnected elements, whose interactions evolve dynamically in time to cooperatively perform specific functions. A common technique to probe these interactions involves multi-sensor recordings of brain activity during a repeated task. Many techniques exist to characterize the resulting task-related activity, including establishing functional networks, which represent the statistical associations between brain areas. Although functional network inference is commonly employed to analyze neural time series data, techniques to assess the uncertainty—both in the functional network edges and the corresponding aggregate measures of network topology—are lacking. To address this, we describe a statistically principled approach for computing uncertainty in functional networks and aggregate network measures in task-related data. The approach is based on a resampling procedure that utilizes the trial structure common in experimental recordings. We show in simulations that this approach successfully identifies functional networks and associated measures of confidence emergent during a task in a variety of scenarios, including dynamically evolving networks. In addition, we describe a principled technique for establishing functional networks based on predetermined regions of interest using canonical correlation. Doing so provides additional robustness to the functional network inference. Finally, we illustrate the use of these methods on example invasive brain voltage recordings collected during an overt speech task. The general strategy described here—appropriate for static and dynamic network inference and different statistical measures of coupling—permits the evaluation of confidence in network measures in a variety of settings common to neuroscience. VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/24678295 IS - 31 ER - TY - JOUR T1 - Decoding spectrotemporal features of overt and covert speech from the human cortex. JF - Frontiers in Neuroengineering Y1 - 2014 A1 - Martin, Stéphanie A1 - Peter Brunner A1 - Holdgraf, Chris A1 - Heinze, Hans-Jochen A1 - Nathan E. Crone A1 - Rieger, Jochem A1 - Gerwin Schalk A1 - Robert T. Knight A1 - Pasley, Brian N. KW - covert speech KW - decoding model KW - Electrocorticography KW - pattern recognition KW - speech production AB - Auditory perception and auditory imagery have been shown to activate overlapping brain regions. We hypothesized that these phenomena also share a common underlying neural representation. To assess this, we used electrocorticography intracranial recordings from epileptic patients performing an out loud or a silent reading task. In these tasks, short stories scrolled across a video screen in two conditions: subjects read the same stories both aloud (overt) and silently (covert). In a control condition the subject remained in a resting state. We first built a high gamma (70–150 Hz) neural decoding model to reconstruct spectrotemporal auditory features of self-generated overt speech. We then evaluated whether this same model could reconstruct auditory speech features in the covert speech condition. Two speech models were tested: a spectrogram and a modulation-based feature space. For the overt condition, reconstruction accuracy was evaluated as the correlation between original and predicted speech features, and was significant in each subject (p < 0.00001; paired two-sample t-test). For the covert speech condition, dynamic time warping was first used to realign the covert speech reconstruction with the corresponding original speech from the overt condition. Reconstruction accuracy was then evaluated as the correlation between original and reconstructed speech features. Covert reconstruction accuracy was compared to the accuracy obtained from reconstructions in the baseline control condition. Reconstruction accuracy for the covert condition was significantly better than for the control condition (p < 0.005; paired two-sample t-test). The superior temporal gyrus, pre- and post-central gyrus provided the highest reconstruction information. The relationship between overt and covert speech reconstruction depended on anatomy. These results provide evidence that auditory representations of covert speech can be reconstructed from models that are built from an overt speech data set, supporting a partially shared neural substrate. VL - 7 UR - http://www.ncbi.nlm.nih.gov/pubmed/24904404 IS - 14 ER - TY - JOUR T1 - ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song. JF - Front Hum Neurosci Y1 - 2014 A1 - Sturm, Irene A1 - Benjamin Blankertz A1 - Potes, Cristhian A1 - Gerwin Schalk A1 - Curio, Gabriel KW - acoustic features KW - electrocorticography (ECoG) KW - high gamma KW - music processing KW - natural music AB -

Listening to music moves our minds and moods, stirring interest in its neural underpinnings. A multitude of compositional features drives the appeal of natural music. How such original music, where a composer's opus is not manipulated for experimental purposes, engages a listener's brain has not been studied until recently. Here, we report an in-depth analysis of two electrocorticographic (ECoG) data sets obtained over the left hemisphere in ten patients during presentation of either a rock song or a read-out narrative. First, the time courses of five acoustic features (intensity, presence/absence of vocals with lyrics, spectral centroid, harmonic change, and pulse clarity) were extracted from the audio tracks and found to be correlated with each other to varying degrees. In a second step, we uncovered the specific impact of each musical feature on ECoG high-gamma power (70-170 Hz) by calculating partial correlations to remove the influence of the other four features. In the music condition, the onset and offset of vocal lyrics in ongoing instrumental music was consistently identified within the group as the dominant driver for ECoG high-gamma power changes over temporal auditory areas, while concurrently subject-individual activation spots were identified for sound intensity, timbral, and harmonic features. The distinct cortical activations to vocal speech-related content embedded in instrumental music directly demonstrate that song integrated in instrumental music represents a distinct dimension in complex music. In contrast, in the speech condition, the full sound envelope was reflected in the high gamma response rather than the onset or offset of the vocal lyrics. This demonstrates how the contributions of stimulus features that modulate the brain response differ across the two examples of a full-length natural stimulus, which suggests a context-dependent feature selection in the processing of complex auditory stimuli.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/25352799 ER - TY - JOUR T1 - A general method for assessing brain–computer interface performance and its limitations. JF - Journal of Neural Engineering Y1 - 2014 A1 - Jeremy Jeremy Hill A1 - Häuser, Ann-Katrin A1 - Gerwin Schalk KW - brain-computer interface KW - information gain KW - information transfer rate KW - Neuroprosthetics KW - performance evaluation AB - Objective. When researchers evaluate brain–computer interface (BCI) systems, we want quantitative answers to questions such as: How good is the system's performance? How good does it need to be? and: Is it capable of reaching the desired level in future? In response to the current lack of objective, quantitative, study-independent approaches, we introduce methods that help to address such questions. We identified three challenges: (I) the need for efficient measurement techniques that adapt rapidly and reliably to capture a wide range of performance levels; (II) the need to express results in a way that allows comparison between similar but non-identical tasks; (III) the need to measure the extent to which certain components of a BCI system (e.g. the signal processing pipeline) not only support BCI performance, but also potentially restrict the maximum level it can reach. Approach. For challenge (I), we developed an automatic staircase method that adjusted task difficulty adaptively along a single abstract axis. For challenge (II), we used the rate of information gain between two Bernoulli distributions: one reflecting the observed success rate, the other reflecting chance performance estimated by a matched random-walk method. This measure includes Wolpaw's information transfer rate as a special case, but addresses the latter's limitations including its restriction to item-selection tasks. To validate our approach and address challenge (III), we compared four healthy subjects' performance using an EEG-based BCI, a 'Direct Controller' (a high-performance hardware input device), and a 'Pseudo-BCI Controller' (the same input device, but with control signals processed by the BCI signal processing pipeline). Main results. Our results confirm the repeatability and validity of our measures, and indicate that our BCI signal processing pipeline reduced attainable performance by about 33% (21 bits/min). Significance. Our approach provides a flexible basis for evaluating BCI performance and its limitations, across a wide range of tasks and task difficulties. VL - 11 UR - http://www.ncbi.nlm.nih.gov/pubmed/24658406 IS - 026018 ER - TY - JOUR T1 - Localizing ECoG electrodes on the cortical anatomy without post-implantation imaging. JF - Neuroimage Clin Y1 - 2014 A1 - Disha Gupta A1 - Jeremy Jeremy Hill A1 - Adamo, Matthew A A1 - A L Ritaccio A1 - Gerwin Schalk KW - auditory processing KW - electrocorticography (ECoG) KW - electrode localization KW - fiducials KW - interaoperative localization AB -

INTRODUCTION: Electrocorticographic (ECoG) grids are placed subdurally on the cortex in people undergoing cortical resection to delineate eloquent cortex. ECoG signals have high spatial and temporal resolution and thus can be valuable for neuroscientific research. The value of these data is highest when they can be related to the cortical anatomy. Existing methods that establish this relationship rely either on post-implantation imaging using computed tomography (CT), magnetic resonance imaging (MRI) or X-Rays, or on intra-operative photographs. For research purposes, it is desirable to localize ECoG electrodes on the brain anatomy even when post-operative imaging is not available or when intra-operative photographs do not readily identify anatomical landmarks.

METHODS: We developed a method to co-register ECoG electrodes to the underlying cortical anatomy using only a pre-operative MRI, a clinical neuronavigation device (such as BrainLab VectorVision), and fiducial markers. To validate our technique, we compared our results to data collected from six subjects who also had post-grid implantation imaging available. We compared the electrode coordinates obtained by our fiducial-based method to those obtained using existing methods, which are based on co-registering pre- and post-grid implantation images.

RESULTS: Our fiducial-based method agreed with the MRI-CT method to within an average of 8.24 mm (mean, median = 7.10 mm) across 6 subjects in 3 dimensions. It showed an average discrepancy of 2.7 mm when compared to the results of the intra-operative photograph method in a 2D coordinate system. As this method does not require post-operative imaging such as CTs, our technique should prove useful for research in intra-operative single-stage surgery scenarios. To demonstrate the use of our method, we applied our method during real-time mapping of eloquent cortex during a single-stage surgery. The results demonstrated that our method can be applied intra-operatively in the absence of post-operative imaging to acquire ECoG signals that can be valuable for neuroscientific investigations.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/25379417 ER - TY - JOUR T1 - Proceedings of the Fifth International Workshop on Advances in Electrocorticography. JF - Epilepsy Behav Y1 - 2014 A1 - A L Ritaccio A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - Hermes, Dora A1 - Hirsch, Lawrence J A1 - Jacobs, Joshua A1 - Kamada, Kyousuke A1 - Kastner, Sabine A1 - Robert T. Knight A1 - Lesser, Ronald P A1 - Miller, Kai A1 - Sejnowski, Terrence A1 - Worrell, Gregory A1 - Gerwin Schalk KW - Brain Mapping KW - brain-computer interface KW - electrical stimulation mapping KW - Electrocorticography KW - functional mapping KW - Gamma-frequency electroencephalography KW - High-frequency oscillations KW - Neuroprosthetics KW - Seizure detection KW - Subdural grid AB -

The Fifth International Workshop on Advances in Electrocorticography convened in San Diego, CA, on November 7-8, 2013. Advancements in methodology, implementation, and commercialization across both research and in the interval year since the last workshop were the focus of the gathering. Electrocorticography (ECoG) is now firmly established as a preferred signal source for advanced research in functional, cognitive, and neuroprosthetic domains. Published output in ECoG fields has increased tenfold in the past decade. These proceedings attempt to summarize the state of the art.

VL - 41 UR - http://www.ncbi.nlm.nih.gov/pubmed/25461213 ER - TY - JOUR T1 - Real-time functional mapping: potential tool for improving language outcome in pediatric epilepsy surgery. JF - J Neurosurg Pediatr Y1 - 2014 A1 - Korostenskaja, Milena A1 - Chen, Po-Ching A1 - Salinas, Christine M A1 - Westerveld, Michael A1 - Peter Brunner A1 - Gerwin Schalk A1 - Cook, Jane C A1 - Baumgartner, James A1 - Lee, Ki H KW - Adolescent KW - Anticonvulsants KW - Brain Mapping KW - Cerebral Cortex KW - Electric Stimulation KW - Electroencephalography KW - Epilepsies, Partial KW - Female KW - Humans KW - Language KW - Neuropsychological Tests KW - Sensitivity and Specificity KW - Speech AB -

Accurate language localization expands surgical treatment options for epilepsy patients and reduces the risk of postsurgery language deficits. Electrical cortical stimulation mapping (ESM) is considered to be the clinical gold standard for language localization. While ESM affords clinically valuable results, it can be poorly tolerated by children, requires active participation and compliance, carries a risk of inducing seizures, is highly time consuming, and is labor intensive. Given these limitations, alternative and/or complementary functional localization methods such as analysis of electrocorticographic (ECoG) activity in high gamma frequency band in real time are needed to precisely identify eloquent cortex in children. In this case report, the authors examined 1) the use of real-time functional mapping (RTFM) for language localization in a high gamma frequency band derived from ECoG to guide surgery in an epileptic pediatric patient and 2) the relationship of RTFM mapping results to postsurgical language outcomes. The authors found that RTFM demonstrated relatively high sensitivity (75%) and high specificity (90%) when compared with ESM in a "next-neighbor" analysis. While overlapping with ESM in the superior temporal region, RTFM showed a few other areas of activation related to expressive language function, areas that were eventually resected during the surgery. The authors speculate that this resection may be associated with observed postsurgical expressive language deficits. With additional validation in more subjects, this finding would suggest that surgical planning and associated assessment of the risk/benefit ratio would benefit from information provided by RTFM mapping.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/24995815 IS - 3 ER - TY - JOUR T1 - Real-Time Functional Mapping with Electrocorticography in Pediatric Epilepsy: Comparison with fMRI and ESM Findings. JF - Clinical EEG and neuroscience Y1 - 2014 A1 - Korostenskaja, Milena A1 - Adam J Wilson A1 - Rose, Douglas F A1 - Peter Brunner A1 - Gerwin Schalk A1 - Leach, James A1 - Mangano, Francesco T A1 - Fujiwara, Hisako A1 - Rozhkov, Leonid A1 - Harris, Elana A1 - Chen, Po-Ching A1 - Seo, Joo-Hee A1 - Lee, Ki H KW - Brain-computer interface (BCI) KW - cortical stimulation KW - electrocorticography (ECoG) KW - epilepsy surgery KW - functional magnetic resonance imaging (fMRI) KW - functional mapping KW - pediatrics KW - SIGFRIED AB - SIGFRIED (SIGnal modeling For Real-time Identification and Event Detection) software provides real-time functional mapping (RTFM) of eloquent cortex for epilepsy patients preparing to undergo resective surgery. This study presents the first application of paradigms used in functional magnetic resonance (fMRI) and electrical cortical stimulation mapping (ESM) studies for shared functional cortical mapping in the context of RTFM. Results from the 3 modalities are compared. A left-handed 13-year-old male with intractable epilepsy participated in functional mapping for localization of eloquent language cortex with fMRI, ESM, and RTFM. For RTFM, data were acquired over the frontal and temporal cortex. Several paradigms were sequentially presented: passive (listening to stories) and active (picture naming and verb generation). For verb generation and story processing, fMRI showed atypical right lateralizing language activation within temporal lobe regions of interest and bilateral frontal activation with slight right lateralization. Left hemisphere ESM demonstrated no eloquent language areas. RTFM procedures using story processing and picture naming elicited activity in the right lateral and basal temporal regions. Verb generation elicited strong right lateral temporal lobe activation, as well as left frontal lobe activation. RTFM results confirmed atypical language lateralization evident from fMRI and ESM. We demonstrated the feasibility and usefulness of a new RTFM stimulation paradigm during presurgical evaluation. Block design paradigms used in fMRI may be optimal for this purpose. Further development is needed to create age-appropriate RTFM test batteries. UR - http://www.ncbi.nlm.nih.gov/pubmed/24293161 ER - TY - JOUR T1 - Simultaneous Real-Time Monitoring of Multiple Cortical Systems. JF - Journal of Neural Engineering Y1 - 2014 A1 - Disha Gupta A1 - Jeremy Jeremy Hill A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - A L Ritaccio A1 - Gerwin Schalk KW - auditory processing KW - Electrocorticography KW - movement intention KW - realtime decoding KW - simultaneous decoding AB - OBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic. UR - http://www.ncbi.nlm.nih.gov/pubmed/25080161 ER - TY - JOUR T1 - Spatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing. JF - NeuroImage Y1 - 2014 A1 - Potes, Cristhian A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - Robert T. Knight A1 - Gerwin Schalk KW - alpha and high gamma activity KW - auditory processing KW - electrocorticography (ECoG) KW - functional connectivity KW - granger causality KW - thalamo-cortical interactions AB - Neuroimaging approaches have implicated multiple brain sites in musical perception, including the posterior part of the superior temporal gyrus and adjacent perisylvian areas. However, the detailed spatial and temporal relationship of neural signals that support auditory processing is largely unknown. In this study, we applied a novel inter-subject analysis approach to electrophysiological signals recorded from the surface of the brain (electrocorticography (ECoG)) in ten human subjects. This approach allowed us to reliably identify those ECoG features that were related to the processing of a complex auditory stimulus (i.e., continuous piece of music) and to investigate their spatial, temporal, and causal relationships. Our results identified stimulus-related modulations in the alpha (8-12 Hz) and high gamma (70-110 Hz) bands at neuroanatomical locations implicated in auditory processing. Specifically, we identified stimulus-related ECoG modulations in the alpha band in areas adjacent to primary auditory cortex, which are known to receive afferent auditory projections from the thalamus (80 of a total of 15,107 tested sites). In contrast, we identified stimulus-related ECoG modulations in the high gamma band not only in areas close to primary auditory cortex but also in other perisylvian areas known to be involved in higher-order auditory processing, and in superior premotor cortex (412/15,107 sites). Across all implicated areas, modulations in the high gamma band preceded those in the alpha band by 280 ms, and activity in the high gamma band causally predicted alpha activity, but not vice versa (Granger causality, p<1e(-8)). Additionally, detailed analyses using Granger causality identified causal relationships of high gamma activity between distinct locations in early auditory pathways within superior temporal gyrus (STG) and posterior STG, between posterior STG and inferior frontal cortex, and between STG and premotor cortex. Evidence suggests that these relationships reflect direct cortico-cortical connections rather than common driving input from subcortical structures such as the thalamus. In summary, our inter-subject analyses defined the spatial and temporal relationships between music-related brain activity in the alpha and high gamma bands. They provide experimental evidence supporting current theories about the putative mechanisms of alpha and gamma activity, i.e., reflections of thalamo-cortical interactions and local cortical neural activity, respectively, and the results are also in agreement with existing functional models of auditory processing. VL - 97 UR - http://www.ncbi.nlm.nih.gov/pubmed/24768933 ER - TY - CHAP T1 - BCI Software Platforms. T2 - Towards Practical Brain-Computer Interfaces Y1 - 2013 A1 - Brunner, Clemens A1 - Andreoni, G A1 - Bianchi, L A1 - Benjamin Blankertz A1 - Breitwieser, C. A1 - Kanoh, S. A1 - Kothe, C. A. A1 - Lecuyer, A. A1 - Makeig, S A1 - Mellinger, J. A1 - Perego, P. A1 - Renard, Y. A1 - Gerwin Schalk A1 - Susila, I.P. A1 - Venthur, B A1 - Mueller-Putz, G.R. A1 - Brendan Z. Allison A1 - Dunne, S. A1 - Leeb, R. A1 - Del R. Millán, J. A1 - A. Nijholt AB - In this chapter, we provide an overview of publicly available software platforms for brain–computer interfaces. We have identified seven major BCI platforms and one platform specifically targeted towards feedback and stimulus presentation. We describe the intended target user group (which includes researchers, programmers, and end users), the most important features of each platform such as availability on different operating systems, licences, programming languages involved, supported devices, and so on. These seven platforms are: (1) BCI2000, (2) OpenViBE, (3) TOBI Common Implementation Platform (CIP), (4) BCILAB, (5) BCI++, (6) xBCI, and (7) BF++. The feedback framework is called Pyff. Our conclusion discusses possible synergies and future developments, such as combining different components of different platforms. With this overview, we hope to identify the strengths and weaknesses of each available platform, which should help anyone in the BCI research field in their decision which platform to use for their specific purposes. JF - Towards Practical Brain-Computer Interfaces PB - Biological and Medical Physics SN - 978-3-642-29745-8 UR - http://link.springer.com/chapter/10.1007/978-3-642-29746-5_16 ER - TY - Generic T1 - Brain-Computer Interfaces Yesterday, Today, and Tomorrow: A Status Report of Bioengineering Research Partnership EB0085 Y1 - 2013 A1 - Gerwin Schalk AB - National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, MD ER - TY - Generic T1 - Brain-Computer Interfacing Using P300 Evoked Potentials Y1 - 2013 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interfaces, Electrical and Computer Engineering Department, NYU Poly ER - TY - Generic T1 - Brain-Computer Interfacing Using P300 Evoked Potentials Y1 - 2013 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interfaces, Departments of Neurosurgery/Bioengineering, University of Pennsylvania ER - TY - Generic T1 - Communicating Directly With the Brain Y1 - 2013 A1 - Gerwin Schalk AB - Annual Gala of Fondazione Neurone, Rome, Italy ER - TY - Generic T1 - cortiQ – Clinical Software for Electrocorticographic Real-Time Functional Mapping of the Eloquent Cortex T2 - 35th Annual International IEEE EMBS Conference (EMBC) Y1 - 2013 A1 - Prueckl, R. A1 - Kapeller, C A1 - Potes, Cristhian A1 - Korostenskaja, M A1 - Gerwin Schalk A1 - Lee, K.H. A1 - Guger, C JF - 35th Annual International IEEE EMBS Conference (EMBC) ER - TY - JOUR T1 - CortiQ - clinical software for electrocorticographic real-time functional mapping of the eloquent cortex. JF - Conf Proc IEEE Eng Med Biol Soc Y1 - 2013 A1 - Prueckl, Robert A1 - Kapeller, Christoph A1 - Potes, Cristhian A1 - Korostenskaja, Milena A1 - Gerwin Schalk A1 - Lee, Ki H A1 - Guger, Christoph AB - Planning for epilepsy surgery depends substantially on the localization of brain cortical areas responsible for sensory, motor, or cognitive functions, clinically also known as eloquent cortex. In this paper, we present the novel software package 'cortiQ' that allows clinicians to localize eloquent cortex, thus providing a safe margin for surgical resection with a low incidence of neurological deficits. This software can be easily used in addition to traditional mapping procedures such as the electrical cortical stimulation (ECS) mapping. The software analyses task-related changes in gamma activity recorded from implanted subdural electrocorticography electrodes using extensions to previously published methods. In this manuscript, we describe the system's architecture and workflow required to obtain a map of the eloquent cortex. We validate the system by comparing our mapping results with those acquired using ECS mapping in two subjects. Our results indicate that cortiQ reliably identifies eloquent cortex much faster (several minutes compared to an hour or more) than ECS mapping. Next-neighbour analyses show that there are no false positives and an average of 1.24% false negatives. VL - 2013 UR - http://www.ncbi.nlm.nih.gov/pubmed/24111197 ER - TY - Generic T1 - ECoG-Based Neuroscience and Neuroengineering Y1 - 2013 A1 - Gerwin Schalk AB - Center for Neuropharmacology and Neuroscience Seminar Series, Albany Medical College, Albany, NY ER - TY - Generic T1 - Exciting Opportunities for Neuroengineering Y1 - 2013 A1 - Gerwin Schalk AB - Hershey Medical Center, Penn State University ER - TY - Generic T1 - The Exciting World of Brain-Computer Interfaces Y1 - 2013 A1 - Gerwin Schalk AB - Society of Physics Students, State University of New York at Albany, Albany, NY ER - TY - Generic T1 - Long-term Cortical Neuroprostheses: Prospects and Challenges Y1 - 2013 A1 - Gerwin Schalk AB - 1st Bernstein Sparks Workshop on Cortical Neurointerfaces, Delmenhorst, Germany ER - TY - JOUR T1 - A low-frequency oscillatory neural signal in humans encodes a developing decision variable. JF - NeuroImage Y1 - 2013 A1 - Kubanek, Jan A1 - Snyder, Lawrence H. A1 - Brunton, Bingni W. A1 - Brody, Carlos D. A1 - Gerwin Schalk AB - We often make decisions based on sensory evidence that is accumulated over a period of time. How the evidence for such decisions is represented in the brain and how such a neural representation is used to guide a subsequent action are questions of considerable interest to decision sciences. The neural correlates of developing perceptual decisions have been thoroughly investigated in the oculomotor system of macaques who communicated their decisions using an eye movement. It has been found that the evidence informing a decision to make an eye movement is in part accumulated within the same oculomotor circuits that signal the upcoming eye movement. Recent evidence suggests that the somatomotor system may exhibit an analogous property for choices made using a hand movement. To investigate this possibility, we engaged humans in a decision task in which they integrated discrete quanta of sensory information over a period of time and signaled their decision using a hand movement or an eye movement. The discrete form of the sensory evidence allowed us to infer the decision variable on which subjects base their decision on each trial and to assess the neural processes related to each quantum of the incoming decision evidence. We found that a low-frequency electrophysiological signal recorded over centroparietal regions strongly encodes the decision variable inferred in this task, and that it does so specifically for hand movement choices. The signal ramps up with a rate that is proportional to the decision variable, remains graded by the decision variable throughout the delay period, reaches a common peak shortly before a hand movement, and falls off shortly after the hand movement. Furthermore, the signal encodes the polarity of each evidence quantum, with a short latency, and retains the response level over time. Thus, this neural signal shows properties of evidence accumulation. These findings suggest that the decision-related effects observed in the oculomotor system of the monkey during eye movement choices may share the same basic properties with the decision-related effects in the somatomotor system of humans during hand movement choices. VL - 83 UR - http://www.ncbi.nlm.nih.gov/pubmed/23872495 ER - TY - Generic T1 - Opportunities in Computation Electrophysiological Imaging Y1 - 2013 A1 - Gerwin Schalk AB - Department of Psychology, NYU, New York, NY ER - TY - Generic T1 - Opportunities in Computation Electrophysiological Imaging Y1 - 2013 A1 - Gerwin Schalk AB - McGovern Institute for Brain Research, MIT ER - TY - JOUR T1 - Proceedings of the Fourth International Workshop on Advances in Electrocorticography. JF - Epilepsy & Behavior Y1 - 2013 A1 - A L Ritaccio A1 - Peter Brunner A1 - Nathan E. Crone A1 - Gunduz, Aysegul A1 - Hirsch, Lawrence J. A1 - Kanwisher, Nancy A1 - Litt, Brian A1 - Kai J. Miller A1 - Morani, Daniel A1 - Parvizi, Josef A1 - Ramsey, Nick F A1 - Richner, Thomas J. A1 - Tandon, Niton A1 - Williams, Justin A1 - Gerwin Schalk KW - Brain Mapping KW - Brain–computer interface KW - Electrocorticography KW - Gamma-frequency electroencephalography KW - High-frequency oscillations KW - Neuroprosthetics KW - Seizure detection KW - Subdural grid AB - The Fourth International Workshop on Advances in Electrocorticography (ECoG) convened in New Orleans, LA, on October 11–12, 2012. The proceedings of the workshop serves as an accurate record of the most contemporary clinical and experimental work on brain surface recording and represents the insights of a unique multidisciplinary ensemble of expert clinicians and scientists. Presentations covered a broad range of topics, including innovations in passive functional mapping, increased understanding of pathologic high-frequency oscillations, evolving sensor technologies, a human trial of ECoG-driven brain–machine interface, as well as fresh insights into brain electrical stimulation. VL - 29 UR - http://www.ncbi.nlm.nih.gov/pubmed/24034899 IS - 2 ER - TY - JOUR T1 - Toward Gaze-Independent Brain-Computer Interfaces. JF - Clinical Neurophysiology Y1 - 2013 A1 - Peter Brunner A1 - Gerwin Schalk VL - 125 UR - http://www.ncbi.nlm.nih.gov/pubmed/23465431 IS - 5 ER - TY - JOUR T1 - The Tracking of Speech Envelope in the Human Cortex. JF - PLoS ONE Y1 - 2013 A1 - Kubanek, Jan A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - Poeppel, David A1 - Gerwin Schalk AB - Humans are highly adept at processing speech. Recently, it has been shown that slow temporal information in speech (i.e., the envelope of speech) is critical for speech comprehension. Furthermore, it has been found that evoked electric potentials in human cortex are correlated with the speech envelope. However, it has been unclear whether this essential linguistic feature is encoded differentially in specific regions, or whether it is represented throughout the auditory system. To answer this question, we recorded neural data with high temporal resolution directly from the cortex while human subjects listened to a spoken story. We found that the gamma activity in human auditory cortex robustly tracks the speech envelope. The effect is so marked that it is observed during a single presentation of the spoken story to each subject. The effect is stronger in regions situated relatively early in the auditory pathway (belt areas) compared to other regions involved in speech processing, including the superior temporal gyrus (STG) and the posterior inferior frontal gyrus (Broca's region). To further distinguish whether speech envelope is encoded in the auditory system as a phonological (speech-related), or instead as a more general acoustic feature, we also probed the auditory system with a melodic stimulus. We found that belt areas track melody envelope weakly, and as the only region considered. Together, our data provide the first direct electrophysiological evidence that the envelope of speech is robustly tracked in non-primary auditory cortex (belt areas in particular), and suggest that the considered higher-order regions (STG and Broca's region) partake in a more abstract linguistic analysis. VL - 8 UR - http://dx.doi.org/10.1371%2Fjournal.pone.0053398 IS - 1 ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2012 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, New Orleans, LA ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and Its Application to ECoG Signals Y1 - 2012 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, New Orleans, LA ER - TY - CHAP T1 - BCIs That Use Electrocorticographic Activity. T2 - Brain-Computer Interfaces: Principles and Practice Y1 - 2012 A1 - Jonathan Wolpaw A1 - E. Winter-Wolpaw A1 - Gerwin Schalk KW - brain signals KW - brain-computer interfaces KW - ECoG KW - intracortically recorded signals AB - This chapter discusses the potential of electrocorticography (ECoG) as a clinically useful brain-computer interface signal modality. ECoG has greater amplitude, higher topographical resolution, and a much broader frequency range than scalp-recorded electroencephalography and is less susceptible to artifacts. With current and foreseeable recording methodologies, ECoG is likely to have greater long-term stability than intracortically recorded signals. Furthermore, it can more readily be recorded from larger cortical areas, and it requires much lower digitization rates, thus greatly reducing the power requirements of wholly implanted systems. JF - Brain-Computer Interfaces: Principles and Practice PB - Oxford University Press UR - http://www.oxfordscholarship.com/view/10.1093/acprof:oso/9780195388855.001.0001/acprof-9780195388855-chapter-015 ER - TY - Generic T1 - Brain-Computer Interfacing Using P300 Evoked Potentials Y1 - 2012 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interfaces, Departments of Neurosurgery/Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania ER - TY - Generic T1 - Brain-Computer Interfacing Using P300 Evoked Potentials Y1 - 2012 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interfaces, Electrical and Computer Engineering Department, NYU poly, New York, NY ER - TY - Generic T1 - Communicating Directly With the Brain Y1 - 2012 A1 - Gerwin Schalk AB - Introductory lecture at the initial public presentation of the €20m Italian project "cyber brain." Chamber of Commerce, Avellino, Italy. ER - TY - JOUR T1 - Communication and control by listening: towards optimal design of a two-class auditory streaming brain-computer interface. JF - Frontiers in Neuroscience Y1 - 2012 A1 - Jeremy Jeremy Hill A1 - Moinuddin, Aisha A1 - Häuser, Ann-Katrin A1 - Kienzle, Stephan A1 - Gerwin Schalk KW - auditory attention KW - auditory event-related potentials KW - brain-computer interface KW - dichotic listening KW - N1 potential KW - P3 potential AB - Most brain-computer interface (BCI) systems require users to modulate brain signals in response to visual stimuli. Thus, they may not be useful to people with limited vision, such as those with severe paralysis. One important approach for overcoming this issue is auditory streaming, an approach whereby a BCI system is driven by shifts of attention between two simultaneously presented auditory stimulus streams. Motivated by the long-term goal of translating such a system into a reliable, simple yes-no interface for clinical usage, we aim to answer two main questions. First, we asked which of two previously published variants provides superior performance: a fixed-phase (FP) design in which the streams have equal period and opposite phase, or a drifting-phase (DP) design where the periods are unequal. We found FP to be superior to DP (p = 0.002): average performance levels were 80 and 72% correct, respectively. We were also able to show, in a pilot with one subject, that auditory streaming can support continuous control and neurofeedback applications: by shifting attention between ongoing left and right auditory streams, the subject was able to control the position of a paddle in a computer game. Second, we examined whether the system is dependent on eye movements, since it is known that eye movements and auditory attention may influence each other, and any dependence on the ability to move one’s eyes would be a barrier to translation to paralyzed users. We discovered that, despite instructions, some subjects did make eye movements that were indicative of the direction of attention. However, there was no correlation, across subjects, between the reliability of the eye movement signal and the reliability of the BCI system, indicating that our system was configured to work independently of eye movement. Together, these findings are an encouraging step forward toward BCIs that provide practical communication and control options for the most severely paralyzed users. VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/23267312 ER - TY - JOUR T1 - Decoding covert spatial attention using electrocorticographic (ECoG) signals in humans. JF - Neuroimage Y1 - 2012 A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - Amy Daitch A1 - Leuthardt, E C A1 - A L Ritaccio A1 - Pesaran, Bijan A1 - Gerwin Schalk KW - covert attention KW - electrocorticography (ECoG) KW - visual spatial attention AB -

This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.

VL - 60 UR - http://www.ncbi.nlm.nih.gov/pubmed/22366333 IS - 4 ER - TY - JOUR T1 - Decoding Onset and Direction of Movements using Electrocorticographic (ECoG) Signals in Humans. JF - Frontiers in Neuroengineering Y1 - 2012 A1 - Wang, Z. A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - A L Ritaccio A1 - Ji, Q A1 - Gerwin Schalk KW - brain computer interface KW - ECoG KW - movement direction prediction KW - movement onset prediction KW - neurorehabilitation KW - performance augmentation AB - Communication of intent usually requires motor function. This requirement can be limiting when a person is engaged in a task, or prohibitive for some people suffering from neuromuscular disorders. Determining a person's intent, e.g., where and when to move, from brain signals rather than from muscles would have important applications in clinical or other domains. For example, detection of the onset and direction of intended movements may provide the basis for restoration of simple grasping function in people with chronic stroke, or could be used to optimize a user's interaction with the surrounding environment. Detecting the onset and direction of actual movements are a first step in this direction. In this study, we demonstrate that we can detect the onset of intended movements and their direction using electrocorticographic (ECoG) signals recorded from the surface of the cortex in humans. We also demonstrate in a simulation that the information encoded in ECoG about these movements may improve performance in a targeting task. In summary, the results in this paper suggest that detection of intended movement is possible, and may serve useful functions. VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/22891058 IS - 15 ER - TY - JOUR T1 - Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening. JF - Neuroimage Y1 - 2012 A1 - Potes, Cristhian A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - Gerwin Schalk KW - auditory processing KW - electrocorticography (ECoG) KW - high gamma activity KW - sound intensity AB -

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

VL - 61 UR - http://www.ncbi.nlm.nih.gov/pubmed/22537600 IS - 4 ER - TY - Generic T1 - ECoG-Based Neuroscience and Neuroengineering Y1 - 2012 A1 - Gerwin Schalk AB - BBCI Workshop 2012, Advances in Neurotechnology, Berlin, Germany ER - TY - JOUR T1 - Electrocorticographic (ECoG) Correlates of Human Arm Movements. JF - Exp Brain Res Y1 - 2012 A1 - Nicholas R Anderson A1 - Blakely, Timothy A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, Daniel W KW - arm tuning KW - brain-computer interfaces KW - cosine tuning KW - Electrocorticography KW - Motor Cortex KW - subdural electroencephalography AB - Invasive and non-invasive brain-computer interface (BCI) studies have long focused on the motor cortex for kinematic control of artificial devices. Most of these studies have used single-neuron recordings or electroencephalography (EEG). Electrocorticography (ECoG) is a relatively new recording modality in BCI research that has primarily been built on successes in EEG recordings. We built on prior experiments related to single-neuron recording and quantitatively compare the extent to which different brain regions reflect kinematic tuning parameters of hand speed, direction, and velocity in both a reaching and tracing task in humans. Hand and arm movement experiments using ECoG have shown positive results before, but the tasks were not designed to tease out which kinematics are encoded. In non-human primates, the relationships among these kinematics have been more carefully documented, and we sought to begin elucidating that relationship in humans using ECoG. The largest modulation in ECoG activity for direction, speed, and velocity representation was found in the primary motor cortex. We also found consistent cosine tuning across both tasks, to hand direction and velocity in the high gamma band (70-160 Hz). Thus, the results of this study clarify the neural substrates involved in encoding aspects of motor preparation and execution and confirm the important role of the motor cortex in BCI applications. VL - 223 UR - http://www.ncbi.nlm.nih.gov/pubmed/23001369 IS - 1 ER - TY - Generic T1 - Exciting Adventures in Neuroscience and Neuroengineering Y1 - 2012 A1 - Gerwin Schalk AB - Colloquium at Electrical Engineering and Computer Science Department, Case Western Reserve University, Cleveland OH ER - TY - Generic T1 - Exciting Directions in Neuroscience and Neuroengineering Y1 - 2012 A1 - Gerwin Schalk AB - Kent State University, Kent, OH ER - TY - Generic T1 - Exciting Opportunities in Neuroscience and Neuroengineering Y1 - 2012 A1 - Gerwin Schalk AB - University of Washington, Seattle, WA ER - TY - Generic T1 - The Exciting World of Brain-Computer Interfaces Y1 - 2012 A1 - Gerwin Schalk AB - Wadsworth Center Research Experience for Undergraduates (REU) program ER - TY - Generic T1 - The Exciting World of Brain-Computer Interfaces Y1 - 2012 A1 - Gerwin Schalk AB - Lecture in course Science in the News, Sage College, Albany, NY ER - TY - Generic T1 - The Exciting World of Brain-Computer Interfacing Y1 - 2012 A1 - Gerwin Schalk AB - Keynote Address, Workshop in "Solving the Mystery of how the Brian Works." Walt Disney Pavilion, Florida Hospital for Children, FL ER - TY - Generic T1 - Future Aspects of Functional Mapping Y1 - 2012 A1 - Gerwin Schalk AB - 1st International Workshop on Functional Mapping with ECoG, New Orleans, LA ER - TY - Generic T1 - Future Aspects of Functional Mapping Y1 - 2012 A1 - Gerwin Schalk ER - TY - CHAP T1 - Hardware and Software Technologies. T2 - Brain-Computer Interfaces: Principles and Practice Y1 - 2012 A1 - Gerwin Schalk A1 - Guger, C A1 - Adam J Wilson ED - Jonathan Wolpaw ED - E. Winter-Wolpaw JF - Brain-Computer Interfaces: Principles and Practice PB - Oxford University Press ER - TY - Generic T1 - Learning with Target Prior T2 - Neural Information Processing Systems (NIPS) Conference Y1 - 2012 A1 - Wang, Z. A1 - Lyu, S. A1 - Gerwin Schalk A1 - Ji, Q JF - Neural Information Processing Systems (NIPS) Conference ER - TY - Generic T1 - Past and Present Aspects of Functional Mapping Y1 - 2012 A1 - Gerwin Schalk AB - 1st International Workshop on Functional Mapping with ECoG, New Orleans, LA ER - TY - Generic T1 - Perspectives on ECoG Research and Application Y1 - 2012 A1 - Gerwin Schalk AB - 4th International Workshop on Advances in Electrocorticography, New Orleans, LA ER - TY - Generic T1 - Principles of Real-Time Passive Functional Mapping Y1 - 2012 A1 - Gerwin Schalk AB - Department of Neurology, Yale University, New Haven, CT ER - TY - JOUR T1 - Proceedings of the Third International Workshop on Advances in Electrocorticography. JF - Epilepsy Behav Y1 - 2012 A1 - A L Ritaccio A1 - Beauchamp, Michael A1 - Bosman, Conrado A1 - Peter Brunner A1 - Chang, Edward A1 - Nathan E. Crone A1 - Gunduz, Aysegul A1 - Disha Gupta A1 - Robert T. Knight A1 - Leuthardt, Eric A1 - Litt, Brian A1 - Moran, Daniel A1 - Ojemann, Jeffrey A1 - Parvizi, Josef A1 - Ramsey, Nick A1 - Rieger, Jochem A1 - Viventi, Jonathan A1 - Voytek, Bradley A1 - Williams, Justin A1 - Gerwin Schalk KW - Brain Mapping KW - brain-computer interface KW - Electrocorticography KW - Gamma-frequency electroencephalography KW - high-frequency oscillation KW - Neuroprosthetics KW - Seizure detection KW - Subdural grid AB - The Third International Workshop on Advances in Electrocorticography (ECoG) was convened in Washington, DC, on November 10-11, 2011. As in prior meetings, a true multidisciplinary fusion of clinicians, scientists, and engineers from many disciplines gathered to summarize contemporary experiences in brain surface recordings. The proceedings of this meeting serve as evidence of a very robust and transformative field but will yet again require revision to incorporate the advances that the following year will surely bring. VL - 25 UR - http://www.ncbi.nlm.nih.gov/pubmed/23160096 IS - 4 ER - TY - Generic T1 - Real-Time Functional Mapping Using ECoG Y1 - 2012 A1 - Gerwin Schalk AB - g.tec ECoG/Spike Workshop, New Orleans, LA ER - TY - JOUR T1 - Recording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping. JF - J Vis Exp Y1 - 2012 A1 - Jeremy Jeremy Hill A1 - Disha Gupta A1 - Peter Brunner A1 - Gunduz, Aysegul A1 - Adamo, Matthew A A1 - A L Ritaccio A1 - Gerwin Schalk KW - BCI2000 KW - brain-computer interfacing KW - Electrocorticography KW - epilepsy monitoring KW - functional brain mapping KW - issue 64 KW - Magnetic Resonance Imaging KW - MRI KW - neuroscience KW - SIGFRIED AB -

Neuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), magnetoencephalography or functional magnetic-resonance imaging. These techniques have either inherently low temporal or low spatial resolution, and suffer from low signal-to-noise ratio and/or poor high-frequency sensitivity. Thus, they are suboptimal for exploring the short-lived spatio-temporal dynamics of many of the underlying brain processes. In contrast, the invasive technique of electrocorticography (ECoG) provides brain signals that have an exceptionally high signal-to-noise ratio, less susceptibility to artifacts than EEG, and a high spatial and temporal resolution (i.e., <1 cm/<1 millisecond, respectively). ECoG involves measurement of electrical brain signals using electrodes that are implanted subdurally on the surface of the brain. Recent studies have shown that ECoG amplitudes in certain frequency bands carry substantial information about task-related activity, such as motor execution and planning, auditory processing and visual-spatial attention. Most of this information is captured in the high gamma range (around 70-110 Hz). Thus, gamma activity has been proposed as a robust and general indicator of local cortical function. ECoG can also reveal functional connectivity and resolve finer task-related spatial-temporal dynamics, thereby advancing our understanding of large-scale cortical processes. It has especially proven useful for advancing brain-computer interfacing (BCI) technology for decoding a user's intentions to enhance or improve communication and control. Nevertheless, human ECoG data are often hard to obtain because of the risks and limitations of the invasive procedures involved, and the need to record within the constraints of clinical settings. Still, clinical monitoring to localize epileptic foci offers a unique and valuable opportunity to collect human ECoG data. We describe our methods for collecting recording ECoG, and demonstrate how to use these signals for important real-time applications such as clinical mapping and brain-computer interfacing. Our example uses the BCI2000 software platform and the SIGFRIED method, an application for real-time mapping of brain functions. This procedure yields information that clinicians can subsequently use to guide the complex and laborious process of functional mapping by electrical stimulation. PREREQUISITES AND PLANNING: Patients with drug-resistant partial epilepsy may be candidates for resective surgery of an epileptic focus to minimize the frequency of seizures. Prior to resection, the patients undergo monitoring using subdural electrodes for two purposes: first, to localize the epileptic focus, and second, to identify nearby critical brain areas (i.e., eloquent cortex) where resection could result in long-term functional deficits. To implant electrodes, a craniotomy is performed to open the skull. Then, electrode grids and/or strips are placed on the cortex, usually beneath the dura. A typical grid has a set of 8 x 8 platinum-iridium electrodes of 4 mm diameter (2.3 mm exposed surface) embedded in silicon with an inter-electrode distance of 1cm. A strip typically contains 4 or 6 such electrodes in a single line. The locations for these grids/strips are planned by a team of neurologists and neurosurgeons, and are based on previous EEG monitoring, on a structural MRI of the patient's brain, and on relevant factors of the patient's history. Continuous recording over a period of 5-12 days serves to localize epileptic foci, and electrical stimulation via the implanted electrodes allows clinicians to map eloquent cortex. At the end of the monitoring period, explantation of the electrodes and therapeutic resection are performed together in one procedure. In addition to its primary clinical purpose, invasive monitoring also provides a unique opportunity to acquire human ECoG data for neuroscientific research. The decision to include a prospective patient in the research is based on the planned location of their electrodes, on the patient's performance scores on neuropsychological assessments, and on their informed consent, which is predicated on their understanding that participation in research is optional and is not related to their treatment. As with all research involving human subjects, the research protocol must be approved by the hospital's institutional review board. The decision to perform individual experimental tasks is made day-by-day, and is contingent on the patient's endurance and willingness to participate. Some or all of the experiments may be prevented by problems with the clinical state of the patient, such as post-operative facial swelling, temporary aphasia, frequent seizures, post-ictal fatigue and confusion, and more general pain or discomfort. At the Epilepsy Monitoring Unit at Albany Medical Center in Albany, New York, clinical monitoring is implemented around the clock using a 192-channel Nihon-Kohden Neurofax monitoring system. Research recordings are made in collaboration with the Wadsworth Center of the New York State Department of Health in Albany. Signals from the ECoG electrodes are fed simultaneously to the research and the clinical systems via splitter connectors. To ensure that the clinical and research systems do not interfere with each other, the two systems typically use separate grounds. In fact, an epidural strip of electrodes is sometimes implanted to provide a ground for the clinical system. Whether research or clinical recording system, the grounding electrode is chosen to be distant from the predicted epileptic focus and from cortical areas of interest for the research. Our research system consists of eight synchronized 16-channel g.USBamp amplifier/digitizer units (g.tec, Graz, Austria). These were chosen because they are safety-rated and FDA-approved for invasive recordings, they have a very low noise-floor in the high-frequency range in which the signals of interest are found, and they come with an SDK that allows them to be integrated with custom-written research software. In order to capture the high-gamma signal accurately, we acquire signals at 1200Hz sampling rate-considerably higher than that of the typical EEG experiment or that of many clinical monitoring systems. A built-in low-pass filter automatically prevents aliasing of signals higher than the digitizer can capture. The patient's eye gaze is tracked using a monitor with a built-in Tobii T-60 eye-tracking system (Tobii Tech., Stockholm, Sweden). Additional accessories such as joystick, bluetooth Wiimote (Nintendo Co.), data-glove (5(th) Dimension Technologies), keyboard, microphone, headphones, or video camera are connected depending on the requirements of the particular experiment. Data collection, stimulus presentation, synchronization with the different input/output accessories, and real-time analysis and visualization are accomplished using our BCI2000 software. BCI2000 is a freely available general-purpose software system for real-time biosignal data acquisition, processing and feedback. It includes an array of pre-built modules that can be flexibly configured for many different purposes, and that can be extended by researchers' own code in C++, MATLAB or Python. BCI2000 consists of four modules that communicate with each other via a network-capable protocol: a Source module that handles the acquisition of brain signals from one of 19 different hardware systems from different manufacturers; a Signal Processing module that extracts relevant ECoG features and translates them into output signals; an Application module that delivers stimuli and feedback to the subject; and the Operator module that provides a graphical interface to the investigator. A number of different experiments may be conducted with any given patient. The priority of experiments will be determined by the location of the particular patient's electrodes. However, we usually begin our experimentation using the SIGFRIED (SIGnal modeling For Realtime Identification and Event Detection) mapping method, which detects and displays significant task-related activity in real time. The resulting functional map allows us to further tailor subsequent experimental protocols and may also prove as a useful starting point for traditional mapping by electrocortical stimulation (ECS). Although ECS mapping remains the gold standard for predicting the clinical outcome of resection, the process of ECS mapping is time consuming and also has other problems, such as after-discharges or seizures. Thus, a passive functional mapping technique may prove valuable in providing an initial estimate of the locus of eloquent cortex, which may then be confirmed and refined by ECS. The results from our passive SIGFRIED mapping technique have been shown to exhibit substantial concurrence with the results derived using ECS mapping. The protocol described in this paper establishes a general methodology for gathering human ECoG data, before proceeding to illustrate how experiments can be initiated using the BCI2000 software platform. Finally, as a specific example, we describe how to perform passive functional mapping using the BCI2000-based SIGFRIED system.

UR - http://www.ncbi.nlm.nih.gov/pubmed/22782131 IS - 64 ER - TY - JOUR T1 - Review of the BCI Competition IV. JF - Frontiers in Neuroprosthetics Y1 - 2012 A1 - Tangermann, M. A1 - Muller, K.R. A1 - Aertsen, A. A1 - Niels Birbaumer A1 - Christoph Braun A1 - Brunner, Clemens A1 - Leeb, R. A1 - Mehring, C. A1 - Miller, K.J. A1 - Mueller-Putz, G. A1 - Nolte, G. A1 - Pfurtscheller, G. A1 - Preissl, H. A1 - Gerwin Schalk A1 - Schlögl, A. A1 - Vidaurre, C. A1 - Waldert, S. A1 - Benjamin Blankertz KW - BCI KW - brain-computer interface KW - competition AB - The BCI competition IV stands in the tradition of prior BCI competitions that aim to provide high quality neuroscientific data for open access to the scientific community. As experienced already in prior competitions not only scientists from the narrow field of BCI compete, but scholars with a broad variety of backgrounds and nationalities. They include high specialists as well as students. The goals of all BCI competitions have always been to challenge with respect to novel paradigms and complex data. We report on the following challenges: (1) asynchronous data, (2) synthetic, (3) multi-class continuous data, (4) session-to-session transfer, (5) directionally modulated MEG, (6) finger movements recorded by ECoG. As after past competitions, our hope is that winning entries may enhance the analysis methods of future BCIs. VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/22811657 IS - 55 ER - TY - JOUR T1 - Silent Communication: toward using brain signals. JF - IEEE Pulse Y1 - 2012 A1 - Pei, Xiao-Mei A1 - Jeremy Jeremy Hill A1 - Gerwin Schalk KW - Animals KW - Brain KW - Brain Waves KW - Humans KW - Movement KW - User-Computer Interface AB -

From the 1980s movie Firefox to the more recent Avatar, popular science fiction has speculated about the possibility of a persons thoughts being read directly from his or her brain. Such braincomputer interfaces (BCIs) might allow people who are paralyzed to communicate with and control their environment, and there might also be applications in military situations wherever silent user-to-user communication is desirable. Previous studies have shown that BCI systems can use brain signals related to movements and movement imagery or attention-based character selection. Although these systems have successfully demonstrated the possibility to control devices using brain function, directly inferring which word a person intends to communicate has been elusive. A BCI using imagined speech might provide such a practical, intuitive device. Toward this goal, our studies to date addressed two scientific questions: (1) Can brain signals accurately characterize different aspects of speech? (2) Is it possible to predict spoken or imagined words or their components using brain signals?

VL - 3 UR - http://www.ncbi.nlm.nih.gov/pubmed/22344951 IS - 1 ER - TY - JOUR T1 - Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task. JF - Front Hum Neurosci Y1 - 2012 A1 - Leuthardt, E C A1 - Pei, Xiao-Mei A1 - Breshears, Jonathan A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Zachary V. Freudenberg A1 - Barbour, Dennis L A1 - Gerwin Schalk KW - cortex KW - Electrocorticography KW - gamma rhythms KW - human KW - Speech AB -

Several scientists have proposed different models for cortical processing of speech. Classically, the regions participating in language were thought to be modular with a linear sequence of activations. More recently, modern theoretical models have posited a more hierarchical and distributed interaction of anatomic areas for the various stages of speech processing. Traditional imaging techniques can only define the location or time of cortical activation, which impedes the further evaluation and refinement of these models. In this study, we take advantage of recordings from the surface of the brain [electrocorticography (ECoG)], which can accurately detect the location and timing of cortical activations, to study the time course of ECoG high gamma (HG) modulations during an overt and covert word repetition task for different cortical areas. For overt word production, our results show substantial perisylvian cortical activations early in the perceptual phase of the task that were maintained through word articulation. However, this broad activation is attenuated during the expressive phase of covert word repetition. Across the different repetition tasks, the utilization of the different cortical sites within the perisylvian region varied in the degree of activation dependent on which stimulus was provided (auditoryor visual cue) and whether the word was to be spoken or imagined. Taken together, the data support current models of speech that have been previously described with functional imaging. Moreover, this study demonstrates that the broad perisylvian speech network activates early and maintains suprathreshold activation throughout the word repetition task that appears to be modulated by the demands of different conditions.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/22563311 ER - TY - Generic T1 - Using Machines to Read the Mind Y1 - 2012 A1 - Gerwin Schalk AB - Department of Neurology and Neurological Services, Stanford University School of Medicine, Palo Alto, CA ER - TY - Generic T1 - Advanced BCI2000 Concepts Y1 - 2011 A1 - Gerwin Schalk AB - 8th BCI2000 Workshop, University Medical Center, Utrecht, The Netherlands ER - TY - Generic T1 - Anatomically Constrained Decoding of Finger Flexion from Electrocorticographic Signals T2 - NIPS Y1 - 2011 A1 - Zuoguan Wang A1 - Gerwin Schalk A1 - Ji, Q JF - NIPS ER - TY - Generic T1 - BCI2000 Y1 - 2011 A1 - Gerwin Schalk AB - FBNCI Cluster Workshop for Roadmap Development, Graz University of Technology ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2011 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, Washington, DC ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2011 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, IEEE EMBC Conference, Boston, MA ER - TY - Generic T1 - Brain-Computer Interfaces: Integrating Bioengineering and Neuroscience Research Y1 - 2011 A1 - Gerwin Schalk AB - Keynote, 37th Annual Northeast Bioengineering Conference, Rensselaer Polytechnic Institute, Troy, New York ER - TY - Generic T1 - Brain-Computer Interfaces: The Hope, The Hype, The Power, and The Pain Y1 - 2011 A1 - Gerwin Schalk AB - Brain-Computer Interfacing in 2011, Rudolf Magnus Institute for Neuroscience, Utrecht, The Netherlands ER - TY - JOUR T1 - Brain-computer interfaces using electrocorticographic signals. JF - IEEE Rev Biomed Eng Y1 - 2011 A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Brain-computer interface (BCI) KW - brain-machine interface (BMI) KW - electrocorticography (ECoG) AB -

Many studies over the past two decades have shown that people and animals can use brain signals to convey their intent to a computer using brain-computer interfaces (BCIs). BCI systems measure specific features of brain activity and translate them into control signals that drive an output. The sensor modalities that have most commonly been used in BCI studies have been electroencephalographic (EEG) recordings from the scalp and single-neuron recordings from within the cortex. Over the past decade, an increasing number of studies has explored the use of electrocorticographic (ECoG) activity recorded directly from the surface of the brain. ECoG has attracted substantial and increasing interest, because it has been shown to reflect specific details of actual and imagined actions, and because its technical characteristics should readily support robust and chronic implementations of BCI systems in humans. This review provides general perspectives on the ECoG platform; describes the different electrophysiological features that can be detected in ECoG; elaborates on the signal acquisition issues, protocols, and online performance of ECoG-based BCI studies to date; presents important limitations of current ECoG studies; discusses opportunities for further research; and finally presents a vision for eventual clinical implementation. In summary, the studies presented to date strongly encourage further research using the ECoG platform for basic neuroscientific research, as well as for translational neuroprosthetic applications.

VL - 4 UR - http://www.ncbi.nlm.nih.gov/pubmed/22273796 ER - TY - Generic T1 - Communicating Directly from the Brain Y1 - 2011 A1 - Gerwin Schalk AB - EmTech Conference, MIT Campus ER - TY - JOUR T1 - Current Trends in Hardware and Software for Brain-Computer Interfaces (BCIs). JF - J Neural Eng Y1 - 2011 A1 - Peter Brunner A1 - Bianchi, L A1 - Guger, C A1 - Cincotti, F A1 - Gerwin Schalk KW - Biofeedback, Psychology KW - Brain KW - Brain Mapping KW - Electroencephalography KW - Equipment Design KW - Equipment Failure Analysis KW - Humans KW - Man-Machine Systems KW - Software KW - User-Computer Interface AB -

brain-computer interface (BCI) provides a non-muscular communication channel to people with and without disabilities. BCI devices consist of hardware and software. BCI hardware records signals from the brain, either invasively or non-invasively, using a series of device components. BCI software then translates these signals into device output commands and provides feedback. One may categorize different types of BCI applications into the following four categories: basic research, clinical/translational research, consumer products, and emerging applications. These four categories use BCI hardware and software, but have different sets of requirements. For example, while basic research needs to explore a wide range of system configurations, and thus requires a wide range of hardware and software capabilities, applications in the other three categories may be designed for relatively narrow purposes and thus may only need a very limited subset of capabilities. This paper summarizes technical aspects for each of these four categories of BCI applications. The results indicate that BCI technology is in transition from isolated demonstrations to systematic research and commercial development. This process requires several multidisciplinary efforts, including the development of better integrated and more robust BCI hardware and software, the definition of standardized interfaces, and the developmentof certification, dissemination and reimbursement procedures.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/21436536 IS - 2 ER - TY - JOUR T1 - Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2011 A1 - Pei, Xiao-Mei A1 - Barbour, Dennis L A1 - Leuthardt, E C A1 - Gerwin Schalk KW - Adolescent KW - Adult KW - Brain KW - Brain Mapping KW - Cerebral Cortex KW - Communication Aids for Disabled KW - Data Interpretation, Statistical KW - Discrimination (Psychology) KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Functional Laterality KW - Humans KW - Male KW - Middle Aged KW - Movement KW - Speech Perception KW - User-Computer Interface AB -

Several stories in the popular media have speculated that it may be possible to infer from the brain which word a person is speaking or even thinking. While recent studies have demonstrated that brain signals can give detailed information about actual and imagined actions, such as different types of limb movements or spoken words, concrete experimental evidence for the possibility to 'read the mind', i.e. to interpret internally-generated speech, has been scarce. In this study, we found that it is possible to use signals recorded from the surface of the brain (electrocorticography) to discriminate the vowels and consonants embedded in spoken and in imagined words, and we defined the cortical areas that held the most information about discrimination of vowels and consonants. The results shed light on the distinct mechanisms associated with production of vowels and consonants, and could provide the basis for brain-based communication using imagined speech.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/21750369 IS - 4 ER - TY - CONF T1 - Defense-related insights and solutions from neuroscience and neuroengineering. Y1 - 2011 A1 - Gunduz, Aysegul A1 - Gerwin Schalk AB - Communication of intent usually requires motor function, which can be limiting during military missions. Determining a soldier's intent from brain signals rather than using muscles would have numerous applications for tactical combat. Brain-computer interfaces (BCIs) translate brain signals into machine readable form and could optimize a soldier's interaction with the surrounding environment. However, current BCI devices have largely remained laboratory curiosities, because current techniques either require extended training or do not have the requisite signal fidelity, because they are highly invasive and thus not safe or practical for use in humans, or because they rely on equipment (such as magnetic resonance imaging scanners) that do not allow for real-time applications and/or field deployment. The objective of our research program is to create a prototype of a system for communication and monitoring of orientation that uses brain signals to provide, in real time, an accurate assessment of the users intentional focus and imagined speech. We expect that our efforts will provide a prototype of the first intuitive brain-based communication and orientation system for human use. UR - http://spie.org/Publications/Proceedings/Paper/10.1117/12.888189 ER - TY - Generic T1 - Defense-related insights and solutions from neuroscience and neuroengineering Y1 - 2011 A1 - Gunduz, Aysegul A1 - Gerwin Schalk AB - Communication of intent usually requires motor function, which can be limiting during military missions. Determining a soldier's intent from brain signals rather than using muscles would have numerous applications for tactical combat. Brain-computer interfaces (BCIs) translate brain signals into machine readable form and could optimize a soldier's interaction with the surrounding environment. However, current BCI devices have largely remained laboratory curiosities, because current techniques either require extended training or do not have the requisite signal fidelity, because they are highly invasive and thus not safe or practical for use in humans, or because they rely on equipment (such as magnetic resonance imaging scanners) that do not allow for real-time applications and/or field deployment. The objective of our research program is to create a prototype of a system for communication and monitoring of orientation that uses brain signals to provide, in real time, an accurate assessment of the users intentional focus and imagined speech. We expect that our efforts will provide a prototype of the first intuitive brain-based communication and orientation system for human use. ER - TY - JOUR T1 - Editorial: Current Trends in Brain-Computer Interface (BCI) Research and Development. JF - International Journal of Human-Computer Interaction Y1 - 2011 A1 - Nam, C.S. A1 - Gerwin Schalk A1 - Moore-Jackson, M. UR - http://www.tandfonline.com/doi/abs/10.1080/10447318.2011.535748?journalCode=hihc20#.VYwf82AxI4g ER - TY - Generic T1 - Electrocorticography: A New Window into Brain Function Y1 - 2011 A1 - Gerwin Schalk AB - Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Boston, MA ER - TY - Generic T1 - Exciting Adventures in Neuroscience and Neuroengineering Y1 - 2011 A1 - Gerwin Schalk AB - Electrical and Computer Engineering Department, University of Houston, Houston, Texas ER - TY - Generic T1 - Exciting Adventures in Neuroscience and Neuroengineering Y1 - 2011 A1 - Gerwin Schalk AB - Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, New York ER - TY - Generic T1 - Exciting Adventures in Neuroscience and Neuroengineering Y1 - 2011 A1 - Gerwin Schalk AB - Institute for Knowledge Discovery, Graz Technical University, Graz, Austria ER - TY - Generic T1 - Introduction to BCI2000 Y1 - 2011 A1 - Gerwin Schalk AB - 8th BCI2000 Workshop, University Medical Center, Utrecht, The Netherlands ER - TY - JOUR T1 - Neural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans. JF - Front Hum Neurosci Y1 - 2011 A1 - Gunduz, Aysegul A1 - Peter Brunner A1 - Amy Daitch A1 - Leuthardt, E C A1 - A L Ritaccio A1 - Pesaran, Bijan A1 - Gerwin Schalk KW - covert attention KW - Electrocorticography KW - intention KW - motor response KW - visual-spatial attention AB -

Attention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/22046153 ER - TY - JOUR T1 - Nonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex. JF - J Neurosci Y1 - 2011 A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Zachary V. Freudenberg A1 - Breshears, Jonathan A1 - Bundy, David T A1 - Roland, Jarod A1 - Barbour, Dennis L A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Analysis of Variance KW - Brain Mapping KW - Brain Waves KW - Cerebral Cortex KW - Cognition Disorders KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Female KW - Humans KW - Male KW - Middle Aged KW - Neuropsychological Tests KW - Nonlinear Dynamics KW - Photic Stimulation KW - Reaction Time KW - Spectrum Analysis KW - Time Factors KW - Vocabulary AB -

High-gamma-band (>60 Hz) power changes in cortical electrophysiology are a reliable indicator of focal, event-related cortical activity. Despite discoveries of oscillatory subthreshold and synchronous suprathreshold activity at the cellular level, there is an increasingly popular view that high-gamma-band amplitude changes recorded from cellular ensembles are the result of asynchronous firing activity that yields wideband and uniform power increases. Others have demonstrated independence of power changes in the low- and high-gamma bands, but to date, no studies have shown evidence of any such independence above 60 Hz. Based on nonuniformities in time-frequency analyses of electrocorticographic (ECoG) signals, we hypothesized that induced high-gamma-band (60-500 Hz) power changes are more heterogeneous than currently understood. Using single-word repetition tasks in six human subjects, we showed that functional responsiveness of different ECoG high-gamma sub-bands can discriminate cognitive task (e.g., hearing, reading, speaking) and cortical locations. Power changes in these sub-bands of the high-gamma range are consistently present within single trials and have statistically different time courses within the trial structure. Moreover, when consolidated across all subjects within three task-relevant anatomic regions (sensorimotor, Broca's area, and superior temporal gyrus), these behavior- and location-dependent power changes evidenced nonuniform trends across the population. Together, the independence and nonuniformity of power changes across a broad range of frequencies suggest that a new approach to evaluating high-gamma-band cortical activity is necessary. These findings show that in addition to time and location, frequency is another fundamental dimension of high-gamma dynamics.

VL - 31 UR - http://www.ncbi.nlm.nih.gov/pubmed/21307246 IS - 6 ER - TY - Generic T1 - Opportunities for Clinical Application of Emerging Neuroscientific and Neuroengineering Understanding Y1 - 2011 A1 - Gerwin Schalk AB - Neruophysiology Seminar Series, Baylor Hospital, Houston, TX ER - TY - Generic T1 - Perspectives on ECoG Research and Application Y1 - 2011 A1 - Gerwin Schalk AB - 3rd International Workshop on Advances in Electrocorticography, Washington, DC ER - TY - JOUR T1 - Prior knowledge improves decoding of finger flexion from electrocorticographic signals. JF - Front Neurosci Y1 - 2011 A1 - Zuoguan Wang A1 - Ji, Q A1 - Miller, John W A1 - Gerwin Schalk KW - brain-computer interface KW - decoding algorithm KW - electrocorticographic KW - finger flexion KW - machine learning KW - prior knowledge AB -

Brain-computer interfaces (BCIs) use brain signals to convey a user's intent. Some BCI approaches begin by decoding kinematic parameters of movements from brain signals, and then proceed to using these signals, in absence of movements, to allow a user to control an output. Recent results have shown that electrocorticographic (ECoG) recordings from the surface of the brain in humans can give information about kinematic parameters (e.g., hand velocity or finger flexion). The decoding approaches in these studies usually employed classical classification/regression algorithms that derive a linear mapping between brain signals and outputs. However, they typically only incorporate little prior information about the target movement parameter. In this paper, we incorporate prior knowledge using a Bayesian decoding method, and use it to decode finger flexion from ECoG signals. Specifically, we exploit the constraints that govern finger flexion and incorporate these constraints in the construction, structure, and the probabilistic functions of the prior model of a switched non-parametric dynamic system (SNDS). Given a measurement model resulting from a traditional linear regression method, we decoded finger flexion using posterior estimation that combined the prior and measurement models. Our results show that the application of the Bayesian decoding model, which incorporates prior knowledge, improves decoding performance compared to the application of a linear regression model, which does not incorporate prior knowledge. Thus, the results presented in this paper may ultimately lead to neurally controlled hand prostheses with full fine-grained finger articulation.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/22144944 ER - TY - JOUR T1 - Proceedings of the Second International Workshop on Advances in Electrocorticography. JF - Epilepsy Behav Y1 - 2011 A1 - A L Ritaccio A1 - Boatman-Reich, Dana A1 - Peter Brunner A1 - Cervenka, Mackenzie C A1 - Cole, Andrew J A1 - Nathan E. Crone A1 - Duckrow, Robert A1 - Korzeniewska, Anna A1 - Litt, Brian A1 - Miller, John W A1 - Moran, D A1 - Parvizi, Josef A1 - Viventi, Jonathan A1 - Williams, Justin C A1 - Gerwin Schalk KW - Brain KW - Brain Mapping KW - Brain Waves KW - Diagnosis, Computer-Assisted KW - Electroencephalography KW - Epilepsy KW - Humans KW - United States KW - User-Computer Interface AB -

The Second International Workshop on Advances in Electrocorticography (ECoG) was convened in San Diego, CA, USA, on November 11-12, 2010. Between this meeting and the inaugural 2009 event, a much clearer picture has been emerging of cortical ECoG physiology and its relationship to local field potentials and single-cell recordings. Innovations in material engineering are advancing the goal of a stable long-term recording interface. Continued evolution of ECoG-driven brain-computer interface technology is determining innovation in neuroprosthetics. Improvements in instrumentation and statistical methodologies continue to elucidate ECoG correlates of normal human function as well as the ictal state. This proceedings document summarizes the current status of this rapidly evolving field.

VL - 22 UR - http://www.ncbi.nlm.nih.gov/pubmed/22036287 IS - 4 ER - TY - JOUR T1 - Rapid Communication with a "P300" Matrix Speller Using Electrocorticographic Signals (ECoG). JF - Front Neurosci Y1 - 2011 A1 - Peter Brunner A1 - A L Ritaccio A1 - Emrich, Joseph F A1 - H Bischof A1 - Gerwin Schalk KW - brain-computer interface KW - Electrocorticography KW - event-related potential KW - P300 KW - speller AB -

brain-computer interface (BCI) can provide a non-muscular communication channel to severely disabled people. One particular realization of a BCI is the P300 matrix speller that was originally described by Farwell and Donchin (1988). This speller uses event-related potentials (ERPs) that include the P300 ERP. All previous online studies of the P300 matrix speller used scalp-recorded electroencephalography (EEG) and were limited in their communication performance to only a few characters per minute. In our study, we investigated the feasibility of using electrocorticographic (ECoG) signals for online operation of the matrix speller, and determined associated spelling rates. We used the matrix speller that is implemented in the BCI2000 system. This speller used ECoG signals that were recorded from frontal, parietal, and occipital areas in one subject. This subject spelled a total of 444 characters in online experiments. The results showed that the subject sustained a rate of 17 characters/min (i.e., 69 bits/min), and achieved a peak rate of 22 characters/min (i.e., 113 bits/min). Detailed analysis of the results suggests that ERPs over visual areas (i.e., visual evoked potentials) contribute significantly to the performance of the matrix speller BCI system. Our results also point to potential reasons for the apparent advantages in spelling performance of ECoG compared to EEG. Thus, with additional verification in more subjects, these results may further extend the communication options for people with serious neuromuscular disabilities.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/21369351 ER - TY - Generic T1 - Real-Time Functional Mapping Using ECoG Y1 - 2011 A1 - Gerwin Schalk AB - g.tec ECoG/Spike Workshop, Washington, DC ER - TY - JOUR T1 - Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition. JF - Neuroimage Y1 - 2011 A1 - Pei, Xiao-Mei A1 - Leuthardt, E C A1 - Charles M Gaona A1 - Peter Brunner A1 - Jonathan Wolpaw A1 - Gerwin Schalk KW - Adolescent KW - Adult KW - Brain KW - Brain Mapping KW - Electroencephalography KW - Female KW - Humans KW - Male KW - Middle Aged KW - Signal Processing, Computer-Assisted KW - Verbal Behavior AB -

Language is one of the defining abilities of humans. Many studies have characterized the neural correlates of different aspects of language processing. However, the imaging techniques typically used in these studies were limited in either their temporal or spatial resolution. Electrocorticographic (ECoG) recordings from the surface of the brain combine high spatial with high temporal resolution and thus could be a valuable tool for the study of neural correlates of language function. In this study, we defined the spatiotemporal dynamics of ECoG activity during a word repetition task in nine human subjects. ECoG was recorded while each subject overtly or covertly repeated words that were presented either visually or auditorily. ECoG amplitudes in the high gamma (HG) band confidently tracked neural changes associated with stimulus presentation and with the subject's verbal response. Overt word production was primarily associated with HG changes in the superior and middle parts of temporal lobe, Wernicke's area, the supramarginal gyrus, Broca's area, premotor cortex (PMC), primary motor cortex. Covert word production was primarily associated with HG changes in superior temporal lobe and the supramarginal gyrus. Acoustic processing from both auditory stimuli as well as the subject's own voice resulted in HG power changes in superior temporal lobe and Wernicke's area. In summary, this study represents a comprehensive characterization of overt and covert speech using electrophysiological imaging with high spatial and temporal resolution. It thereby complements the findings of previous neuroimaging studies of language and thus further adds to current understanding of word processing in humans.

VL - 54 UR - http://www.ncbi.nlm.nih.gov/pubmed/21029784 IS - 4 ER - TY - CHAP T1 - State-of-the-Art in BCI Research: BCI Award 2010. T2 - Recent Advances in Brain-Computer Interface Systems Y1 - 2011 A1 - Guger, C A1 - Gerwin Schalk ED - Reza Fazel JF - Recent Advances in Brain-Computer Interface Systems PB - InTech Press UR - http://www.intechopen.com/books/recent-advances-in-brain-computer-interface-systems/state-of-the-art-in-bci-research-bci-award-2010 ER - TY - JOUR T1 - Toward a gaze-independent matrix speller brain-computer interface. JF - Clin Neurophysiol Y1 - 2011 A1 - Peter Brunner A1 - Gerwin Schalk KW - Attention KW - Brain KW - Fixation, Ocular KW - Humans KW - User-Computer Interface VL - 122 UR - http://www.ncbi.nlm.nih.gov/pubmed/21183404 IS - 6 ER - TY - JOUR T1 - Using the electrocorticographic speech network to control a brain-computer interface in humans. JF - J Neural Eng Y1 - 2011 A1 - Leuthardt, E C A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Szrama, Nicholas A1 - Roland, Jarod A1 - Zachary V. Freudenberg A1 - Solisb, Jamie A1 - Breshears, Jonathan A1 - Gerwin Schalk KW - Adult KW - Brain KW - Brain Mapping KW - Computer Peripherals KW - Electroencephalography KW - Evoked Potentials KW - Feedback, Physiological KW - Female KW - Humans KW - Imagination KW - Male KW - Middle Aged KW - Nerve Net KW - Speech Production Measurement KW - User-Computer Interface AB -

Electrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/21471638 IS - 3 ER - TY - Generic T1 - Advanced BCI2000 Concepts Y1 - 2010 A1 - Gerwin Schalk AB - 7th BCI2000 Workshop, Asilomar Conference Center, Monterey, California ER - TY - Generic T1 - A brain-based communication and orientation system Y1 - 2010 A1 - Gerwin Schalk AB - 2010 US Army DDRE MURI Conference in Arlington, VA ER - TY - Generic T1 - Brain-Computer Interfaces: Prospects and Problems Y1 - 2010 A1 - Gerwin Schalk AB - Cog Sci Issues Colloquium, Department of Cognitive Sciences, Rensselaer Polytechnic Institute, Troy, New York ER - TY - JOUR T1 - Brain-computer interfacing based on cognitive control. JF - Ann Neurol Y1 - 2010 A1 - Vansteensel, Mariska J A1 - Hermes, Dora A1 - Aarnoutse, Erik J A1 - Bleichner, Martin G A1 - Gerwin Schalk A1 - van Rijen, Peter C A1 - Leijten, Frans S S A1 - Ramsey, Nick F KW - Cognition KW - Computers KW - Electrodes KW - Electroencephalography KW - Epilepsy KW - Humans KW - Image Processing, Computer-Assisted KW - Magnetic Resonance Imaging KW - Neuropsychological Tests KW - Oxygen KW - Prefrontal Cortex KW - Psychomotor Performance KW - Spectrum Analysis KW - Time Factors KW - User-Computer Interface AB -

OBJECTIVE: 

Brain-computer interfaces (BCIs) translate deliberate intentions and associated changes in brain activity into action, thereby offering patients with severe paralysis an alternative means of communication with and control over their environment. Such systems are not available yet, partly due to the high performance standard that is required. A major challenge in the development of implantable BCIs is to identify cortical regions and related functions that an individual can reliably and consciously manipulate. Research predominantly focuses on the sensorimotor cortex, which can be activated by imagining motor actions. However, because this region may not provide an optimal solution to all patients, other neuronal networks need to be examined. Therefore, we investigated whether the cognitive control network can be used for BCI purposes. We also determined the feasibility of using functional magnetic resonance imaging (fMRI) for noninvasive localization of the cognitive control network.

METHODS: 

Three patients with intractable epilepsy, who were temporarily implanted with subdural grid electrodes for diagnostic purposes, attempted to gain BCI control using the electrocorticographic (ECoG) signal of the left dorsolateral prefrontal cortex (DLPFC).

RESULTS: 

All subjects quickly gained accurate BCI control by modulation of gamma-power of the left DLPFC. Prelocalization of the relevant region was performed with fMRI and was confirmed using the ECoG signals obtained during mental calculation localizer tasks.

INTERPRETATION: 

The results indicate that the cognitive control network is a suitable source of signals for BCI applications. They also demonstrate the feasibility of translating understanding about cognitive networks derived from functional neuroimaging into clinical applications.

VL - 67 UR - http://www.ncbi.nlm.nih.gov/pubmed/20517943 IS - 6 ER - TY - JOUR T1 - Can Electrocorticography (ECoG) Support Robust and Powerful Brain-Computer Interfaces?. JF - Front Neuroeng Y1 - 2010 A1 - Gerwin Schalk VL - 3 UR - http://www.ncbi.nlm.nih.gov/pubmed/20631853 ER - TY - JOUR T1 - Cortical activity during motor execution, motor imagery, and imagery-based online feedback. JF - Proc Natl Acad Sci U S A Y1 - 2010 A1 - Miller, K.J. A1 - Gerwin Schalk A1 - Fetz, Eberhard E A1 - den Nijs, Marcel A1 - Ojemann, J G A1 - Rao, Rajesh P N KW - Adolescent KW - Adult KW - Biofeedback, Psychology KW - Cerebral Cortex KW - Child KW - Electric Stimulation KW - Electrocardiography KW - Female KW - Humans KW - Male KW - Middle Aged KW - Motor Activity KW - Young Adult AB -

Imagery of motor movement plays an important role in learning of complex motor skills, from learning to serve in tennis to perfecting a pirouette in ballet. What and where are the neural substrates that underlie motor imagery-based learning? We measured electrocorticographic cortical surface potentials in eight human subjects during overt action and kinesthetic imagery of the same movement, focusing on power in "high frequency" (76-100 Hz) and "low frequency" (8-32 Hz) ranges. We quantitatively establish that the spatial distribution of local neuronal population activity during motor imagery mimics the spatial distribution of activity during actual motor movement. By comparing responses to electrocortical stimulation with imagery-induced cortical surface activity, we demonstrate the role of primary motor areas in movement imagery. The magnitude of imagery-induced cortical activity change was approximately 25% of that associated with actual movement. However, when subjects learned to use this imagery to control a computer cursor in a simple feedback task, the imagery-induced activity change was significantly augmented, even exceeding that of overt movement.

VL - 107 UR - http://www.ncbi.nlm.nih.gov/pubmed/20160084 IS - 9 ER - TY - Generic T1 - Decoding finger flexion from electrocorticographic signals using sparse Gaussian process. T2 - International Conference on Pattern Recognition - ICPR Y1 - 2010 A1 - Zuoguan Wang A1 - Ji, Q A1 - Kai J. Miller A1 - Gerwin Schalk AB - A brain-computer interface (BCI) creates a direct communication pathway between the brain and an external device, and can thereby restore function in people with severe motor disabilities. A core component in a BCI system is the decoding algorithm that translates brain signals into action commands of an output device. Most of current decoding algorithms are based on linear models (e.g., derived using linear regression) that may have important shortcomings. The use of nonlinear models (e.g., neural networks) could overcome some of these shortcomings, but has difficulties with high dimensional feature spaces. Here we propose another decoding algorithm that is based on the sparse gaussian process with pseudo-inputs (SPGP). As a nonparametric method, it can model more complex relationships compared to linear methods. As a kernel method, it can readily deal with high dimensional feature space. The evaluations shown in this paper demonstrate that SPGP can decode the flexion of finger movements from electrocorticographic (ECoG) signals more accurately than a previously described algorithm that used a linear model. In addition, by formulating problems in the bayesian probabilistic framework, SPGP can provide estimation of the prediction uncertainty. Furthermore, the trained SPGP offers a very effective way for identifying important features. JF - International Conference on Pattern Recognition - ICPR ER - TY - JOUR T1 - Does the 'P300' speller depend on eye gaze?. JF - J Neural Eng Y1 - 2010 A1 - Peter Brunner A1 - Joshi, S A1 - S Briskin A1 - Jonathan Wolpaw A1 - H Bischof A1 - Gerwin Schalk KW - Adult KW - Event-Related Potentials, P300 KW - Eye Movements KW - Female KW - Humans KW - Male KW - Middle Aged KW - Models, Neurological KW - Photic Stimulation KW - User-Computer Interface KW - Young Adult AB -

Many people affected by debilitating neuromuscular disorders such as amyotrophic lateral sclerosis, brainstem stroke or spinal cord injury are impaired in their ability to, or are even unable to, communicate. A brain-computer interface (BCI) uses brain signals, rather than muscles, to re-establish communication with the outside world. One particular BCI approach is the so-called 'P300 matrix speller' that was first described by Farwell and Donchin (1988 Electroencephalogr. Clin. Neurophysiol. 70 510-23). It has been widely assumed that this method does not depend on the ability to focus on the desired character, because it was thought that it relies primarily on the P300-evoked potential and minimally, if at all, on other EEG features such as the visual-evoked potential (VEP). This issue is highly relevant for the clinical application of this BCI method, because eye movements may be impaired or lost in the relevant user population. This study investigated the extent to which the performance in a 'P300' speller BCI depends on eye gaze. We evaluated the performance of 17 healthy subjects using a 'P300' matrix speller under two conditions. Under one condition ('letter'), the subjects focused their eye gaze on the intended letter, while under the second condition ('center'), the subjects focused their eye gaze on a fixation cross that was located in the center of the matrix. The results show that the performance of the 'P300' matrix speller in normal subjects depends in considerable measure on gaze direction. They thereby disprove a widespread assumption in BCI research, and suggest that this BCI might function more effectively for people who retain some eye-movement control. The applicability of these findings to people with severe neuromuscular disabilities (particularly in eye-movements) remains to be determined.

VL - 7 UR - http://www.ncbi.nlm.nih.gov/pubmed/20858924 IS - 5 ER - TY - JOUR T1 - Electrocorticographic frequency alteration mapping for extraoperative localization of speech cortex. JF - Neurosurgery Y1 - 2010 A1 - Wu, Melinda A1 - Wisneski, Kimberly A1 - Gerwin Schalk A1 - Sharma, Mohit A1 - Roland, Jarod A1 - Breshears, Jonathan A1 - Charles M Gaona A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Chi-Square Distribution KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Mass Spectrometry KW - Middle Aged KW - Photic Stimulation KW - Speech KW - Verbal Behavior KW - Young Adult AB -

OBJECTIVE: 

Electrocortical stimulation (ECS) has long been established for delineating eloquent cortex in extraoperative mapping. However, ECS is still coarse and inefficient in delineating regions of functional cortex and can be hampered by afterdischarges. Given these constraints, an adjunct approach to defining motor cortex is the use of electrocorticographic (ECoG) signal changes associated with active regions of cortex. The broad range of frequency oscillations are categorized into 2 main groups with respect to sensorimotor cortex: low-frequency bands (LFBs) and high-frequency bands (HFBs). The LFBs tend to show a power reduction, whereas the HFBs show power increases with cortical activation. These power changes associated with activated cortex could potentially provide a powerful tool in delineating areas of speech cortex. We explore ECoG signal alterations as they occur with activated region of speech cortex and its potential in clinical brain mapping applications.

METHODS: 

We evaluated 7 patients who underwent invasive monitoring for seizure localization. Each had extraoperative ECS mapping to identify speech cortex. Additionally, all subjects performed overt speech tasks with an auditory or a visual cue to identify associated frequency power changes in regard to location and degree of concordance with ECS results.

RESULTS: 

Electrocorticographic frequency alteration mapping (EFAM) had an 83.9% sensitivity and a 40.4% specificity in identifying any language site when considering both frequency bands and both stimulus cues. Electrocorticographic frequency alteration mapping was more sensitive in identifying the Wernicke area (100%) than the Broca area (72.2%). The HFB is uniquely suited to identifying the Wernicke area, whereas a combination of the HFB and LFB is important for Broca localization.

CONCLUSION: 

The concordance between stimulation and spectral power changes demonstrates the possible utility of EFAM as an adjunct method to improve the efficiency and resolution of identifying speech cortex.

VL - 66 UR - http://www.ncbi.nlm.nih.gov/pubmed/20087111 IS - 2 ER - TY - Generic T1 - Emerging Opportunities in Neuroengineering Y1 - 2010 A1 - Gerwin Schalk AB - Department of Electrical Engineering and Computer Science, Technical University of Berlin, Berlin, Germany ER - TY - Generic T1 - Emerging Opportunities in Neuroengineering Y1 - 2010 A1 - Gerwin Schalk AB - Graduate School of Biomedical Engineering, The University of New South Wales, Sydney, Australia ER - TY - Generic T1 - Encoding of Perception and Cognition in Human Electrocorticographic Signals Y1 - 2010 A1 - Gerwin Schalk AB - Keynote Address, Bernstein Conference on Computational Neuroscience, Berlin, Germany ER - TY - Generic T1 - Exciting Directions in Human Electrocorticography Y1 - 2010 A1 - Gerwin Schalk AB - University of California San Francisco Medical School, San Francisco, California ER - TY - Generic T1 - Exciting Directions in Human Electrocorticography Y1 - 2010 A1 - Gerwin Schalk AB - Small Scale Systems and Integration and Packaging Center's Seminar Series, Binghamton University, Binghamton, New York ER - TY - Generic T1 - Exciting Directions in Neuroscience and Neuroengineering Y1 - 2010 A1 - Gerwin Schalk AB - Department of Physical Therapy and Human Movement Sciences, Northwestern University, Feinberg School of Medicine, Chicago, IL ER - TY - Generic T1 - Inferring Detailed Aspects of COgnition Using Electrocorticographic (ECoG) Signals in Humans Y1 - 2010 A1 - Gerwin Schalk AB - Seattle Children's Research Institute, Seattle, WA ER - TY - Generic T1 - Introduction to BCI2000 Y1 - 2010 A1 - Gerwin Schalk AB - 7th BCI2000 Workshop, Asilomar Conference Center, Monterey, California ER - TY - Generic T1 - Neuroscience and Brain-Computer Interface Research Using Signals Recorded from the Surface of the Brain Y1 - 2010 A1 - Gerwin Schalk AB - Hudson Valley-Berkshire Chapter of the Society for Neuroscience, Albany, New York ER - TY - Generic T1 - Novel Methods and Applications in Brain-Computer Interface Research Y1 - 2010 A1 - Gerwin Schalk AB - U.S. Army Research Laboratory, Aberdeen Proving Ground, Aberdeen MD ER - TY - JOUR T1 - Passive real-time identification of speech and motor cortex during an awake craniotomy. JF - Epilepsy Behav Y1 - 2010 A1 - Roland, Jarod A1 - Peter Brunner A1 - Johnston, James A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Brain Mapping KW - Brain Neoplasms KW - Cerebral Cortex KW - Craniotomy KW - Electric Stimulation KW - Electroencephalography KW - Humans KW - Neurologic Examination AB -

Precise localization of eloquent cortex is a clinical necessity prior to surgical resections adjacent to speech or motor cortex. In the intraoperative setting, this traditionally requires inducing temporary lesions by direct electrocortical stimulation (DECS). In an attempt to increase efficiency and potentially reduce the amount of necessary stimulation, we used a passive mapping procedure in the setting of an awake craniotomy for tumor in two patients resection. We recorded electrocorticographic (ECoG) signals from exposed cortex while patients performed simple cue-directed motor and speech tasks. SIGFRIED, a procedure for real-time event detection, was used to identify areas of cortical activation by detecting task-related modulations in the ECoG high gamma band. SIGFRIED's real-time output quickly localized motor and speech areas of cortex similar to those identified by DECS. In conclusion, real-time passive identification of cortical function using SIGFRIED may serve as a useful adjunct to cortical stimulation mapping in the intraoperative setting.

VL - 18 UR - http://www.ncbi.nlm.nih.gov/pubmed/20478745 IS - 1-2 ER - TY - BOOK T1 - A Practical Guide to Brain-Computer Interfacing with BCI2000. Y1 - 2010 A1 - Gerwin Schalk A1 - Mellinger, Jürgen PB - Springer London Dordrecht Heidelberg New York UR - http://link.springer.com/book/10.1007%2F978-1-84996-092-2 ER - TY - JOUR T1 - A procedure for measuring latencies in brain-computer interfaces. JF - IEEE Trans Biomed Eng Y1 - 2010 A1 - Adam J Wilson A1 - Mellinger, Jürgen A1 - Gerwin Schalk A1 - Williams, Justin C KW - Brain KW - Computer Systems KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Models, Neurological KW - Reproducibility of Results KW - Signal Processing, Computer-Assisted KW - Time Factors KW - User-Computer Interface AB -

Brain-computer interface (BCI) systems must process neural signals with consistent timing in order to support adequate system performance. Thus, it is important to have the capability to determine whether a particular BCI configuration (i.e., hardware and software) provides adequate timing performance for a particular experiment. This report presents a method of measuring and quantifying different aspects of system timing in several typical BCI experiments across a range of settings, and presents comprehensive measures of expected overall system latency for each experimental configuration.

VL - 57 UR - http://www.ncbi.nlm.nih.gov/pubmed/20403781 IS - 7 ER - TY - JOUR T1 - Proceedings of the first international workshop on advances in electrocorticography. JF - Epilepsy Behav Y1 - 2010 A1 - A L Ritaccio A1 - Peter Brunner A1 - Cervenka, Mackenzie C A1 - Nathan E. Crone A1 - Guger, C A1 - Leuthardt, E C A1 - Oostenveld, Robert A1 - Stacey, William A1 - Gerwin Schalk KW - Brain KW - Brain Mapping KW - Diagnosis, Computer-Assisted KW - Electroencephalography KW - Humans KW - International Cooperation KW - Seizures KW - Signal Detection, Psychological AB -

In October 2009, a group of neurologists, neurosurgeons, computational neuroscientists, and engineers congregated to present novel developments transforming human electrocorticography (ECoG) beyond its established relevance in clinical epileptology. The contents of the proceedings advanced the role of ECoG in seizure detection and prediction, neurobehavioral research, functional mapping, and brain-computer interface technology. The meeting established the foundation for future work on the methodology and application of surface brain recordings.

VL - 19 UR - http://www.ncbi.nlm.nih.gov/pubmed/20889384 IS - 3 ER - TY - Generic T1 - Real-Time Functional Mapping Using Electrocorticographic Signals Y1 - 2010 A1 - Gerwin Schalk AB - Department of Neurology, Seattle Children's Hospital, Seattle, WA ER - TY - Generic T1 - Toward Brain-Computer Symbiosis Y1 - 2010 A1 - Gerwin Schalk AB - Keynote Address, X-Prize Workshop on Brain-Computer Interfaces, MIT Campus, Cambridge, MA ER - TY - CHAP T1 - Using BCI2000 for HCI-Centered BCI Research. T2 - Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction Y1 - 2010 A1 - Adam J Wilson A1 - Gerwin Schalk ED - A. Nijholt ED - D. Tan AB - BCI2000 is a general-purpose software suite designed for brain-computer interface (BCI) and related research. BCI2000 has been in development since 2000 and is currently used in close to 500 laboratories around the world. BCI2000 can provide stimulus presentation while simultaneously recording brain signals and subject responses from a number of data acquisition and input devices, respectively. Furthermore, BCI2000 provides a number of services (such as a generic data format that can accommodate any hardware or experimental setup) that can greatly facilitate research. In summary, BCI2000 is ideally suited to support investigations in the area of human-computer interfaces (HCI), in particular those that include recording and processing of brain signals. This chapter provides an overview of the BCI2000 system, and gives examples of its utility for HCI research. JF - Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction PB - Springer London UR - http://link.springer.com/chapter/10.1007%2F978-1-84996-272-8_15 ER - TY - CHAP T1 - Using BCI2000 in BCI Research. T2 - Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction Y1 - 2010 A1 - Mellinger, Jürgen A1 - Gerwin Schalk ED - Graimann, Bernhard ED - Pfurtscheller, Gert ED - Brendan Z. Allison AB -

BCI2000 is a general-purpose system for brain–computer interface (BCI) research. It can also be used for data acquisition, stimulus presentation, and brain monitoring applications [18,27]. The mission of the BCI2000 project is to facilitate research and applications in these areas. BCI2000 has been in development since 2000 in a collaboration between the Wadsworth Center of the New York State Department of Health in Albany, New York, and the Institute of Medical Psychology and Behavioral Neurobiology at the University of Tübingen, Germany. Many other individuals at different institutions world-wide have contributed to this project.

JF - Brain-Computer Interfaces: Revolutionizing Human-Computer Interaction T3 - The Frontiers Collection PB - Springer Berlin Heidelberg UR - http://dx.doi.org/10.1007/978-3-642-02091-9_15 ER - TY - Generic T1 - Using Neuroscience and Neuroengineering to Augment Human Performance Y1 - 2010 A1 - Gerwin Schalk AB - Topical Panel on Neuroscience, 27th Army Science Conference Orlando, FL ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2009 A1 - Gerwin Schalk AB - Tutorial T02: Brain-Computer Interface, HCI International, San Diego, California ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2009 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, Society for Neuroscience Annual Meeting, Chicago, IL ER - TY - Generic T1 - The BCI2000 Framework Y1 - 2009 A1 - Gerwin Schalk AB - 5th BCI2000 Workshop, The Sagamore Conference Center, Bolton Landing, new York ER - TY - Generic T1 - Brain-Computer Interaction Y1 - 2009 A1 - Gerwin Schalk AB - Session Applications and Challenges in Neurally-Driven System Interfaces, Intl. Conference on Augmented Cognition, San Diego, California ER - TY - CONF T1 - Brain-Computer Interaction. T2 - 5th Intl. Conference on Augmented Cognition Y1 - 2009 A1 - Peter Brunner A1 - Gerwin Schalk KW - BCI KW - brain-computer interface KW - neural engineering KW - neural prosthesis AB -

Detection and automated interpretation of attention-related or intention-related brain activity carries significant promise for many military and civilian applications. This interpretation of brain activity could provide information about a person’s intended movements, imagined movements, or attentional focus, and thus could be valuable for optimizing or replacing traditional motor-based communication between a person and a computer or other output devices. We describe here the objective and preliminary results of our studies in this area.

JF - 5th Intl. Conference on Augmented Cognition PB - Springer SN - 978-3-642-02811-3 UR - http://link.springer.com/chapter/10.1007%2F978-3-642-02812-0_81 ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2009 A1 - Gerwin Schalk AB - Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2009 A1 - Gerwin Schalk AB - Beijing BCI20009 Symposium, Tsinghua University, Beijing, China ER - TY - Generic T1 - Brain-Computer Interfacing Using P300 Evoked Potentials Y1 - 2009 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interfaces, Departments of Neurosurgery/Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania ER - TY - Generic T1 - Brain-COmputer Interfacing Using P300 Evoked Potentials Y1 - 2009 A1 - Gerwin Schalk AB - Guest lecture in course Brain-Computer Interface Systems, Department of Cognitive Sciences, University of California San Diego, La Jolla, California ER - TY - JOUR T1 - Decoding flexion of individual fingers using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2009 A1 - Kubánek, J A1 - Miller, John W A1 - Ojemann, J G A1 - Jonathan Wolpaw A1 - Gerwin Schalk KW - Adolescent KW - Adult KW - Biomechanics KW - Brain KW - Electrodiagnosis KW - Epilepsy KW - Female KW - Fingers KW - Humans KW - Male KW - Microelectrodes KW - Middle Aged KW - Motor Activity KW - Rest KW - Thumb KW - Time Factors KW - Young Adult AB -

Brain signals can provide the basis for a non-muscular communication and control system, a brain-computer interface (BCI), for people with motor disabilities. A common approach to creating BCI devices is to decode kinematic parameters of movements using signals recorded by intracortical microelectrodes. Recent studies have shown that kinematic parameters of hand movements can also be accurately decoded from signals recorded by electrodes placed on the surface of the brain (electrocorticography (ECoG)). In the present study, we extend these results by demonstrating that it is also possible to decode the time course of the flexion of individual fingers using ECoG signals in humans, and by showing that these flexion time courses are highly specific to the moving finger. These results provide additional support for the hypothesis that ECoG could be the basis for powerful clinically practical BCI systems, and also indicate that ECoG is useful for studying cortical dynamics related to motor function.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/19794237 IS - 6 ER - TY - Generic T1 - Detecting Detailed Aspects of Behavior in ECoG Signals Y1 - 2009 A1 - Gerwin Schalk AB - International Workshop on Advances in Electrocorticography, Bolton Landing, New York ER - TY - Generic T1 - Detection of spontaneous class-specific visual stimuli with high temporal accuracy in human electrocorticography. T2 - Conf Proc IEEE Eng Med Biol Soc Y1 - 2009 A1 - Miller, John W A1 - Hermes, Dora A1 - Gerwin Schalk A1 - Ramsey, Nick F A1 - Jagadeesh, Bharathi A1 - den Nijs, Marcel A1 - Ojemann, J G A1 - Rao, Rajesh P N KW - Algorithms KW - Electrocardiography KW - Evoked Potentials, Visual KW - Humans KW - Male KW - Pattern Recognition, Automated KW - Pattern Recognition, Visual KW - Photic Stimulation KW - Reproducibility of Results KW - Sensitivity and Specificity KW - User-Computer Interface KW - Visual Cortex AB - Most brain-computer interface classification experiments from electrical potential recordings have been focused on the identification of classes of stimuli or behavior where the timing of experimental parameters is known or pre-designated. Real world experience, however, is spontaneous, and to this end we describe an experiment predicting the occurrence, timing, and types of visual stimuli perceived by a human subject from electrocorticographic recordings. All 300 of 300 presented stimuli were correctly detected, with a temporal precision of order 20 ms. The type of stimulus (face/house) was correctly identified in 95% of these cases. There were approximately 20 false alarm events, corresponding to a late 2nd neuronal response to a previously identified event. JF - Conf Proc IEEE Eng Med Biol Soc VL - 2009 ER - TY - Generic T1 - EEG/ECoG-based BCIs for People with Little or No Motor Function Y1 - 2009 A1 - Gerwin Schalk AB - Seminar Brain-Computer Interfaces: Frontiers in Neurology and Neuroscience, American Academy of Neurology Meeting, Seattle, Washington ER - TY - Generic T1 - Effective brain-computer interfacing using BCI2000. T2 - Conf Proc IEEE Eng Med Biol Soc Y1 - 2009 A1 - Gerwin Schalk KW - Algorithms KW - Brain KW - Electrocardiography KW - Equipment Design KW - Equipment Failure Analysis KW - Rehabilitation KW - Reproducibility of Results KW - Sensitivity and Specificity KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB - To facilitate research and development in Brain-Computer Interface (BCI) research, we have been developing a general-purpose BCI system, called BCI2000, over the past nine years. This system has enjoyed a growing adoption in BCI and related areas and has been the basis for some of the most impressive studies reported to date. This paper gives an update on the status of this project by describing the principles of the BCI2000 system, its benefits, and impact on the field to date. JF - Conf Proc IEEE Eng Med Biol Soc VL - 2009 ER - TY - Generic T1 - Effective Brain-Computer Interfacing Using BCI2000 Y1 - 2009 A1 - Gerwin Schalk AB - Session Brain-Machine Interface I, 31st Annual International IEEE EMBS Conference, Minneapolis, Minnesota ER - TY - Generic T1 - Emerging Opportunities in Neuroengineering Y1 - 2009 A1 - Gerwin Schalk AB - University of Pennsylvania, Philadelphia, Pennsylvania ER - TY - Generic T1 - Engineering the Future in Biomedicine: Using Brain Signals for Communication and Diagnosis Y1 - 2009 A1 - Gerwin Schalk AB - IEEE Schenectady Section, Niskayuna, New York ER - TY - JOUR T1 - Evolution of brain-computer interfaces: going beyond classic motor physiology. JF - Neurosurg Focus Y1 - 2009 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Roland, Jarod A1 - Rouse, Adam A1 - Moran, D KW - Brain KW - Cerebral Cortex KW - Humans KW - Man-Machine Systems KW - Motor Cortex KW - Movement KW - Movement Disorders KW - Neuronal Plasticity KW - Prostheses and Implants KW - Research KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB -

The notion that a computer can decode brain signals to infer the intentions of a human and then enact those intentions directly through a machine is becoming a realistic technical possibility. These types of devices are known as brain-computer interfaces (BCIs). The evolution of these neuroprosthetic technologies could have significant implications for patients with motor disabilities by enhancing their ability to interact and communicate with their environment. The cortical physiology most investigated and used for device control has been brain signals from the primary motor cortex. To date, this classic motor physiology has been an effective substrate for demonstrating the potential efficacy of BCI-based control. However, emerging research now stands to further enhance our understanding of the cortical physiology underpinning human intent and provide further signals for more complex brain-derived control. In this review, the authors report the current status of BCIs and detail the emerging research trends that stand to augment clinical applications in the future.

VL - 27 UR - http://www.ncbi.nlm.nih.gov/pubmed/19569892 IS - 1 ER - TY - Generic T1 - Introduction to BCI2000 Y1 - 2009 A1 - Gerwin Schalk AB - 6th BCI2000 Workshop, Tsinghua University, Beijing, China ER - TY - Generic T1 - Overview of Available BCI2000 Components Y1 - 2009 A1 - Gerwin Schalk AB - 5th BCI2000 Workshop, The Sagamore Conference Center, Bolton Landing, New York ER - TY - JOUR T1 - A practical procedure for real-time functional mapping of eloquent cortex using electrocorticographic signals in humans. JF - Epilepsy Behav Y1 - 2009 A1 - Peter Brunner A1 - A L Ritaccio A1 - Lynch, Timothy M A1 - Emrich, Joseph F A1 - Adam J Wilson A1 - Williams, Justin C A1 - Aarnoutse, Erik J A1 - Ramsey, Nick F A1 - Leuthardt, E C A1 - H Bischof A1 - Gerwin Schalk KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Electric Stimulation KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Middle Aged KW - Practice Guidelines as Topic KW - Signal Processing, Computer-Assisted KW - Young Adult AB -

Functional mapping of eloquent cortex is often necessary prior to invasive brain surgery, but current techniques that derive this mapping have important limitations. In this article, we demonstrate the first comprehensive evaluation of a rapid, robust, and practical mapping system that uses passive recordings of electrocorticographic signals. This mapping procedure is based on the BCI2000 and SIGFRIED technologies that we have been developing over the past several years. In our study, we evaluated 10 patients with epilepsy from four different institutions and compared the results of our procedure with the results derived using electrical cortical stimulation (ECS) mapping. The results show that our procedure derives a functional motor cortical map in only a few minutes. They also show a substantial concurrence with the results derived using ECS mapping. Specifically, compared with ECS maps, a next-neighbor evaluation showed no false negatives, and only 0.46 and 1.10% false positives for hand and tongue maps, respectively. In summary, we demonstrate the first comprehensive evaluation of a practical and robust mapping procedure that could become a new tool for planning of invasive brain surgeries.

VL - 15 UR - http://www.ncbi.nlm.nih.gov/pubmed/19366638 IS - 3 ER - TY - Generic T1 - Real-Time Data Acquisition, Signal Processing, and Stimulus Presentation Using BCI2000 Y1 - 2009 A1 - Gerwin Schalk AB - Workshop Neural Engineering in Real Time, Pittsburgh, Pennsylvania ER - TY - Generic T1 - Real-Time Functional Mapping Using Electrocorticographic Signals Y1 - 2009 A1 - Gerwin Schalk AB - Clinical Neurophysiology Research Seminar, Langone Medical Center, New York University, New York, New York ER - TY - Generic T1 - Research and Clinical Application of Electrocorticographic Signals in Humans Y1 - 2009 A1 - Gerwin Schalk AB - Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA ER - TY - Generic T1 - Sensor Modalities for Brain-Computer Interfacing T2 - 13th Intl. Conference on Human-Computer Interaction Y1 - 2009 A1 - Gerwin Schalk AB - Many people have neuromuscular conditions or disorders that impair the neural pathways that control muscles. Those most severely affected lose all voluntary muscle control and hence lose the ability to communicate. Brain-computer interfaces (BCIs) might be able to restore some communication or control functions for these people by creating a new communication channel – directly from the brain to an output device. Many studies over the past two decades have shown that such BCI communication is possible and that it can serve useful functions. This paper reviews the different sensor methodologies that have been explored in these studies. JF - 13th Intl. Conference on Human-Computer Interaction PB - Springer VL - 5611 ER - TY - Generic T1 - Sensor Modalities for Brain-Computer Interfacing Y1 - 2009 A1 - Gerwin Schalk AB - Session Brain-Computer Interface (BCI); Towards Understanding Neural Bases of Human-Computer Interaction, HCI International, San Diego, California ER - TY - Generic T1 - Technical Basis for Real-Time Functional Mapping of Eloquent Cortex Y1 - 2009 A1 - Gerwin Schalk AB - Department of Neurology, Weill Cornell Medical Center, New York City, New York ER - TY - Generic T1 - Theory and Application of Electrocorticographic (ECoG) Signals in Humans Y1 - 2009 A1 - Gerwin Schalk AB - Invited 1.5 hour tutorial, BBCI Workshop 2009, Advances in Neurotechnology, Berlin, Germany ER - TY - JOUR T1 - Using an EEG-based brain-computer interface for virtual cursor movement with BCI2000. JF - J Vis Exp Y1 - 2009 A1 - Adam J Wilson A1 - Gerwin Schalk A1 - Walton, Léo M A1 - Williams, Justin C KW - Brain KW - Calibration KW - Electrodes KW - Electroencephalography KW - Humans KW - User-Computer Interface AB -

A brain-computer interface (BCI) functions by translating a neural signal, such as the electroencephalogram (EEG), into a signal that can be used to control a computer or other device. The amplitude of the EEG signals in selected frequency bins are measured and translated into a device command, in this case the horizontal and vertical velocity of a computer cursor. First, the EEG electrodes are applied to the user s scalp using a cap to record brain activity. Next, a calibration procedure is used to find the EEG electrodes and features that the user will learn to voluntarily modulate to use the BCI. In humans, the power in the mu (8-12 Hz) and beta (18-28 Hz) frequency bands decrease in amplitude during a real or imagined movement. These changes can be detected in the EEG in real-time, and used to control a BCI ([1],[2]). Therefore, during a screening test, the user is asked to make several different imagined movements with their hands and feet to determine the unique EEG features that change with the imagined movements. The results from this calibration will show the best channels to use, which are configured so that amplitude changes in the mu and beta frequency bands move the cursor either horizontally or vertically. In this experiment, the general purpose BCI system BCI2000 is used to control signal acquisition, signal processing, and feedback to the user [3].

UR - http://www.ncbi.nlm.nih.gov/pubmed/19641479 IS - 29 ER - TY - Generic T1 - Using Electrocorticographic (ECoG) Signals in Humans for Communication and Diagnosis Y1 - 2009 A1 - Gerwin Schalk AB - University of Pennsylvania, Philadelphia, Pennsylvania ER - TY - Generic T1 - Using Subdural Signals in Humans for Communication and Diagnosis Y1 - 2009 A1 - Gerwin Schalk AB - Epilepsy Research Program, Georgetown University, Washington, DC. ER - TY - JOUR T1 - Advanced neurotechnologies for chronic neural interfaces: new horizons and clinical opportunities. JF - J Neurosci Y1 - 2008 A1 - Kipke, Daryl R A1 - Shain, William A1 - Buzsáki, György A1 - Fetz, Eberhard E A1 - Henderson, Jaimie M A1 - Hetke, Jamille F A1 - Gerwin Schalk KW - Cerebral Cortex KW - Electrodes, Implanted KW - Electroencephalography KW - Electronics, Medical KW - Electrophysiology KW - Evoked Potentials KW - Movement Disorders KW - Neurons KW - Prostheses and Implants KW - User-Computer Interface VL - 28 UR - http://www.ncbi.nlm.nih.gov/pubmed/19005048?report=abstract IS - 46 ER - TY - Generic T1 - BCI2000: A General-Purpose BCI System and its Application to ECoG Signals Y1 - 2008 A1 - Gerwin Schalk AB - g.tec Brain-Computer Interface Workshop, Society for Neuroscience Annual Meeting, Washington, DC ER - TY - Generic T1 - BCI2000: A General-Purpose Brain-Computer Interface System Y1 - 2008 A1 - Gerwin Schalk AB - 4th BCI2000 Workshop, Utrecht, The Netherlands ER - TY - Generic T1 - The BCI2000 Framework Y1 - 2008 A1 - Gerwin Schalk AB - 4th BCI2000 Workshop, Utrecht, The Netherlands ER - TY - Generic T1 - Brain-Based Communication and Orientation Y1 - 2008 A1 - Gerwin Schalk AB - Multi-disciplinary University Research Initiative sponsored by the US Army Research Office. University of Maryland College Park, College Park, Maryland. ER - TY - JOUR T1 - Brain-computer interfaces (BCIs): Detection Instead of Classification. JF - J Neurosci Methods Y1 - 2008 A1 - Gerwin Schalk A1 - Peter Brunner A1 - Lester A Gerhardt A1 - H Bischof A1 - Jonathan Wolpaw KW - Adult KW - Algorithms KW - Brain KW - Brain Mapping KW - Electrocardiography KW - Electroencephalography KW - Humans KW - Male KW - Man-Machine Systems KW - Normal Distribution KW - Online Systems KW - Signal Detection, Psychological KW - Signal Processing, Computer-Assisted KW - Software Validation KW - User-Computer Interface AB -

Many studies over the past two decades have shown that people can use brain signals to convey their intent to a computer through brain-computer interfaces (BCIs). These devices operate by recording signals from the brain and translating these signals into device commands. They can be used by people who are severely paralyzed to communicate without any use of muscle activity. One of the major impediments in translating this novel technology into clinical applications is the current requirement for preliminary analyses to identify the brain signal features best suited for communication. This paper introduces and validates signal detection, which does not require such analysis procedures, as a new concept in BCI signal processing. This detection concept is realized with Gaussian mixture models (GMMs) that are used to model resting brain activity so that any change in relevant brain signals can be detected. It is implemented in a package called SIGFRIED (SIGnal modeling For Real-time Identification and Event Detection). The results indicate that SIGFRIED produces results that are within the range of those achieved using a common analysis strategy that requires preliminary identification of signal features. They indicate that such laborious analysis procedures could be replaced by merely recording brain signals during rest. In summary, this paper demonstrates how SIGFRIED could be used to overcome one of the present impediments to translation of laboratory BCI demonstrations into clinically practical applications.

VL - 167 UR - http://www.ncbi.nlm.nih.gov/pubmed/17920134 IS - 1 ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography and Electrocorticography Y1 - 2008 A1 - Gerwin Schalk AB - EuroNeuro (European Congress on Neurology, Neurosurgery, Intensive Care and Anesthesiology), Maastricht, The Netherlands ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2008 A1 - Gerwin Schalk AB - Bernstein Seminar, Bernstein Center for Computation Neuroscience, Albert-Ludwigs-Universitaet Freiburg, Freiburg, Germany ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2008 A1 - Gerwin Schalk AB - Institute for Automation, University of Bremen, Bremen, Germany ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2008 A1 - Gerwin Schalk AB - University of Pittsburgh, Pittsburgh, Pennsylvania ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2008 A1 - Gerwin Schalk AB - MEG Center, Eberhard Karls University of Tübingen, Tübingen, Germany ER - TY - Generic T1 - Brain-Computer Interfacing Using Non-Invasive and Invasive Methods Y1 - 2008 A1 - Gerwin Schalk AB - Workshop Brain-Computer Interfacing in 2008, Utrecht, The Netherlands ER - TY - Generic T1 - Brain-Computer Interfacing Using Non-Invasive and Invasive Methods Y1 - 2008 A1 - Gerwin Schalk AB - Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria ER - TY - JOUR T1 - Brain-computer symbiosis. JF - J Neural Eng Y1 - 2008 A1 - Gerwin Schalk KW - Brain KW - Computers KW - Humans KW - User-Computer Interface AB -

The theoretical groundwork of the 1930s and 1940s and the technical advance of computers in the following decades provided the basis for dramatic increases in human efficiency. While computers continue to evolve, and we can still expect increasing benefits from their use, the interface between humans and computers has begun to present a serious impediment to full realization of the potential payoff. This paper is about the theoretical and practical possibility that direct communication between the brain and the computer can be used to overcome this impediment by improving or augmenting conventional forms of human communication. It is about the opportunity that the limitations of our body's input and output capacities can be overcome using direct interaction with the brain, and it discusses the assumptions, possible limitations and implications of a technology that I anticipate will be a major source of pervasive changes in the coming decades.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/18310804 IS - 1 ER - TY - Generic T1 - Combining Fidelity With Practicality: Interrogation of the Brain Using Electrocorticography (ECoG) Y1 - 2008 A1 - Gerwin Schalk AB - Symposium Advanced Neurotechnologies for Chronic Neural Interfaces: New Horizons and Clinical Opportunities, Society for Neuroscience Annual Meeting, Washington, DC ER - TY - Generic T1 - Decoding Detailed Information fromt he Brain Using Electrocorticographic (ECoG) Signals in Humans Y1 - 2008 A1 - Gerwin Schalk AB - Lecture in Workshop on Research Efforts and Future Directions in Neuroergonamics and Neuromorphics sponsored by the US Army Research Office. University of Maryland Colelge Park, College Park, Maryland ER - TY - Generic T1 - A Device For Real-Time Functional Mapping Using ECoG Y1 - 2008 A1 - Gerwin Schalk AB - CIMIT Epilepsy Innovation Summit, Boston, Massachusetts ER - TY - Generic T1 - Direct Interaction With The Brain Y1 - 2008 A1 - Gerwin Schalk AB - Guest lecture in Information Technology Capstone Course, Department of Information Technology, Rensselaer Polytechnic Institute, Troy, New York, 11/24/2008 ER - TY - Generic T1 - Direct Interaction With The Brain Y1 - 2008 A1 - Gerwin Schalk AB - Guest lecture in Business Issues for Engineers and Scientists, Department of Information Technology, Rensselaer Polytechnic Institute, Troy, New York ER - TY - CHAP T1 - General Clinical Issues Relevant to Brain-Computer Interfaces. T2 - Neuroengineering Y1 - 2008 A1 - Leuthardt, E C A1 - Ojemann, J G A1 - Gerwin Schalk A1 - Moran, D ED - Daniel DiLorenzo JF - Neuroengineering PB - Taylor and Francis Group CY - Boca Raton ER - TY - Generic T1 - Inferring Details of Motor/Language Function Using ECoG Signals in Humans Y1 - 2008 A1 - Gerwin Schalk AB - Workshop Advances in Theory and Clinical Application of Subdural Recordings, American Epilepsy Society Annual Meeting, Seattle, Washington ER - TY - Generic T1 - Movement Control Using Field Potentials Recorded on the Surface of the Brain Y1 - 2008 A1 - Gerwin Schalk AB - Workshop on Real-Time Brain Interfacing Applications, Mathematical Biosciences Institute, The Ohio State University, Columbus, Ohio ER - TY - JOUR T1 - Non-invasive brain-computer interface system: towards its application as assistive technology. JF - Brain Res Bull Y1 - 2008 A1 - Cincotti, F A1 - Mattia, Donatella A1 - Aloise, Fabio A1 - Bufalari, Simona A1 - Gerwin Schalk A1 - Oriolo, Giuseppe A1 - Cherubini, Andrea A1 - Marciani, Maria Grazia A1 - Babiloni, Fabio KW - Activities of Daily Living KW - Adolescent KW - Adult KW - Brain KW - Child KW - Electroencephalography KW - Evoked Potentials, Motor KW - Female KW - Humans KW - Learning KW - Male KW - Middle Aged KW - Motor Skills KW - Muscular Dystrophy, Duchenne KW - Pilot Projects KW - Prostheses and Implants KW - Robotics KW - Self-Help Devices KW - Software KW - Spinal Muscular Atrophies of Childhood KW - User-Computer Interface KW - Volition AB -

The quality of life of people suffering from severe motor disabilities can benefit from the use of current assistive technology capable of ameliorating communication, house-environment management and mobility, according to the user's residual motor abilities. Brain-computer interfaces (BCIs) are systems that can translate brain activity into signals that control external devices. Thus they can represent the only technology for severely paralyzed patients to increase or maintain their communication and control options. Here we report on a pilot study in which a system was implemented and validated to allow disabled persons to improve or recover their mobility (directly or by emulation) and communication within the surrounding environment. The system is based on a software controller that offers to the user a communication interface that is matched with the individual's residual motor abilities. Patients (n=14) with severe motor disabilities due to progressive neurodegenerative disorders were trained to use the system prototype under a rehabilitation program carried out in a house-like furnished space. All users utilized regular assistive control options (e.g., microswitches or head trackers). In addition, four subjects learned to operate the system by means of a non-invasive EEG-based BCI. This system was controlled by the subjects' voluntary modulations of EEG sensorimotor rhythms recorded on the scalp; this skill was learnt even though the subjects have not had control over their limbs for a long time. We conclude that such a prototype system, which integrates several different assistive technologies including a BCI system, can potentially facilitate the translation from pre-clinical demonstrations to a clinical useful BCI.

VL - 75 UR - http://www.ncbi.nlm.nih.gov/pubmed/18394526 IS - 6 ER - TY - Generic T1 - Overview of Available BCI2000 Components Y1 - 2008 A1 - Gerwin Schalk AB - 4th BCI2000 Workshop, Utrecht, The Netherlands ER - TY - JOUR T1 - Real-time detection of event-related brain activity. JF - Neuroimage Y1 - 2008 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Peter Brunner A1 - Ojemann, J G A1 - Lester A Gerhardt A1 - Jonathan Wolpaw KW - Adult KW - Algorithms KW - Brain Mapping KW - Computer Systems KW - Diagnosis, Computer-Assisted KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Female KW - Humans KW - Male KW - Pattern Recognition, Automated KW - Reproducibility of Results KW - Sensitivity and Specificity AB -

The complexity and inter-individual variation of brain signals impedes real-time detection of events in raw signals. To convert these complex signals into results that can be readily understood, current approaches usually apply statistical methods to data from known conditions after all data have been collected. The capability to provide meaningful visualization of complex brain signals without the requirement to initially collect data from all conditions would provide a new tool, essentially a new imaging technique, that would open up new avenues for the study of brain function. Here we show that a new analysis approach, called SIGFRIED, can overcome this serious limitation of current methods. SIGFRIED can visualize brain signal changes without requiring prior data collection from all conditions. This capacity is particularly well suited to applications in which comprehensive prior data collection is impossible or impractical, such as intraoperative localization of cortical function or detection of epileptic seizures.

VL - 43 UR - http://www.ncbi.nlm.nih.gov/pubmed/18718544 IS - 2 ER - TY - Generic T1 - Theory and Application of Subdural Recordings in Humans Y1 - 2008 A1 - Gerwin Schalk AB - Neurosciences Grand Rounds, The Neurosciences Institute, Albany Medical Center, Albany, New York ER - TY - Generic T1 - Three cases of feature correlation in an electrocorticographic BCI. T2 - Conf Proc IEEE Eng Med Biol Soc Y1 - 2008 A1 - Miller, John W A1 - Blakely, Timothy A1 - Gerwin Schalk A1 - den Nijs, Marcel A1 - Rao, Rajesh P N A1 - Ojemann, J G KW - Adolescent KW - Adult KW - Algorithms KW - Electrocardiography KW - Evoked Potentials, Motor KW - Female KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Pattern Recognition, Automated KW - Statistics as Topic KW - Task Performance and Analysis KW - User-Computer Interface AB - Three human subjects participated in a closed-loop brain computer interface cursor control experiment mediated by implanted subdural electrocorticographic arrays. The paradigm consisted of several stages: baseline recording, hand and tongue motor tasks as the basis for feature selection, two closed-loop one-dimensional feedback experiments with each of these features, and a two-dimensional feedback experiment using both of the features simultaneously. The two selected features were simple channel and frequency band combinations associated with change during hand and tongue movement. Inter-feature correlation and cross-correlation between features during different epochs of each task were quantified for each stage of the experiment. Our anecdotal, three subject, result suggests that while high correlation between horizontal and vertical control signal can initially preclude successful two-dimensional cursor control, a feedback-based learning strategy can be successfully employed by the subject to overcome this limitation and progressively decorrelate these control signals. JF - Conf Proc IEEE Eng Med Biol Soc ER - TY - CONF T1 - Three cases of feature correlation in an electrocorticographic BCI. T2 - Engineering in Medicine and Biology Society, 2008. Y1 - 2008 A1 - Miller, Kai J A1 - Blakely, Timothy A1 - Gerwin Schalk A1 - den Nijs, Marcel A1 - Rao, Rajesh PN A1 - Ojemann, Jeffrey G KW - Adolescent KW - Adult KW - Algorithms KW - automated pattern recognition KW - control systems KW - decorrelation KW - Electrocardiography KW - Electrodes KW - Electroencephalography KW - evoked motor potentials KW - Feedback KW - Female KW - frequency KW - hospitals KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Signal Processing KW - Statistics as Topic KW - Task Performance and Analysis KW - Tongue KW - User-Computer Interface AB - Three human subjects participated in a closed-loop brain computer interface cursor control experiment mediated by implanted subdural electrocorticographic arrays. The paradigm consisted of several stages: baseline recording, hand and tongue motor tasks as the basis for feature selection, two closed-loop one-dimensional feedback experiments with each of these features, and a two-dimensional feedback experiment using both of the features simultaneously. The two selected features were simple channel and frequency band combinations associated with change during hand and tongue movement. Inter-feature correlation and cross-correlation between features during different epochs of each task were quantified for each stage of the experiment. Our anecdotal, three subject, result suggests that while high correlation between horizontal and vertical control signal can initially preclude successful two-dimensional cursor control, a feedback-based learning strategy can be successfully employed by the subject to overcome this limitation and progressively decorrelate these control signals. JF - Engineering in Medicine and Biology Society, 2008. PB - IEEE CY - Vancouver, BC UR - http://www.ncbi.nlm.nih.gov/pubmed/19163918 ER - TY - JOUR T1 - Towards an independent brain-computer interface using steady state visual evoked potentials. JF - Clin Neurophysiol Y1 - 2008 A1 - Brendan Z. Allison A1 - Dennis J. McFarland A1 - Gerwin Schalk A1 - Zheng, Shi Dong A1 - Moore-Jackson, Melody A1 - Jonathan Wolpaw KW - Adolescent KW - Adult KW - Attention KW - Brain KW - Brain Mapping KW - Dose-Response Relationship, Radiation KW - Electroencephalography KW - Evoked Potentials, Visual KW - Female KW - Humans KW - Male KW - Pattern Recognition, Visual KW - Photic Stimulation KW - Spectrum Analysis KW - User-Computer Interface AB -

OBJECTIVE: 

Brain-computer interface (BCI) systems using steady state visual evoked potentials (SSVEPs) have allowed healthy subjects to communicate. However, these systems may not work in severely disabled users because they may depend on gaze shifting. This study evaluates the hypothesis that overlapping stimuli can evoke changes in SSVEP activity sufficient to control a BCI. This would provide evidence that SSVEP BCIs could be used without shifting gaze.

METHODS: 

Subjects viewed a display containing two images that each oscillated at a different frequency. Different conditions used overlapping or non-overlapping images to explore dependence on gaze function. Subjects were asked to direct attention to one or the other of these images during each of 12 one-minute runs.

RESULTS: 

Half of the subjects produced differences in SSVEP activity elicited by overlapping stimuli that could support BCI control. In all remaining users, differences did exist at corresponding frequencies but were not strong enough to allow effective control.

CONCLUSIONS: 

The data demonstrate that SSVEP differences sufficient for BCI control may be elicited by selective attention to one of two overlapping stimuli. Thus, some SSVEP-based BCI approaches may not depend on gaze control. The nature and extent of any BCI's dependence on muscle activity is a function of many factors, including the display, task, environment, and user.

SIGNIFICANCE: 

SSVEP BCIs might function in severely disabled users unable to reliably control gaze. Further research with these users is necessary to explore the optimal parameters of such a system and validate online performance in a home environment.

VL - 119 UR - http://www.ncbi.nlm.nih.gov/pubmed/18077208 IS - 2 ER - TY - JOUR T1 - Two-dimensional movement control using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2008 A1 - Gerwin Schalk A1 - Miller, K.J. A1 - Nicholas R Anderson A1 - Adam J Wilson A1 - Smyth, Matt A1 - Ojemann, J G A1 - Moran, D A1 - Jonathan Wolpaw A1 - Leuthardt, E C KW - Adolescent KW - Adult KW - Brain Mapping KW - Data Interpretation, Statistical KW - Drug Resistance KW - Electrocardiography KW - Electrodes, Implanted KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Movement KW - User-Computer Interface AB -

We show here that a brain-computer interface (BCI) using electrocorticographic activity (ECoG) and imagined or overt motor tasks enables humans to control a computer cursor in two dimensions. Over a brief training period of 12-36 min, each of five human subjects acquired substantial control of particular ECoG features recorded from several locations over the same hemisphere, and achieved average success rates of 53-73% in a two-dimensional four-target center-out task in which chance accuracy was 25%. Our results support the expectation that ECoG-based BCIs can combine high performance with technical and clinical practicality, and also indicate promising directions for further research.

VL - 5 UR - http://www.ncbi.nlm.nih.gov/pubmed/18310813 IS - 1 ER - TY - JOUR T1 - Unique cortical physiology associated with ipsilateral hand movements and neuroprosthetic implications. JF - Stroke Y1 - 2008 A1 - Wisneski, Kimberly A1 - Nicholas R Anderson A1 - Gerwin Schalk A1 - Smyth, Matt A1 - Moran, D A1 - Leuthardt, E C KW - Adolescent KW - Adult KW - Artificial Limbs KW - Bionics KW - Brain Mapping KW - Child KW - Dominance, Cerebral KW - Electroencephalography KW - Female KW - Hand KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement KW - Paresis KW - Prosthesis Design KW - Psychomotor Performance KW - Stroke KW - User-Computer Interface KW - Volition AB -

BACKGROUND AND PURPOSE: 

Brain computer interfaces (BCIs) offer little direct benefit to patients with hemispheric stroke because current platforms rely on signals derived from the contralateral motor cortex (the same region injured by the stroke). For BCIs to assist hemiparetic patients, the implant must use unaffected cortex ipsilateral to the affected limb. This requires the identification of distinct electrophysiological features from the motor cortex associated with ipsilateral hand movements.

METHODS: 

In this study we studied 6 patients undergoing temporary placement of intracranial electrode arrays. Electrocorticographic (ECoG) signals were recorded while the subjects engaged in specific ipsilateral or contralateral hand motor tasks. Spectral changes were identified with regards to frequency, location, and timing.

RESULTS: 

Ipsilateral hand movements were associated with electrophysiological changes that occur in lower frequency spectra, at distinct anatomic locations, and earlier than changes associated with contralateral hand movements. In a subset of 3 patients, features specific to ipsilateral and contralateral hand movements were used to control a cursor on a screen in real time. In ipsilateral derived control this was optimal with lower frequency spectra.

CONCLUSIONS: 

There are distinctive cortical electrophysiological features associated with ipsilateral movements which can be used for device control. These findings have implications for patients with hemispheric stroke because they offer a potential methodology for which a single hemisphere can be used to enhance the function of a stroke induced hemiparesis.

VL - 39 UR - http://www.ncbi.nlm.nih.gov/pubmed/18927456 IS - 12 ER - TY - Generic T1 - Using Brain Signals for Clinical Diagnosis and Communication Y1 - 2008 A1 - Gerwin Schalk AB - Center for Neuropharmacology & Neuroscience, Albany Medical College, Albany, New York ER - TY - Generic T1 - Using Electrocorticographic (ECoG) Signals in Humans for Communication and Diagnosis Y1 - 2008 A1 - Gerwin Schalk AB - Department of Physiology and Biophysics, University of Washington, Seattle, Washington ER - TY - Generic T1 - Using Electrocorticographic (ECoG) Signals in Humans for Communication and Diagnosis Y1 - 2008 A1 - Gerwin Schalk AB - Technical University of Berlin, Berlin, Germany ER - TY - Generic T1 - Using Electrocorticography for Brain-Computer Interfacing and Detailed Single-Trial Decoding of Human Behavior Y1 - 2008 A1 - Gerwin Schalk AB - Brain Gain Lecture, F.C. Donders Center for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands ER - TY - Generic T1 - BCI2000: A General-Purpose Brain-Computer Interface System Y1 - 2007 A1 - Gerwin Schalk AB - 2nd BCI2000 Workshop, Beijing, China ER - TY - CHAP T1 - BCI2000: A General-Purpose Software Platform for BCI Research. T2 - Brain-Computer Interfaces Y1 - 2007 A1 - Mellinger, Jürgen A1 - Gerwin Schalk JF - Brain-Computer Interfaces PB - MIT Press ER - TY - Generic T1 - Brain-Computer Interfaces: Controlling A Computer With Your Thought Y1 - 2007 A1 - Gerwin Schalk AB - Science Today Seminar Series. Bethlehem High School, Delmar, New York. ER - TY - Generic T1 - Brain-Computer Interfacing Using Electrocorticography (ECoG) Y1 - 2007 A1 - Gerwin Schalk AB - International Workshop on Brain-Computer Interface Technology, Beijing, China ER - TY - Generic T1 - Brain-Computer Interfacing Using Non-Invasive and Invasive Methods Y1 - 2007 A1 - Gerwin Schalk AB - Computer Science and Electrical Engineering Department, Orgegon Health & Science University, Beaverton, Oregon ER - TY - Generic T1 - Brain-Computer Interfacing Using Non-Invasive, Intra-Cortical, and Subdural Methods Y1 - 2007 A1 - Gerwin Schalk AB - Max-Planck-Institute for Brain Research, Frankfurt, Germany ER - TY - Generic T1 - Communicating Directly from the Brain: Brain-Computer Interfaces (BCIs) Y1 - 2007 A1 - Gerwin Schalk AB - Wadsworth Center Research Experience for Undergraduates Program, Albany, New York ER - TY - JOUR T1 - Decoding two-dimensional movement trajectories using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2007 A1 - Gerwin Schalk A1 - Kubánek, J A1 - Miller, John W A1 - Nicholas R Anderson A1 - Leuthardt, E C A1 - Ojemann, J G A1 - Limbrick, D A1 - Moran, D A1 - Lester A Gerhardt A1 - Jonathan Wolpaw KW - Adult KW - Algorithms KW - Arm KW - Brain Mapping KW - Cerebral Cortex KW - Electroencephalography KW - Evoked Potentials, Motor KW - Female KW - Humans KW - Male KW - Movement AB -

Signals from the brain could provide a non-muscular communication and control system, a brain-computer interface (BCI), for people who are severely paralyzed. A common BCI research strategy begins by decoding kinematic parameters from brain signals recorded during actual arm movement. It has been assumed that these parameters can be derived accurately only from signals recorded by intracortical microelectrodes, but the long-term stability of such electrodes is uncertain. The present study disproves this widespread assumption by showing in humans that kinematic parameters can also be decoded from signals recorded by subdural electrodes on the cortical surface (ECoG) with an accuracy comparable to that achieved in monkey studies using intracortical microelectrodes. A new ECoG feature labeled the local motor potential (LMP) provided the most information about movement. Furthermore, features displayed cosine tuning that has previously been described only for signals recorded within the brain. These results suggest that ECoG could be a more stable and less invasive alternative to intracortical electrodes for BCI systems, and could also prove useful in studies of motor function.

VL - 4 UR - http://www.ncbi.nlm.nih.gov/pubmed/17873429 IS - 3 ER - TY - Generic T1 - Definition of Motor Responses and Brain-Computer Interfacing Using Electrocorticography Y1 - 2007 A1 - Gerwin Schalk AB - Neuroscience Group, Laborator of Nervous System Disorders, Wadsworth Center, New York State Department of Health, Albany New York ER - TY - Generic T1 - Direct Communication From the Brain Y1 - 2007 A1 - Gerwin Schalk AB - Guest lecture for BS in IT Capstone Course. Department of Information Technology, Rensselaer Polytechnic Institute, Troy, New York ER - TY - JOUR T1 - Electrocorticographic Frequency Alteration Mapping: A Clinical Technique for Mapping the Motor Cortex. JF - Neurosurgery Y1 - 2007 A1 - Leuthardt, E C A1 - Miller, John W A1 - Nicholas R Anderson A1 - Gerwin Schalk A1 - Dowling, Joshua A1 - Miller, John W A1 - Moran, D A1 - Ojemann, J G KW - Adult KW - Biological Clocks KW - Brain Mapping KW - Electric Stimulation KW - Electrodes, Implanted KW - Electroencephalography KW - Female KW - Hand KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Oscillometry KW - Signal Processing, Computer-Assisted KW - Tongue AB -

OBJECTIVE: 

Electrocortical stimulation (ECS) has been well established for delineating the eloquent cortex. However, ECS is still coarse and inefficient in delineating regions of the functional cortex and can be hampered by after-discharges. Given these constraints, an adjunct approach to defining the motor cortex is the use of electrocorticographic signal changes associated with active regions of the cortex. The broad range of frequency oscillations are categorized into two main groups with respect to the sensorimotor cortex: low and high frequency bands. The low frequency bands tend to show a power reduction with cortical activation, whereas the high frequency bands show power increases. These power changes associated with the activated cortex could potentially provide a powerful tool in delineating areas of the motor cortex. We explore electrocorticographic signal alterations as they occur with activated regions of the motor cortex, as well as its potential in clinical brain mapping applications.

METHODS: 

We evaluated seven patients who underwent invasive monitoring for seizure localization. Each patient had extraoperative ECS mapping to identify the motor cortex. All patients also performed overt hand and tongue motor tasks to identify associated frequency power changes in regard to location and degree of concordance with ECS results that localized either hand or tongue motor function.

RESULTS: 

The low frequency bands had a high sensitivity (88.9-100%) and a lower specificity (79.0-82.6%) for identifying electrodes with either hand or tongue ECS motor responses. The high frequency bands had a lower sensitivity (72.7-88.9%) and a higher specificity (92.4-94.9%) in correlation with the same respective ECS positive electrodes.

CONCLUSION: 

The concordance between stimulation and spectral power changes demonstrate the possible utility of electrocorticographic frequency alteration mapping as an adjunct method to improve the efficiency and resolution of identifying the motor cortex.

VL - 60 UR - http://www.ncbi.nlm.nih.gov/pubmed/17415162 IS - 4 Suppl 2 ER - TY - Generic T1 - Electrocorticography (ECoG) for Feedback and Decoding of Function Y1 - 2007 A1 - Gerwin Schalk AB - Workshop on Large Scale Brain Dynamics, Neural Information Processing Systems (NIPS), Whistler, British Columbia, Canada ER - TY - Generic T1 - Electrocorticography for Brain-Computer Interfacing and Motor/Language Mapping Y1 - 2007 A1 - Gerwin Schalk AB - Neurosciences Grand Rounds, The Neurosciences Institute, Albany Medical Center, Albany, New York. ER - TY - JOUR T1 - An MEG-based brain-computer interface (BCI). JF - Neuroimage Y1 - 2007 A1 - Mellinger, Jürgen A1 - Gerwin Schalk A1 - Christoph Braun A1 - Preissl, Hubert A1 - Rosenstiel, W. A1 - Niels Birbaumer A1 - Kübler, A. KW - Adult KW - Algorithms KW - Artifacts KW - Brain KW - Electroencephalography KW - Electromagnetic Fields KW - Electromyography KW - Feedback KW - Female KW - Foot KW - Hand KW - Head Movements KW - Humans KW - Magnetic Resonance Imaging KW - Magnetoencephalography KW - Male KW - Movement KW - Principal Component Analysis KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB -

Brain-computer interfaces (BCIs) allow for communicating intentions by mere brain activity, not involving muscles. Thus, BCIs may offer patients who have lost all voluntary muscle control the only possible way to communicate. Many recent studies have demonstrated that BCIs based on electroencephalography(EEG) can allow healthy and severely paralyzed individuals to communicate. While this approach is safe and inexpensive, communication is slow. Magnetoencephalography (MEG) provides signals with higher spatiotemporal resolution than EEG and could thus be used to explore whether these improved signal properties translate into increased BCI communication speed. In this study, we investigated the utility of an MEG-based BCI that uses voluntary amplitude modulation of sensorimotor mu and beta rhythms. To increase the signal-to-noise ratio, we present a simple spatial filtering method that takes the geometric properties of signal propagation in MEG into account, and we present methods that can process artifacts specifically encountered in an MEG-based BCI. Exemplarily, six participants were successfully trained to communicate binary decisions by imagery of limb movements using a feedback paradigm. Participants achieved significant mu rhythm self control within 32 min of feedback training. For a subgroup of three participants, we localized the origin of the amplitude modulated signal to the motor cortex. Our results suggest that an MEG-based BCI is feasible and efficient in terms of user training.

VL - 36 UR - http://www.ncbi.nlm.nih.gov/pubmed/17475511 IS - 3 ER - TY - Generic T1 - Non-invasive brain-computer interface system to operate assistive devices. T2 - Conf Proc IEEE Eng Med Biol Soc Y1 - 2007 A1 - Cincotti, F A1 - Aloise, Fabio A1 - Bufalari, Simona A1 - Gerwin Schalk A1 - Oriolo, Giuseppe A1 - Cherubini, Andrea A1 - Davide, Fabrizio A1 - Babiloni, Fabio A1 - Marciani, Maria Grazia A1 - Mattia, Donatella KW - Brain KW - Communication Aids for Disabled KW - Computer Systems KW - Humans KW - Neurodegenerative Diseases KW - Quality of Life KW - Self-Help Devices KW - Software KW - User-Computer Interface AB - In this pilot study, a system that allows disabled persons to improve or recover their mobility and communication within the surrounding environment was implemented and validated. The system is based on a software controller that offers to the user a communication interface that is matched with the individual's residual motor abilities. Fourteen patients with severe motor disabilities due to progressive neurodegenerative disorders were trained to use the system prototype under a rehabilitation program. All users utilized regular assistive control options (e.g., microswitches or head trackers) while four patients learned to operate the system by means of a non-invasive EEG-based Brain-Computer Interface, based on the subjects' voluntary modulations of EEG sensorimotor rhythms recorded on the scalp. JF - Conf Proc IEEE Eng Med Biol Soc ER - TY - JOUR T1 - Spectral Changes in Cortical Surface Potentials During Motor Movement. JF - J Neurosci Y1 - 2007 A1 - Miller, John W A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Rao, Rajesh P N A1 - Nicholas R Anderson A1 - Moran, D A1 - Miller, John W A1 - Ojemann, J G KW - Adult KW - Brain Mapping KW - Female KW - Humans KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement AB -

In the first large study of its kind, we quantified changes in electrocorticographic signals associated with motor movement across 22 subjects with subdural electrode arrays placed for identification of seizure foci. Patients underwent a 5-7 d monitoring period with array placement, before seizure focus resection, and during this time they participated in the study. An interval-based motor-repetition task produced consistent and quantifiable spectral shifts that were mapped on a Talairach-standardized template cortex. Maps were created independently for a high-frequency band (HFB) (76-100 Hz) and a low-frequency band (LFB) (8-32 Hz) for several different movement modalities in each subject. The power in relevant electrodes consistently decreased in the LFB with movement, whereas the power in the HFB consistently increased. In addition, the HFB changes were more focal than the LFB changes. Sites of power changes corresponded to stereotactic locations in sensorimotor cortex and to the results of individual clinical electrical cortical mapping. Sensorimotor representation was found to be somatotopic, localized in stereotactic space to rolandic cortex, and typically followed the classic homunculus with limited extrarolandic representation.

VL - 27 UR - http://www.ncbi.nlm.nih.gov/pubmed/17329441 IS - 9 ER - TY - JOUR T1 - A µ-rhythm Matched Filter for Continuous Control of a Brain-Computer Interface. JF - IEEE Trans Biomed Eng Y1 - 2007 A1 - Krusienski, Dean J A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Jonathan Wolpaw KW - Algorithms KW - Cerebral Cortex KW - Cortical Synchronization KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Imagination KW - Pattern Recognition, Automated KW - User-Computer Interface AB -

A brain-computer interface (BCI) is a system that provides an alternate nonmuscular communication/control channel for individuals with severe neuromuscular disabilities. With proper training, individuals can learn to modulate the amplitude of specific electroencephalographic (EEG) components (e.g., the 8-12 Hz mu rhythm and 18-26 Hz beta rhythm) over the sensorimotor cortex and use them to control a cursor on a computer screen. Conventional spectral techniques for monitoring the continuousamplitude fluctuations fail to capture essential amplitude/phase relationships of the mu and beta rhythms in a compact fashion and, therefore, are suboptimal. By extracting the characteristic mu rhythm for a user, the exact morphology can be characterized and exploited as a matched filter. A simple, parameterized model for the characteristic mu rhythm is proposed and its effectiveness as a matched filter is examined online for a one-dimensional cursor control task. The results suggest that amplitude/phase coupling exists between the mu and beta bands during event-related desynchronization, and that an appropriate matched filter can provide improved performance.

VL - 54 UR - http://www.ncbi.nlm.nih.gov/pubmed/17278584 IS - 2 ER - TY - JOUR T1 - The BCI competition III: Validating alternative approaches to actual BCI problems. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Benjamin Blankertz A1 - Müller, Klaus-Robert A1 - Krusienski, Dean J A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Schlögl, Alois A1 - Pfurtscheller, Gert A1 - Millán, José del R A1 - Schröder, Michael A1 - Niels Birbaumer KW - Algorithms KW - Brain KW - Communication Aids for Disabled KW - Databases, Factual KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Neuromuscular Diseases KW - Software Validation KW - Technology Assessment, Biomedical KW - User-Computer Interface AB -

brain-computer interface (BCI) is a system that allows its users to control external devices with brainactivity. Although the proof-of-concept was given decades ago, the reliable translation of user intent into device control commands is still a major challenge. Success requires the effective interaction of two adaptive controllers: the user's brain, which produces brain activity that encodes intent, and the BCI system, which translates that activity into device control commands. In order to facilitate this interaction, many laboratories are exploring a variety of signal analysis techniques to improve the adaptation of the BCI system to the user. In the literature, many machine learning and pattern classification algorithms have been reported to give impressive results when applied to BCI data in offline analyses. However, it is more difficult to evaluate their relative value for actual online use. BCI data competitions have been organized to provide objective formal evaluations of alternative methods. Prompted by the great interest in the first two BCI Competitions, we organized the third BCI Competition to address several of the most difficult and important analysis problems in BCI research. The paper describes the data sets that were provided to the competitors and gives an overview of the results.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792282 IS - 2 ER - TY - JOUR T1 - BCI meeting 2005 - Workshop on Technology: Hardware and Software. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Cincotti, F A1 - Bianchi, L A1 - Birch, Gary A1 - Guger, C A1 - Mellinger, Jürgen A1 - Scherer, Reinhold A1 - Schmidt, Robert N A1 - Yáñez Suárez, Oscar A1 - Gerwin Schalk KW - Algorithms KW - Biotechnology KW - Brain KW - Communication Aids for Disabled KW - Computers KW - Electroencephalography KW - Equipment Design KW - Humans KW - Internationality KW - Man-Machine Systems KW - Neuromuscular Diseases KW - Software KW - User-Computer Interface AB -

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop to review and evaluate the current state of BCI-related hardware and software. Technical requirements and current technologies, standardization procedures and future trends are covered. The main conclusion was recognition of the need to focus technical requirements on the users' needs and the need for consistent standards in BCI research.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792276 IS - 2 ER - TY - Generic T1 - BCI2000: Software for Brain-Computer Interface Research Y1 - 2006 A1 - Gerwin Schalk AB - Neuroscience Group, Laboratory of Nervous System Disorders, Wadsworth Center, New York State Department of Health, Albany, New York. ER - TY - Generic T1 - Brain Interfacing with Materials Y1 - 2006 A1 - Gerwin Schalk AB - Task group presentation, National Academy of Sciences Keck Futures Initiative "Smart Prosthetics." Beckman Center, Irvine, California. ER - TY - Generic T1 - Brain-Computer Interfaces (BCIs): Towards Clinical Applications Y1 - 2006 A1 - Gerwin Schalk AB - Biomedical Engineering Colloquium, Washington University in St. Louis, St. Louis, Missouri. ER - TY - Generic T1 - Brain-Computer Interfaces: Challenges and Perspectives Y1 - 2006 A1 - Gerwin Schalk AB - Rudolf Magnus Institute of Neuroscience, University Medical Center, Utrecht, The Netherlands ER - TY - Generic T1 - Brain-Computer Interfaces: Ready for Clinical Use? Y1 - 2006 A1 - Gerwin Schalk AB - Center for Disability Services, Albany, New York ER - TY - Generic T1 - Brain-Computer Interfacing Using BCI2000 Y1 - 2006 A1 - Gerwin Schalk AB - Keynote address, g.tec Brain-Computer Interface Workshop, Graz, Austria ER - TY - Generic T1 - Direct Communication From the Brain Y1 - 2006 A1 - Gerwin Schalk AB - Guest lecture for course Services Science, Management, and Engineering. Department of Information Technology, Rensselaer Polytechnic Institute, Troy, New York. ER - TY - JOUR T1 - ECoG factors underlying multimodal control of a brain-computer interface. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Adam J Wilson A1 - Felton, Elizabeth A A1 - Garell, P Charles A1 - Gerwin Schalk A1 - Williams, Justin C KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Communication Aids for Disabled KW - Computer Peripherals KW - Evoked Potentials KW - Female KW - Humans KW - Imagination KW - Male KW - Man-Machine Systems KW - Neuromuscular Diseases KW - Systems Integration KW - User-Computer Interface KW - Volition AB -

Most current brain-computer interface (BCI) systems for humans use electroencephalographic activity recorded from the scalp, and may be limited in many ways. Electrocorticography (ECoG) is believed to be a minimally-invasive alternative to electroencephalogram (EEG) for BCI systems, yielding superior signal characteristics that could allow rapid user training and faster communication rates. In addition, our preliminary results suggest that brain regions other than the sensorimotor cortex, such as auditory cortex, may be trained to control a BCI system using similar methods as those used to train motor regions of the brain. This could prove to be vital for users who have neurological disease, head trauma, or other conditions precluding the use of sensorimotor cortex for BCI control.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792305 IS - 2 ER - TY - JOUR T1 - Electrocorticography-based brain computer interface--the Seattle experience. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Leuthardt, E C A1 - Miller, John W A1 - Gerwin Schalk A1 - Rao, Rajesh P N A1 - Ojemann, J G KW - Cerebral Cortex KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Humans KW - Therapy, Computer-Assisted KW - User-Computer Interface KW - Washington AB -

Electrocorticography (ECoG) has been demonstrated to be an effective modality as a platform for brain-computer interfaces (BCIs). Through our experience with ten subjects, we further demonstrate evidence to support the power and flexibility of this signal for BCI usage. In a subset of four patients, closed-loop BCI experiments were attempted with the patient receiving online feedback that consisted of one-dimensional cursor movement controlled by ECoG features that had shown correlation with various real and imagined motor and speech tasks. All four achieved control, with final target accuracies between 73%-100%. We assess the methods for achieving control and the manner in which enhancing online control can be accomplished by rescreening during online tasks. Additionally, we assess the relevant issues of the current experimental paradigm in light of their clinical constraints.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792292 IS - 2 ER - TY - JOUR T1 - The emerging world of motor neuroprosthetics: a neurosurgical perspective. JF - Neurosurgery Y1 - 2006 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Moran, D A1 - Ojemann, J G KW - Brain KW - Humans KW - Man-Machine Systems KW - Movement KW - Neurosurgery KW - Prostheses and Implants KW - User-Computer Interface AB -

A MOTOR NEUROPROSTHETIC device, or brain computer interface, is a machine that can take some type of signal from the brain and convert that information into overt device control such that it reflects the intentions of the user's brain. In essence, these constructs can decode the electrophysiological signals representing motor intent. With the parallel evolution of neuroscience, engineering, and rapid computing, the era of clinical neuroprosthetics is approaching as a practical reality for people with severe motor impairment. Patients with such diseases as spinal cord injury, stroke, limb loss, and neuromuscular disorders may benefit through the implantation of these brain computer interfaces that serve to augment their ability to communicate and interact with their environment. In the upcoming years, it will be important for the neurosurgeon to understand what a brain computer interface is, its fundamental principle of operation, and what the salient surgical issues are when considering implantation. We review the current state of the field of motor neuroprosthetics research, the early clinical applications, and the essential considerations from a neurosurgical perspective for the future.

VL - 59 UR - http://www.ncbi.nlm.nih.gov/pubmed/16823294 IS - 1 ER - TY - JOUR T1 - The Wadsworth BCI Research and Development Program: At Home with BCI. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2006 A1 - Theresa M Vaughan A1 - Dennis J. McFarland A1 - Gerwin Schalk A1 - Sarnacki, William A A1 - Krusienski, Dean J A1 - Sellers, Eric W A1 - Jonathan Wolpaw KW - Animals KW - Brain KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Neuromuscular Diseases KW - New York KW - Research KW - Switzerland KW - Therapy, Computer-Assisted KW - Universities KW - User-Computer Interface AB -

The ultimate goal of brain-computer interface (BCI) technology is to provide communication and control capacities to people with severe motor disabilities. BCI research at the Wadsworth Center focuses primarily on noninvasive, electroencephalography (EEG)-based BCI methods. We have shown that people, including those with severe motor disabilities, can learn to use sensorimotor rhythms (SMRs) to move a cursor rapidly and accurately in one or two dimensions. We have also improved P300-based BCI operation. We are now translating this laboratory-proven BCI technology into a system that can be used by severely disabled people in their homes with minimal ongoing technical oversight. To accomplish this, we have: improved our general-purpose BCI software (BCI2000); improved online adaptation and feature translation for SMR-based BCI operation; improved the accuracy and bandwidth of P300-based BCI operation; reduced the complexity of system hardware and software and begun to evaluate home system use in appropriate users. These developments have resulted in prototype systems for every day use in people's homes.

VL - 14 UR - http://www.ncbi.nlm.nih.gov/pubmed/16792301 IS - 2 ER - TY - Generic T1 - Communicating Directly from the Brain: Brain-Computer Interfaces Y1 - 2005 A1 - Gerwin Schalk AB - Condensed Matter Physics Seminar Series. Rensselaer Polytechnic Institute, Troy, New York ER - TY - JOUR T1 - The interaction of a new motor skill and an old one: H-reflex conditioning and locomotion in rats. JF - The Journal of neuroscience : the official journal of the Society for Neuroscience Y1 - 2005 A1 - Yi Chen A1 - Xiang Yang Chen A1 - Jakeman, Lyn B. A1 - Gerwin Schalk A1 - Stokes, Bradford T. A1 - Jonathan Wolpaw KW - H-reflex conditioning KW - Learning KW - Locomotion KW - memory consolidation KW - Motor control KW - Rehabilitation KW - spinal cord plasticity AB - New and old motor skills can interfere with each other or interact in other ways. Because each skill entails a distributed pattern of activity-dependent plasticity, investigation of their interactions is facilitated by simple models. In a well characterized model of simple learning, rats and monkeys gradually change the size of the H-reflex, the electrical analog of the spinal stretch reflex. This study evaluates in normal rats the interactions of this new skill of H-reflex conditioning with the old well established skill of overground locomotion. In rats in which the soleus H-reflex elicited in the conditioning protocol (i.e., the conditioning H-reflex) had been decreased by down-conditioning, the H-reflexes elicited during the stance and swing phases of locomotion (i.e., the locomotor H-reflexes) were also smaller. Similarly, in rats in which the conditioning H-reflex had been increased by up-conditioning, the locomotor H-reflexes were also larger. Soleus H-reflex conditioning did not affect the duration, length, or right/left symmetry of the step cycle. However, the conditioned change in the stance H-reflex was positively correlated with change in the amplitude of the soleus locomotor burst, and the correlation was consistent with current estimates of the contribution of primary afferent input to the burst. Although H-reflex conditioning and locomotion did not interfere with each other, H-reflex conditioning did affect how locomotion was produced: it changed soleus burst amplitude and may have induced compensatory changes in the activity of other muscles. These results illustrate and clarify the subtlety and complexity of skill interactions. They also suggest that H-reflex conditioning might be used to improve the abnormal locomotion produced by spinal cord injury or other disorders of supraspinal control. VL - 25 UR - http://www.ncbi.nlm.nih.gov/pubmed/16033899 ER - TY - JOUR T1 - Long-term spinal reflex studies in awake behaving mice. JF - Journal of neuroscience methods Y1 - 2005 A1 - Jonathan S. Carp A1 - Tennissen, Ann M. A1 - Xiang Yang Chen A1 - Gerwin Schalk A1 - Jonathan Wolpaw KW - Electromyography KW - implanted electrodes KW - Monosynaptic KW - Spinal Cord AB - The increasing availability of genetic variants of mice has facilitated studies of the roles of specific molecules in specific behaviors. The contributions of such studies could be strengthened and extended by correlation with detailed information on the patterns of motor commands throughout the course of specific behaviors in freely moving animals. Previously reported methodologies for long-term recording of electromyographic activity (EMG) in mice using implanted electrodes were designed for intermittent, but not continuous operation. This report describes the fabrication, implantation, and utilization of fine wire electrodes for continuous long-term recordings of spontaneous and nerve-evoked EMG in mice. Six mice were implanted with a tibial nerve cuff electrode and EMG electrodes in soleus and gastrocnemius muscles. Wires exited through a skin button and traveled through an armored cable to an electrical commutator. In mice implanted for 59-144 days, ongoing EMG was monitored continuously (i.e., 24 h/day, 7 days/week) by computer for 18-92 days (total intermittent recording for 25-130 days). When the ongoing EMG criteria were met, the computer applied the nerve stimulus, recorded the evoked EMG response, and determined the size of the M-response (MR) and the H-reflex (HR). It continually adjusted stimulation intensity to maintain a stable MR size. Stable recordings of ongoing EMG, MR, and HR were obtained typically 3 weeks after implantation. This study demonstrates the feasibility of long-term continuous EMG recordings in mice for addressing a variety of neurophysiological and behavioral issues. VL - 149 UR - http://www.ncbi.nlm.nih.gov/pubmed/16026848 ER - TY - Generic T1 - News from the Wadsworth BCI R&D Program: Pushing the Envelope Y1 - 2005 A1 - Gerwin Schalk AB - Eberhard-Karls University, Tübingen, Germany ER - TY - JOUR T1 - Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. JF - Neurology Y1 - 2005 A1 - Kübler, A. A1 - Nijboer, F A1 - Mellinger, Jürgen A1 - Theresa M Vaughan A1 - Pawelzik, H A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Niels Birbaumer A1 - Jonathan Wolpaw KW - Aged KW - Amyotrophic Lateral Sclerosis KW - Electroencephalography KW - Evoked Potentials, Motor KW - Evoked Potentials, Somatosensory KW - Female KW - Humans KW - Imagination KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement KW - Paralysis KW - Photic Stimulation KW - Prostheses and Implants KW - Somatosensory Cortex KW - Treatment Outcome KW - User-Computer Interface AB -

People with severe motor disabilities can maintain an acceptable quality of life if they can communicate. Brain-computer interfaces (BCIs), which do not depend on muscle control, can provide communication. Four people severely disabled by ALS learned to operate a BCI with EEG rhythms recorded over sensorimotor cortex. These results suggest that a sensorimotor rhythm-based BCI could help maintain quality of life for people with ALS.

VL - 64 UR - http://www.ncbi.nlm.nih.gov/pubmed/15911809 IS - 10 ER - TY - JOUR T1 - Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. JF - Neurology Y1 - 2005 A1 - Kübler, A. A1 - Nijboer, F. A1 - Mellinger, J. A1 - Theresa M Vaughan A1 - Pawelzik, H. A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Niels Birbaumer A1 - Jonathan Wolpaw KW - User-Computer Interface AB - People with severe motor disabilities can maintain an acceptable quality of life if they can communicate. Brain-computer interfaces (BCIs), which do not depend on muscle control, can provide communication. Four people severely disabled by ALS learned to operate a BCI with EEG rhythms recorded over sensorimotor cortex. These results suggest that a sensorimotor rhythm-based BCI could help maintain quality of life for people with ALS. VL - 64 UR - http://www.ncbi.nlm.nih.gov/pubmed/15911809 ER - TY - Generic T1 - Recording Options for Brain-Computer Interfaces Y1 - 2005 A1 - Gerwin Schalk AB - Augmented Cognition Conference / Satellite to 11th International Conference on Human-Computer Interaction, Caesars Palace, Las Vegas, Nevada ER - TY - Generic T1 - Recording Options for Brain-Computer Interfaces T2 - Proceedings to the 1st Conference on Augmented Cognition Y1 - 2005 A1 - Gerwin Schalk A1 - Jonathan Wolpaw JF - Proceedings to the 1st Conference on Augmented Cognition ER - TY - CONF T1 - Recording Options for Brain-Computer Interfaces. T2 - Proceedings to the 1st Conference on Augmented Cognition Y1 - 2005 A1 - Gerwin Schalk A1 - Jonathan Wolpaw JF - Proceedings to the 1st Conference on Augmented Cognition ER - TY - Generic T1 - Towards 2D Brain Control Using ECoG Y1 - 2005 A1 - Gerwin Schalk AB - 11th International Conference on Human-Computer Interaction, Caesars Palace, Las Vegas, Nevada ER - TY - CONF T1 - Towards two-dimensional cursor control using electrocorticographic signals. T2 - Proceedings to the 11th International Conference on Human-Computer Interaction Y1 - 2005 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, D A1 - Miller, K.J. A1 - Ojemann, J G A1 - Jonathan Wolpaw JF - Proceedings to the 11th International Conference on Human-Computer Interaction ER - TY - Generic T1 - Towards two-dimensional cursor control using electrocorticographic signals T2 - Proceedings to the 11th International Conference on Human-Computer Interaction Y1 - 2005 A1 - Gerwin Schalk A1 - Leuthardt, E C A1 - Moran, D A1 - Miller, K.J. A1 - Ojemann, J G A1 - Jonathan Wolpaw JF - Proceedings to the 11th International Conference on Human-Computer Interaction ER - TY - CONF T1 - Tracking of the mu rhythm using an empirically derived matched filter. T2 - Proc. IEEE International Conference of Neural Engineering Y1 - 2005 A1 - Krusienski, Dean J A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Jonathan Wolpaw KW - bioelectric potentials KW - Brain Computer Interfaces KW - brain modeling KW - brain-computer interface KW - communication device KW - communication system control KW - cortical mu rhythm modulation KW - EEG KW - Electroencephalography KW - empirically derived matched filter KW - handicapped aids KW - laboratories KW - matched filters KW - medical signal detection KW - medical signal processing KW - monitoring KW - motor imagery KW - mu rhythm tracking KW - noninvasive treatment KW - rhythm KW - synchronous motors KW - two-dimensional cursor control data JF - Proc. IEEE International Conference of Neural Engineering PB - IEEE CY - Arlington, VA SN - 0-7803-8710-4 UR - http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=1419559 ER - TY - Generic T1 - Tracking of the mu rhythm using an empirically derived matched filter T2 - Proc. IEEE International Conference of Neural Engineering Y1 - 2005 A1 - Krusienski, Dean J A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Jonathan Wolpaw JF - Proc. IEEE International Conference of Neural Engineering ER - TY - JOUR T1 - The BCI Competition 2003: progress and perspectives in detection and discrimination of EEG single trials. JF - IEEE transactions on bio-medical engineering Y1 - 2004 A1 - Benjamin Blankertz A1 - Müller, Klaus-Robert A1 - Curio, Gabriel A1 - Theresa M Vaughan A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Schlögl, Alois A1 - Neuper, Christa A1 - Pfurtscheller, Gert A1 - Hinterberger, Thilo A1 - Schröder, Michael A1 - Niels Birbaumer KW - augmentative communication KW - BCI KW - beta-rhythm KW - brain-computer interface KW - EEG KW - ERP KW - imagined hand movements KW - lateralized readiness potential KW - mu-rhythm KW - P300 KW - Rehabilitation KW - single-trial classification KW - slow cortical potentials AB - Interest in developing a new method of man-to-machine communication–a brain-computer interface (BCI)–has grown steadily over the past few decades. BCIs create a new communication channel between the brain and an output device by bypassing conventional motor output pathways of nerves and muscles. These systems use signals recorded from the scalp, the surface of the cortex, or from inside the brain to enable users to control a variety of applications including simple word-processing software and orthotics. BCI technology could therefore provide a new communication and control option for individuals who cannot otherwise express their wishes to the outside world. Signal processing and classification methods are essential tools in the development of improved BCI technology. We organized the BCI Competition 2003 to evaluate the current state of the art of these tools. Four laboratories well versed in EEG-based BCI research provided six data sets in a documented format. We made these data sets (i.e., labeled training sets and unlabeled test sets) and their descriptions available on the Internet. The goal in the competition was to maximize the performance measure for the test labels. Researchers worldwide tested their algorithms and competed for the best classification results. This paper describes the six data sets and the results and function of the most successful algorithms. VL - 51 UR - http://www.ncbi.nlm.nih.gov/pubmed/15188876 ER - TY - JOUR T1 - The BCI Competition 2003: Progress and perspectives in detection and discrimination of EEG single trials. JF - IEEE Trans Biomed Eng Y1 - 2004 A1 - Benjamin Blankertz A1 - Müller, Klaus-Robert A1 - Curio, Gabriel A1 - Theresa M Vaughan A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Schlögl, Alois A1 - Neuper, Christa A1 - Pfurtscheller, Gert A1 - Hinterberger, T. A1 - Schröder, Michael A1 - Niels Birbaumer KW - Adult KW - Algorithms KW - Amyotrophic Lateral Sclerosis KW - Artificial Intelligence KW - Brain KW - Cognition KW - Databases, Factual KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Reproducibility of Results KW - Sensitivity and Specificity KW - User-Computer Interface AB - Interest in developing a new method of man-to-machine communication--a brain-computer interface (BCI)--has grown steadily over the past few decades. BCIs create a new communication channel between the brain and an output device by bypassing conventional motor output pathways of nerves and muscles. These systems use signals recorded from the scalp, the surface of the cortex, or from inside the brain to enable users to control a variety of applications including simple word-processing software and orthotics. BCI technology could therefore provide a new communication and control option for individuals who cannot otherwise express their wishes to the outside world. Signal processing and classification methods are essential tools in the development of improved BCI technology. We organized the BCI Competition 2003 to evaluate the current state of the art of these tools. Four laboratories well versed in EEG-based BCI research provided six data sets in a documented format. We made these data sets (i.e., labeled training sets and unlabeled test sets) and their descriptions available on the Internet. The goal in the competition was to maximize the performance measure for the test labels. Researchers worldwide tested their algorithms and competed for the best classification results. This paper describes the six data sets and the results and function of the most successful algorithms. VL - 51 IS - 6 ER - TY - JOUR T1 - BCI2000: a general-purpose brain-computer interface (BCI) system. JF - IEEE Trans Biomed Eng Y1 - 2004 A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Hinterberger, T. A1 - Niels Birbaumer A1 - Jonathan Wolpaw KW - Algorithms KW - Brain KW - Cognition KW - Communication Aids for Disabled KW - Computer Peripherals KW - Electroencephalography KW - Equipment Design KW - Equipment Failure Analysis KW - Evoked Potentials KW - Humans KW - Systems Integration KW - User-Computer Interface AB - Many laboratories have begun to develop brain-computer interface (BCI) systems that provide communication and control capabilities to people with severe motor disabilities. Further progress and realization of practical applications depends on systematic evaluations and comparisons of different brain signals, recording methods, processing algorithms, output formats, and operating protocols. However, the typical BCI system is designed specifically for one particular BCI method and is, therefore, not suited to the systematic studies that are essential for continued progress. In response to this problem, we have developed a documented general-purpose BCI research and development platform called BCI2000. BCI2000 can incorporate alone or in combination any brain signals, signal processing methods, output devices, and operating protocols. This report is intended to describe to investigators, biomedical engineers, and computer scientists the concepts that the BC12000 system is based upon and gives examples of successful BCI implementations using this system. To date, we have used BCI2000 to create BCI systems for a variety of brain signals, processing methods, and applications. The data show that these systems function well in online operation and that BCI2000 satisfies the stringent real-time requirements of BCI systems. By substantially reducing labor and cost, BCI2000 facilitates the implementation of different BCI systems and other psychophysiological experiments. It is available with full documentation and free of charge for research or educational purposes and is currently being used in a variety of studies by many research groups. VL - 51 IS - 6 ER - TY - JOUR T1 - BCI2000: a general-purpose brain-computer interface (BCI) system. JF - IEEE transactions on bio-medical engineering Y1 - 2004 A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Hinterberger, Thilo A1 - Niels Birbaumer A1 - Jonathan Wolpaw KW - User-Computer Interface AB - Many laboratories have begun to develop brain-computer interface (BCI) systems that provide communication and control capabilities to people with severe motor disabilities. Further progress and realization of practical applications depends on systematic evaluations and comparisons of different brain signals, recording methods, processing algorithms, output formats, and operating protocols. However, the typical BCI system is designed specifically for one particular BCI method and is, therefore, not suited to the systematic studies that are essential for continued progress. In response to this problem, we have developed a documented general-purpose BCI research and development platform called BCI2000. BCI2000 can incorporate alone or in combination any brain signals, signal processing methods, output devices, and operating protocols. This report is intended to describe to investigators, biomedical engineers, and computer scientists the concepts that the BC12000 system is based upon and gives examples of successful BCI implementations using this system. To date, we have used BCI2000 to create BCI systems for a variety of brain signals, processing methods, and applications. The data show that these systems function well in online operation and that BCI2000 satisfies the stringent real-time requirements of BCI systems. By substantially reducing labor and cost, BCI2000 facilitates the implementation of different BCI systems and other psychophysiological experiments. It is available with full documentation and free of charge for research or educational purposes and is currently being used in a variety of studies by many research groups. VL - 51 UR - http://www.ncbi.nlm.nih.gov/pubmed/15188875 ER - TY - JOUR T1 - A brain-computer interface using electrocorticographic signals in humans. JF - J Neural Eng Y1 - 2004 A1 - Leuthardt, E C A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Ojemann, J G A1 - Moran, D KW - Adult KW - Brain KW - Communication Aids for Disabled KW - Computer Peripherals KW - Diagnosis, Computer-Assisted KW - Electrodes, Implanted KW - Electroencephalography KW - Evoked Potentials KW - Female KW - Humans KW - Imagination KW - Male KW - Movement Disorders KW - User-Computer Interface AB -

Brain-computer interfaces (BCIs) enable users to control devices with electroencephalographic (EEG) activity from the scalp or with single-neuron activity from within the brain. Both methods have disadvantages: EEG has limited resolution and requires extensive training, while single-neuron recording entails significant clinical risks and has limited stability. We demonstrate here for the first time that electrocorticographic (ECoG) activity recorded from the surface of the brain can enable users to control a one-dimensional computer cursor rapidly and accurately. We first identified ECoG signals that were associated with different types of motor and speech imagery. Over brief training periods of 3-24 min, four patients then used these signals to master closed-loop control and to achieve success rates of 74-100% in a one-dimensional binary task. In additional open-loop experiments, we found that ECoG signals at frequencies up to 180 Hz encoded substantial information about the direction of two-dimensional joystick movements. Our results suggest that an ECoG-based BCI could provide for people with severe motor disabilities a non-muscular communication and control option that is more powerful than EEG-based BCIs and is potentially more stable and less traumatic than BCIs that use electrodes penetrating the brain.

VL - 1 UR - http://www.ncbi.nlm.nih.gov/pubmed/15876624 IS - 2 ER - TY - Generic T1 - Brain-Computer Interfaces; EGI Amp Server; Event-Detection Y1 - 2004 A1 - Gerwin Schalk AB - Electrical Geodesics, Eugene, Oregon ER - TY - Generic T1 - Brain-Computer Interfaces: Present and Future Y1 - 2004 A1 - Gerwin Schalk AB - "BrainDays" Symposium, Rudolf Magnus Institute of Neuroscience, University Medical Center, Utrecht, The Netherlands ER - TY - Generic T1 - Brain-Computer Interfaces: Present and Future Y1 - 2004 A1 - Gerwin Schalk AB - Fondazione Santa Lucia, Rome, Italy ER - TY - Generic T1 - Brain-Computer Interfaces: Present and Future Y1 - 2004 A1 - Gerwin Schalk AB - University of Washington, Seattle, Washington ER - TY - Generic T1 - Brain-Computer Interfaces: Signals, Methods, and Systems Y1 - 2004 A1 - Gerwin Schalk AB - Seminar SeriesNew Frontiers in Brain Machine Interfaces Research. Institute for Infocomm Research(I2R), Singapore ER - TY - Generic T1 - Business in Austria Y1 - 2004 A1 - Gerwin Schalk AB - International Business Panel, Executive MBA Program, Lally School of Management, Rensselaer Polytechnic Institute, Troy, NY ER - TY - Generic T1 - Introduction to Brain-Computer Interfaces Y1 - 2004 A1 - Gerwin Schalk AB - University of Rome "La Sapienza," Rome, Italy ER - TY - JOUR T1 - P300 for communication: Evidence from patients with amyotrophic lateral sclerosis (ALS). JF - Biomedizinische Technik Y1 - 2004 A1 - Mellinger, Jürgen A1 - Nijboer, F A1 - Pawelzik, H A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Theresa M Vaughan A1 - Jonathan Wolpaw A1 - Niels Birbaumer A1 - Kuebler, A. ER - TY - Generic T1 - Brain-Computer Interfaces: Signals, Methods, and Systems Y1 - 2003 A1 - Gerwin Schalk AB - Eberhard Karls University of Tübingen, Tübingen, Germany ER - TY - Generic T1 - Brain-Computer Interfaces: Signals, Methods, and Systems Y1 - 2003 A1 - Gerwin Schalk AB - NASA Ames Research Center, Moffett Field, CA ER - TY - Generic T1 - Brain-Computer Interfaces: Signals, Methods, and Systems Y1 - 2003 A1 - Gerwin Schalk AB - World Congress on Medical Physics and Biomedical Engineering, Sydney, Australia ER - TY - Generic T1 - Brain-Computer Interfaces: Signals, Methods, and Systems Y1 - 2003 A1 - Gerwin Schalk AB - Society for Neuroscience Hudson-Berkshire Chapter, State University of Albany, Albany, NY ER - TY - Generic T1 - Business in Austria Y1 - 2003 A1 - Gerwin Schalk AB - International Business Panel, Executive MBA Program, Lally School of Management, Rensselaer Polytechnic Institute, Troy, NY ER - TY - JOUR T1 - The Wadsworth Center brain-computer interface (BCI) research and development program. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2003 A1 - Jonathan Wolpaw A1 - Dennis J. McFarland A1 - Theresa M Vaughan A1 - Gerwin Schalk KW - Academic Medical Centers KW - Adult KW - Algorithms KW - Artifacts KW - Brain KW - Brain Mapping KW - Electroencephalography KW - Evoked Potentials, Visual KW - Feedback KW - Humans KW - Middle Aged KW - Nervous System Diseases KW - Research KW - Research Design KW - User-Computer Interface KW - Visual Perception AB -

Brain-computer interface (BCI) research at the Wadsworth Center has focused primarily on using electroencephalogram (EEG) rhythms recorded from the scalp over sensorimotor cortex to control cursor movement in one or two dimensions. Recent and current studies seek to improve the speed and accuracy of this control by improving the selection of signal features and their translation into device commands, by incorporating additional signal features, and by optimizing the adaptive interaction between the user and system. In addition, to facilitate the evaluation, comparison, and combination of alternative BCI methods, we have developed a general-purpose BCI system called BCI-2000 and have made it available to other research groups. Finally, in collaboration with several other groups, we are developing simple BCI applications and are testing their practicality and long-term value for people with severe motor disabilities.

VL - 11 UR - http://www.ncbi.nlm.nih.gov/pubmed/12899275 IS - 2 ER - TY - Generic T1 - Brain-Computer Interfaces and BCI2000 Y1 - 2002 A1 - Gerwin Schalk AB - Georgia State University, Atlanta, Georgia ER - TY - Generic T1 - Brain-Computer Interfaces for Communication and Control Y1 - 2002 A1 - Gerwin Schalk AB - 8th International Conference on Functional Mapping of the Human Brain, Sendai, Japan ER - TY - Generic T1 - General-Purpose Brain-Computer Interfaces (BCI) System Y1 - 2002 A1 - Gerwin Schalk AB - 33rd Neural Prosthesis Workshop, National Library of Medicine / NIH, Bethesda, Maryland ER - TY - JOUR T1 - Temporal transformation of multiunit activity improves identification of single motor units. JF - J Neurosci Methods Y1 - 2002 A1 - Gerwin Schalk A1 - Jonathan S. Carp A1 - Jonathan Wolpaw KW - Action Potentials KW - Animals KW - Electromyography KW - H-Reflex KW - Motor Neurons KW - Muscle, Skeletal KW - Rats KW - Signal Processing, Computer-Assisted AB -

This report describes a temporally based method for identifying repetitive firing of motor units. This approach is ideally suited to spike trains with negative serially correlated inter-spike intervals (ISIs). It can also be applied to spike trains in which ISIs exhibit little serial correlation if their coefficient of variation (COV) is sufficiently low. Using a novel application of the Hough transform, this method (i.e. the modified Hough transform (MHT)) maps motor unit action potential (MUAP) firing times into a feature space with ISI and offset (defined as the latency from an arbitrary starting time to the first MUAP in the train) as dimensions. Each MUAP firing time corresponds to a pattern in the feature space that represents all possible MUAP trains with a firing at that time. Trains with stable ISIs produce clusters in the feature space, whereas randomly firing trains do not. The MHT provides a direct estimate of mean firing rate and its variability for the entire data segment, even if several individual MUAPs are obscured by firings from other motor units. Addition of this method to a shape-based classification approach markedly improved rejection of false positives using simulated data and identified spike trains in whole muscle electromyographic recordings from rats. The relative independence of the MHT from the need to correctly classify individual firings permits a global description of stable repetitive firing behavior that is complementary to shape-based approaches to MUAP classification.

VL - 114 UR - http://www.ncbi.nlm.nih.gov/pubmed/11850043 IS - 1 ER - TY - Generic T1 - Brain-Computer Interfaces for Communication and Control Y1 - 2001 A1 - Gerwin Schalk AB - NIPS*2001 Brain-Computer Interface Workshop, Whistler, British Columbia, Canda ER - TY - Generic T1 - Improved Motor Unit Detection Using the Hough Transform Y1 - 2001 A1 - Gerwin Schalk A1 - Jonathan Carp AB - Neuro-Muscular Research Center, Boston University ER - TY - Generic T1 - BCI2000: A Generic Brain-Computer Interface Y1 - 2000 A1 - Gerwin Schalk AB - Department of Medical Informatics, Technical University of Graz ER - TY - JOUR T1 - Brain-computer interface technology: a review of the first international meeting. JF - IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society Y1 - 2000 A1 - Jonathan Wolpaw A1 - Niels Birbaumer A1 - Heetderks, W. J. A1 - Dennis J. McFarland A1 - Peckham, P. H. A1 - Gerwin Schalk A1 - Emanuel Donchin A1 - Quatrano, L. A. A1 - Robinson, C. J. A1 - Theresa M Vaughan KW - augmentative communication KW - Brain-computer interface (BCI) KW - electroencephalography (EEG) AB - Over the past decade, many laboratories have begun to explore brain-computer interface (BCI) technology as a radically new communication option for those with neuromuscular impairments that prevent them from using conventional augmentative communication methods. BCI's provide these users with communication channels that do not depend on peripheral nerves and muscles. This article summarizes the first international meeting devoted to BCI research and development. Current BCI's use electroencephalographic (EEG) activity recorded at the scalp or single-unit activity recorded from within cortex to control cursor movement, select letters or icons, or operate a neuroprosthesis. The central element in each BCI is a translation algorithm that converts electrophysiological input from the user into output that controls external devices. BCI operation depends on effective interaction between two adaptive controllers, the user who encodes his or her commands in the electrophysiological input provided to the BCI, and the BCI which recognizes the commands contained in the input and expresses them in device control. Current BCI's have maximum information transfer rates of 5-25 b/min. Achievement of greater speed and accuracy depends on improvements in signal processing, translation algorithms, and user training. These improvements depend on increased interdisciplinary cooperation between neuroscientists, engineers, computer programmers, psychologists, and rehabilitation specialists, and on adoption and widespread application of objective methods for evaluating alternative methods. The practical use of BCI technology depends on the development of appropriate applications, identification of appropriate user groups, and careful attention to the needs and desires of individual users. BCI research and development will also benefit from greater emphasis on peer-reviewed publications, and from adoption of standard venues for presentations and discussion. VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/10896178 ER - TY - JOUR T1 - Brain-computer interface technology: a review of the first international meeting. JF - IEEE Trans Rehabil Eng Y1 - 2000 A1 - Jonathan Wolpaw A1 - Niels Birbaumer A1 - Heetderks, W J A1 - Dennis J. McFarland A1 - Peckham, P H A1 - Gerwin Schalk A1 - Emanuel Donchin A1 - Quatrano, L A A1 - Robinson, C J A1 - Theresa M Vaughan KW - Algorithms KW - Cerebral Cortex KW - Communication Aids for Disabled KW - Disabled Persons KW - Electroencephalography KW - Evoked Potentials KW - Humans KW - Neuromuscular Diseases KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB -

Over the past decade, many laboratories have begun to explore brain-computer interface (BCI) technology as a radically new communication option for those with neuromuscular impairments that prevent them from using conventional augmentative communication methods. BCI's provide these users with communication channels that do not depend on peripheral nerves and muscles. This article summarizes the first international meeting devoted to BCI research and development. Current BCI's use electroencephalographic (EEG) activity recorded at the scalp or single-unit activity recorded from within cortex to control cursor movement, select letters or icons, or operate a neuroprosthesis. The central element in each BCI is a translation algorithm that converts electrophysiological input from the user into output that controls external devices. BCI operation depends on effective interaction between two adaptive controllers, the user who encodes his or her commands in the electrophysiological input provided to the BCI, and the BCI which recognizes the commands contained in the input and expresses them in device control. Current BCI's have maximum information transfer rates of 5-25 b/min. Achievement of greater speed and accuracy depends on improvements in signal processing, translation algorithms, and user training. These improvements depend on increased interdisciplinary cooperation between neuroscientists, engineers, computer programmers, psychologists, and rehabilitation specialists, and on adoption and widespread application of objective methods for evaluating alternative methods. The practical use of BCI technology depends on the development of appropriate applications, identification of appropriate user groups, and careful attention to the needs and desires of individual users. BCI research and development will also benefit from greater emphasis on peer-reviewed publications, and from adoption of standard venues for presentations and discussion.

VL - 8 UR - http://www.ncbi.nlm.nih.gov/pubmed/10896178 IS - 2 ER - TY - JOUR T1 - EEG-based communication: presence of an error potential. JF - Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology Y1 - 2000 A1 - Gerwin Schalk A1 - Jonathan Wolpaw A1 - Dennis J. McFarland A1 - Pfurtscheller, G. KW - augmentative communication KW - brain-computer interface KW - Electroencephalography KW - error potential KW - error related negativity KW - event related potential KW - mu rhythm KW - Rehabilitation KW - sensorimotor cortex AB - EEG-based communication could be a valuable new augmentative communication technology for those with severe motor disabilities. Like all communication methods, it faces the problem of errors in transmission. In the Wadsworth EEG-based brain-computer interface (BCI) system, subjects learn to use mu or beta rhythm amplitude to move a cursor to targets on a computer screen. While cursor movement is highly accurate in trained subjects, it is not perfect. VL - 111 UR - http://www.ncbi.nlm.nih.gov/pubmed/11090763 ER -