%0 Journal Article %J J Neurosci %D 2011 %T Nonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex. %A Charles M Gaona %A Sharma, Mohit %A Zachary V. Freudenberg %A Breshears, Jonathan %A Bundy, David T %A Roland, Jarod %A Barbour, Dennis L %A Gerwin Schalk %A Leuthardt, E C %K Acoustic Stimulation %K Adolescent %K Adult %K Analysis of Variance %K Brain Mapping %K Brain Waves %K Cerebral Cortex %K Cognition Disorders %K Electroencephalography %K Epilepsy %K Evoked Potentials %K Female %K Humans %K Male %K Middle Aged %K Neuropsychological Tests %K Nonlinear Dynamics %K Photic Stimulation %K Reaction Time %K Spectrum Analysis %K Time Factors %K Vocabulary %X

High-gamma-band (>60 Hz) power changes in cortical electrophysiology are a reliable indicator of focal, event-related cortical activity. Despite discoveries of oscillatory subthreshold and synchronous suprathreshold activity at the cellular level, there is an increasingly popular view that high-gamma-band amplitude changes recorded from cellular ensembles are the result of asynchronous firing activity that yields wideband and uniform power increases. Others have demonstrated independence of power changes in the low- and high-gamma bands, but to date, no studies have shown evidence of any such independence above 60 Hz. Based on nonuniformities in time-frequency analyses of electrocorticographic (ECoG) signals, we hypothesized that induced high-gamma-band (60-500 Hz) power changes are more heterogeneous than currently understood. Using single-word repetition tasks in six human subjects, we showed that functional responsiveness of different ECoG high-gamma sub-bands can discriminate cognitive task (e.g., hearing, reading, speaking) and cortical locations. Power changes in these sub-bands of the high-gamma range are consistently present within single trials and have statistically different time courses within the trial structure. Moreover, when consolidated across all subjects within three task-relevant anatomic regions (sensorimotor, Broca's area, and superior temporal gyrus), these behavior- and location-dependent power changes evidenced nonuniform trends across the population. Together, the independence and nonuniformity of power changes across a broad range of frequencies suggest that a new approach to evaluating high-gamma-band cortical activity is necessary. These findings show that in addition to time and location, frequency is another fundamental dimension of high-gamma dynamics.

%B J Neurosci %V 31 %P 2091-100 %8 02/2011 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/21307246 %N 6 %R 10.1523/JNEUROSCI.4722-10.2011 %0 Journal Article %J J Neural Eng %D 2011 %T Using the electrocorticographic speech network to control a brain-computer interface in humans. %A Leuthardt, E C %A Charles M Gaona %A Sharma, Mohit %A Szrama, Nicholas %A Roland, Jarod %A Zachary V. Freudenberg %A Solisb, Jamie %A Breshears, Jonathan %A Gerwin Schalk %K Adult %K Brain %K Brain Mapping %K Computer Peripherals %K Electroencephalography %K Evoked Potentials %K Feedback, Physiological %K Female %K Humans %K Imagination %K Male %K Middle Aged %K Nerve Net %K Speech Production Measurement %K User-Computer Interface %X

Electrocorticography (ECoG) has emerged as a new signal platform for brain-computer interface (BCI) systems. Classically, the cortical physiology that has been commonly investigated and utilized for device control in humans has been brain signals from the sensorimotor cortex. Hence, it was unknown whether other neurophysiological substrates, such as the speech network, could be used to further improve on or complement existing motor-based control paradigms. We demonstrate here for the first time that ECoG signals associated with different overt and imagined phoneme articulation can enable invasively monitored human patients to control a one-dimensional computer cursor rapidly and accurately. This phonetic content was distinguishable within higher gamma frequency oscillations and enabled users to achieve final target accuracies between 68% and 91% within 15 min. Additionally, one of the patients achieved robust control using recordings from a microarray consisting of 1 mm spaced microwires. These findings suggest that the cortical network associated with speech could provide an additional cognitive and physiologic substrate for BCI operation and that these signals can be acquired from a cortical array that is small and minimally invasive.

%B J Neural Eng %V 8 %P 036004 %8 06/2011 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/21471638 %N 3 %R 10.1088/1741-2560/8/3/036004 %0 Journal Article %J IEEE Trans Biomed Eng %D 2010 %T A procedure for measuring latencies in brain-computer interfaces. %A Adam J Wilson %A Mellinger, Jürgen %A Gerwin Schalk %A Williams, Justin C %K Brain %K Computer Systems %K Electroencephalography %K Evoked Potentials %K Humans %K Models, Neurological %K Reproducibility of Results %K Signal Processing, Computer-Assisted %K Time Factors %K User-Computer Interface %X

Brain-computer interface (BCI) systems must process neural signals with consistent timing in order to support adequate system performance. Thus, it is important to have the capability to determine whether a particular BCI configuration (i.e., hardware and software) provides adequate timing performance for a particular experiment. This report presents a method of measuring and quantifying different aspects of system timing in several typical BCI experiments across a range of settings, and presents comprehensive measures of expected overall system latency for each experimental configuration.

%B IEEE Trans Biomed Eng %V 57 %P 1785-97 %8 06/2010 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/20403781 %N 7 %R 10.1109/TBME.2010.2047259 %0 Journal Article %J J Neurosci %D 2008 %T Advanced neurotechnologies for chronic neural interfaces: new horizons and clinical opportunities. %A Kipke, Daryl R %A Shain, William %A Buzsáki, György %A Fetz, Eberhard E %A Henderson, Jaimie M %A Hetke, Jamille F %A Gerwin Schalk %K Cerebral Cortex %K Electrodes, Implanted %K Electroencephalography %K Electronics, Medical %K Electrophysiology %K Evoked Potentials %K Movement Disorders %K Neurons %K Prostheses and Implants %K User-Computer Interface %B J Neurosci %V 28 %P 11830-8 %8 11/2008 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/19005048?report=abstract %N 46 %R 10.1523/JNEUROSCI.3879-08.2008 %0 Journal Article %J Neuroimage %D 2008 %T Real-time detection of event-related brain activity. %A Gerwin Schalk %A Leuthardt, E C %A Peter Brunner %A Ojemann, J G %A Lester A Gerhardt %A Jonathan Wolpaw %K Adult %K Algorithms %K Brain Mapping %K Computer Systems %K Diagnosis, Computer-Assisted %K Electroencephalography %K Epilepsy %K Evoked Potentials %K Female %K Humans %K Male %K Pattern Recognition, Automated %K Reproducibility of Results %K Sensitivity and Specificity %X

The complexity and inter-individual variation of brain signals impedes real-time detection of events in raw signals. To convert these complex signals into results that can be readily understood, current approaches usually apply statistical methods to data from known conditions after all data have been collected. The capability to provide meaningful visualization of complex brain signals without the requirement to initially collect data from all conditions would provide a new tool, essentially a new imaging technique, that would open up new avenues for the study of brain function. Here we show that a new analysis approach, called SIGFRIED, can overcome this serious limitation of current methods. SIGFRIED can visualize brain signal changes without requiring prior data collection from all conditions. This capacity is particularly well suited to applications in which comprehensive prior data collection is impossible or impractical, such as intraoperative localization of cortical function or detection of epileptic seizures.

%B Neuroimage %V 43 %P 245-9 %8 11/2008 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/18718544 %N 2 %R 10.1016/j.neuroimage.2008.07.037 %0 Journal Article %J IEEE Trans Biomed Eng %D 2007 %T A µ-rhythm Matched Filter for Continuous Control of a Brain-Computer Interface. %A Krusienski, Dean J %A Gerwin Schalk %A Dennis J. McFarland %A Jonathan Wolpaw %K Algorithms %K Cerebral Cortex %K Cortical Synchronization %K Electroencephalography %K Evoked Potentials %K Humans %K Imagination %K Pattern Recognition, Automated %K User-Computer Interface %X

A brain-computer interface (BCI) is a system that provides an alternate nonmuscular communication/control channel for individuals with severe neuromuscular disabilities. With proper training, individuals can learn to modulate the amplitude of specific electroencephalographic (EEG) components (e.g., the 8-12 Hz mu rhythm and 18-26 Hz beta rhythm) over the sensorimotor cortex and use them to control a cursor on a computer screen. Conventional spectral techniques for monitoring the continuousamplitude fluctuations fail to capture essential amplitude/phase relationships of the mu and beta rhythms in a compact fashion and, therefore, are suboptimal. By extracting the characteristic mu rhythm for a user, the exact morphology can be characterized and exploited as a matched filter. A simple, parameterized model for the characteristic mu rhythm is proposed and its effectiveness as a matched filter is examined online for a one-dimensional cursor control task. The results suggest that amplitude/phase coupling exists between the mu and beta bands during event-related desynchronization, and that an appropriate matched filter can provide improved performance.

%B IEEE Trans Biomed Eng %V 54 %P 273-80 %8 02/2007 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/17278584 %N 2 %R 10.1109/TBME.2006.886661 %0 Journal Article %J IEEE Trans Neural Syst Rehabil Eng %D 2006 %T The BCI competition III: Validating alternative approaches to actual BCI problems. %A Benjamin Blankertz %A Müller, Klaus-Robert %A Krusienski, Dean J %A Gerwin Schalk %A Jonathan Wolpaw %A Schlögl, Alois %A Pfurtscheller, Gert %A Millán, José del R %A Schröder, Michael %A Niels Birbaumer %K Algorithms %K Brain %K Communication Aids for Disabled %K Databases, Factual %K Electroencephalography %K Evoked Potentials %K Humans %K Neuromuscular Diseases %K Software Validation %K Technology Assessment, Biomedical %K User-Computer Interface %X

brain-computer interface (BCI) is a system that allows its users to control external devices with brainactivity. Although the proof-of-concept was given decades ago, the reliable translation of user intent into device control commands is still a major challenge. Success requires the effective interaction of two adaptive controllers: the user's brain, which produces brain activity that encodes intent, and the BCI system, which translates that activity into device control commands. In order to facilitate this interaction, many laboratories are exploring a variety of signal analysis techniques to improve the adaptation of the BCI system to the user. In the literature, many machine learning and pattern classification algorithms have been reported to give impressive results when applied to BCI data in offline analyses. However, it is more difficult to evaluate their relative value for actual online use. BCI data competitions have been organized to provide objective formal evaluations of alternative methods. Prompted by the great interest in the first two BCI Competitions, we organized the third BCI Competition to address several of the most difficult and important analysis problems in BCI research. The paper describes the data sets that were provided to the competitors and gives an overview of the results.

%B IEEE Trans Neural Syst Rehabil Eng %V 14 %P 153-9 %8 06/2006 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/16792282 %N 2 %R 10.1109/TNSRE.2006.875642 %0 Journal Article %J IEEE Trans Neural Syst Rehabil Eng %D 2006 %T ECoG factors underlying multimodal control of a brain-computer interface. %A Adam J Wilson %A Felton, Elizabeth A %A Garell, P Charles %A Gerwin Schalk %A Williams, Justin C %K Adult %K Brain Mapping %K Cerebral Cortex %K Communication Aids for Disabled %K Computer Peripherals %K Evoked Potentials %K Female %K Humans %K Imagination %K Male %K Man-Machine Systems %K Neuromuscular Diseases %K Systems Integration %K User-Computer Interface %K Volition %X

Most current brain-computer interface (BCI) systems for humans use electroencephalographic activity recorded from the scalp, and may be limited in many ways. Electrocorticography (ECoG) is believed to be a minimally-invasive alternative to electroencephalogram (EEG) for BCI systems, yielding superior signal characteristics that could allow rapid user training and faster communication rates. In addition, our preliminary results suggest that brain regions other than the sensorimotor cortex, such as auditory cortex, may be trained to control a BCI system using similar methods as those used to train motor regions of the brain. This could prove to be vital for users who have neurological disease, head trauma, or other conditions precluding the use of sensorimotor cortex for BCI control.

%B IEEE Trans Neural Syst Rehabil Eng %V 14 %P 246-50 %8 06/2006 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/16792305 %N 2 %R 10.1109/TNSRE.2006.875570 %0 Journal Article %J IEEE Trans Neural Syst Rehabil Eng %D 2006 %T Electrocorticography-based brain computer interface--the Seattle experience. %A Leuthardt, E C %A Miller, John W %A Gerwin Schalk %A Rao, Rajesh P N %A Ojemann, J G %K Cerebral Cortex %K Electroencephalography %K Epilepsy %K Evoked Potentials %K Humans %K Therapy, Computer-Assisted %K User-Computer Interface %K Washington %X

Electrocorticography (ECoG) has been demonstrated to be an effective modality as a platform for brain-computer interfaces (BCIs). Through our experience with ten subjects, we further demonstrate evidence to support the power and flexibility of this signal for BCI usage. In a subset of four patients, closed-loop BCI experiments were attempted with the patient receiving online feedback that consisted of one-dimensional cursor movement controlled by ECoG features that had shown correlation with various real and imagined motor and speech tasks. All four achieved control, with final target accuracies between 73%-100%. We assess the methods for achieving control and the manner in which enhancing online control can be accomplished by rescreening during online tasks. Additionally, we assess the relevant issues of the current experimental paradigm in light of their clinical constraints.

%B IEEE Trans Neural Syst Rehabil Eng %V 14 %P 194-8 %8 06/2006 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/16792292 %N 2 %R 10.1109/TNSRE.2006.875536 %0 Journal Article %J IEEE Trans Neural Syst Rehabil Eng %D 2006 %T The Wadsworth BCI Research and Development Program: At Home with BCI. %A Theresa M Vaughan %A Dennis J. McFarland %A Gerwin Schalk %A Sarnacki, William A %A Krusienski, Dean J %A Sellers, Eric W %A Jonathan Wolpaw %K Animals %K Brain %K Electroencephalography %K Evoked Potentials %K Humans %K Neuromuscular Diseases %K New York %K Research %K Switzerland %K Therapy, Computer-Assisted %K Universities %K User-Computer Interface %X

The ultimate goal of brain-computer interface (BCI) technology is to provide communication and control capacities to people with severe motor disabilities. BCI research at the Wadsworth Center focuses primarily on noninvasive, electroencephalography (EEG)-based BCI methods. We have shown that people, including those with severe motor disabilities, can learn to use sensorimotor rhythms (SMRs) to move a cursor rapidly and accurately in one or two dimensions. We have also improved P300-based BCI operation. We are now translating this laboratory-proven BCI technology into a system that can be used by severely disabled people in their homes with minimal ongoing technical oversight. To accomplish this, we have: improved our general-purpose BCI software (BCI2000); improved online adaptation and feature translation for SMR-based BCI operation; improved the accuracy and bandwidth of P300-based BCI operation; reduced the complexity of system hardware and software and begun to evaluate home system use in appropriate users. These developments have resulted in prototype systems for every day use in people's homes.

%B IEEE Trans Neural Syst Rehabil Eng %V 14 %P 229-33 %8 06/2006 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/16792301 %N 2 %R 10.1109/TNSRE.2006.875577 %0 Journal Article %J IEEE Trans Biomed Eng %D 2004 %T The BCI Competition 2003: Progress and perspectives in detection and discrimination of EEG single trials. %A Benjamin Blankertz %A Müller, Klaus-Robert %A Curio, Gabriel %A Theresa M Vaughan %A Gerwin Schalk %A Jonathan Wolpaw %A Schlögl, Alois %A Neuper, Christa %A Pfurtscheller, Gert %A Hinterberger, T. %A Schröder, Michael %A Niels Birbaumer %K Adult %K Algorithms %K Amyotrophic Lateral Sclerosis %K Artificial Intelligence %K Brain %K Cognition %K Databases, Factual %K Electroencephalography %K Evoked Potentials %K Humans %K Reproducibility of Results %K Sensitivity and Specificity %K User-Computer Interface %X Interest in developing a new method of man-to-machine communication--a brain-computer interface (BCI)--has grown steadily over the past few decades. BCIs create a new communication channel between the brain and an output device by bypassing conventional motor output pathways of nerves and muscles. These systems use signals recorded from the scalp, the surface of the cortex, or from inside the brain to enable users to control a variety of applications including simple word-processing software and orthotics. BCI technology could therefore provide a new communication and control option for individuals who cannot otherwise express their wishes to the outside world. Signal processing and classification methods are essential tools in the development of improved BCI technology. We organized the BCI Competition 2003 to evaluate the current state of the art of these tools. Four laboratories well versed in EEG-based BCI research provided six data sets in a documented format. We made these data sets (i.e., labeled training sets and unlabeled test sets) and their descriptions available on the Internet. The goal in the competition was to maximize the performance measure for the test labels. Researchers worldwide tested their algorithms and competed for the best classification results. This paper describes the six data sets and the results and function of the most successful algorithms. %B IEEE Trans Biomed Eng %V 51 %P 1044-51 %8 06/2004 %G eng %N 6 %R 10.1109/TBME.2004.826692 %0 Journal Article %J IEEE Trans Biomed Eng %D 2004 %T BCI2000: a general-purpose brain-computer interface (BCI) system. %A Gerwin Schalk %A Dennis J. McFarland %A Hinterberger, T. %A Niels Birbaumer %A Jonathan Wolpaw %K Algorithms %K Brain %K Cognition %K Communication Aids for Disabled %K Computer Peripherals %K Electroencephalography %K Equipment Design %K Equipment Failure Analysis %K Evoked Potentials %K Humans %K Systems Integration %K User-Computer Interface %X Many laboratories have begun to develop brain-computer interface (BCI) systems that provide communication and control capabilities to people with severe motor disabilities. Further progress and realization of practical applications depends on systematic evaluations and comparisons of different brain signals, recording methods, processing algorithms, output formats, and operating protocols. However, the typical BCI system is designed specifically for one particular BCI method and is, therefore, not suited to the systematic studies that are essential for continued progress. In response to this problem, we have developed a documented general-purpose BCI research and development platform called BCI2000. BCI2000 can incorporate alone or in combination any brain signals, signal processing methods, output devices, and operating protocols. This report is intended to describe to investigators, biomedical engineers, and computer scientists the concepts that the BC12000 system is based upon and gives examples of successful BCI implementations using this system. To date, we have used BCI2000 to create BCI systems for a variety of brain signals, processing methods, and applications. The data show that these systems function well in online operation and that BCI2000 satisfies the stringent real-time requirements of BCI systems. By substantially reducing labor and cost, BCI2000 facilitates the implementation of different BCI systems and other psychophysiological experiments. It is available with full documentation and free of charge for research or educational purposes and is currently being used in a variety of studies by many research groups. %B IEEE Trans Biomed Eng %V 51 %P 1034-43 %8 06/2004 %G eng %N 6 %R 10.1109/TBME.2004.827072 %0 Journal Article %J J Neural Eng %D 2004 %T A brain-computer interface using electrocorticographic signals in humans. %A Leuthardt, E C %A Gerwin Schalk %A Jonathan Wolpaw %A Ojemann, J G %A Moran, D %K Adult %K Brain %K Communication Aids for Disabled %K Computer Peripherals %K Diagnosis, Computer-Assisted %K Electrodes, Implanted %K Electroencephalography %K Evoked Potentials %K Female %K Humans %K Imagination %K Male %K Movement Disorders %K User-Computer Interface %X

Brain-computer interfaces (BCIs) enable users to control devices with electroencephalographic (EEG) activity from the scalp or with single-neuron activity from within the brain. Both methods have disadvantages: EEG has limited resolution and requires extensive training, while single-neuron recording entails significant clinical risks and has limited stability. We demonstrate here for the first time that electrocorticographic (ECoG) activity recorded from the surface of the brain can enable users to control a one-dimensional computer cursor rapidly and accurately. We first identified ECoG signals that were associated with different types of motor and speech imagery. Over brief training periods of 3-24 min, four patients then used these signals to master closed-loop control and to achieve success rates of 74-100% in a one-dimensional binary task. In additional open-loop experiments, we found that ECoG signals at frequencies up to 180 Hz encoded substantial information about the direction of two-dimensional joystick movements. Our results suggest that an ECoG-based BCI could provide for people with severe motor disabilities a non-muscular communication and control option that is more powerful than EEG-based BCIs and is potentially more stable and less traumatic than BCIs that use electrodes penetrating the brain.

%B J Neural Eng %V 1 %P 63-71 %8 06/2004 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/15876624 %N 2 %R 10.1088/1741-2560/1/2/001 %0 Journal Article %J IEEE Trans Rehabil Eng %D 2000 %T Brain-computer interface technology: a review of the first international meeting. %A Jonathan Wolpaw %A Niels Birbaumer %A Heetderks, W J %A Dennis J. McFarland %A Peckham, P H %A Gerwin Schalk %A Emanuel Donchin %A Quatrano, L A %A Robinson, C J %A Theresa M Vaughan %K Algorithms %K Cerebral Cortex %K Communication Aids for Disabled %K Disabled Persons %K Electroencephalography %K Evoked Potentials %K Humans %K Neuromuscular Diseases %K Signal Processing, Computer-Assisted %K User-Computer Interface %X

Over the past decade, many laboratories have begun to explore brain-computer interface (BCI) technology as a radically new communication option for those with neuromuscular impairments that prevent them from using conventional augmentative communication methods. BCI's provide these users with communication channels that do not depend on peripheral nerves and muscles. This article summarizes the first international meeting devoted to BCI research and development. Current BCI's use electroencephalographic (EEG) activity recorded at the scalp or single-unit activity recorded from within cortex to control cursor movement, select letters or icons, or operate a neuroprosthesis. The central element in each BCI is a translation algorithm that converts electrophysiological input from the user into output that controls external devices. BCI operation depends on effective interaction between two adaptive controllers, the user who encodes his or her commands in the electrophysiological input provided to the BCI, and the BCI which recognizes the commands contained in the input and expresses them in device control. Current BCI's have maximum information transfer rates of 5-25 b/min. Achievement of greater speed and accuracy depends on improvements in signal processing, translation algorithms, and user training. These improvements depend on increased interdisciplinary cooperation between neuroscientists, engineers, computer programmers, psychologists, and rehabilitation specialists, and on adoption and widespread application of objective methods for evaluating alternative methods. The practical use of BCI technology depends on the development of appropriate applications, identification of appropriate user groups, and careful attention to the needs and desires of individual users. BCI research and development will also benefit from greater emphasis on peer-reviewed publications, and from adoption of standard venues for presentations and discussion.

%B IEEE Trans Rehabil Eng %V 8 %P 164-73 %8 06/2000 %G eng %U http://www.ncbi.nlm.nih.gov/pubmed/10896178 %N 2 %R 10.1109/TRE.2000.847807