TY - JOUR T1 - Brain-computer interface-based assessment of color vision. JF - J Neural Eng Y1 - 2021 A1 - Norton, James J S A1 - DiRisio, Grace F A1 - Carp, Jonathan S A1 - Norton, Amanda E A1 - Kochan, Nicholas S A1 - Wolpaw, Jonathan R KW - brain-computer interfaces KW - Color Vision KW - Electroencephalography KW - Evoked Potentials, Visual KW - Humans KW - Light KW - Photic Stimulation KW - Research Design AB -

Present methods for assessing color vision require the person's active participation. Here we describe a brain-computer interface-based method for assessing color vision that does not require the person's participation.This method uses steady-state visual evoked potentials to identify metamers-two light sources that have different spectral distributions but appear to the person to be the same color.We demonstrate that: minimization of the visual evoked potential elicited by two flickering light sources identifies the metamer; this approach can distinguish people with color-vision deficits from those with normal color vision; and this metamer-identification process can be automated.This new method has numerous potential clinical, scientific, and industrial applications.

VL - 18 IS - 6 ER - TY - JOUR T1 - A Voting-Enhanced Dynamic-Window-Length Classifier for SSVEP-Based BCIs. JF - IEEE Trans Neural Syst Rehabil Eng Y1 - 2021 A1 - Habibzadeh, Hadi A1 - Norton, James J S A1 - Vaughan, Theresa M A1 - Soyata, Tolga A1 - Zois, Daphney-Stavroula KW - Algorithms KW - brain-computer interfaces KW - Electroencephalography KW - Evoked Potentials, Visual KW - Humans KW - Photic Stimulation AB -

We present a dynamic window-length classifier for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) that does not require the user to choose a feature extraction method or channel set. Instead, the classifier uses multiple feature extraction methods and channel selections to infer the SSVEP and relies on majority voting to pick the most likely target. The classifier extends the window length dynamically if no target obtains the majority of votes. Compared with existing solutions, our classifier: (i) does not assume that any single feature extraction method will consistently outperform the others; (ii) adapts the channel selection to individual users or tasks; (iii) uses dynamic window lengths; (iv) is unsupervised (i.e., does not need training). Collectively, these characteristics make the classifier easy-to-use, especially for caregivers and others with limited technical expertise. We evaluated the performance of our classifier on a publicly available benchmark dataset from 35 healthy participants. We compared the information transfer rate (ITR) of this new classifier to those of the minimum energy combination (MEC), maximum synchronization index (MSI), and filter bank canonical correlation analysis (FBCCA). The new classifier increases average ITR to 123.5 bits-per-minute (bpm), 47.5, 51.2, and 19.5 bpm greater than the MEC, MSI, and FBCCA classifiers, respectively.

VL - 29 ER - TY - JOUR T1 - Brain-computer interface (BCI) evaluation in people with amyotrophic lateral sclerosis. JF - Amyotroph Lateral Scler Frontotemporal Degener Y1 - 2014 A1 - McCane, Lynn M A1 - Sellers, Eric W A1 - Dennis J. McFarland A1 - Mak, Joseph N A1 - Carmack, C Steve A1 - Zeitlin, Debra A1 - Jonathan Wolpaw A1 - Theresa M Vaughan KW - Adult KW - Aged KW - Amyotrophic Lateral Sclerosis KW - Biofeedback, Psychology KW - brain-computer interfaces KW - Communication Disorders KW - Electroencephalography KW - Event-Related Potentials, P300 KW - Female KW - Humans KW - Male KW - Middle Aged KW - Online Systems KW - Photic Stimulation KW - Psychomotor Performance KW - Reaction Time AB - Brain-computer interfaces (BCIs) might restore communication to people severely disabled by amyotrophic lateral sclerosis (ALS) or other disorders. We sought to: 1) define a protocol for determining whether a person with ALS can use a visual P300-based BCI; 2) determine what proportion of this population can use the BCI; and 3) identify factors affecting BCI performance. Twenty-five individuals with ALS completed an evaluation protocol using a standard 6 × 6 matrix and parameters selected by stepwise linear discrimination. With an 8-channel EEG montage, the subjects fell into two groups in BCI accuracy (chance accuracy 3%). Seventeen averaged 92 (± 3)% (range 71-100%), which is adequate for communication (G70 group). Eight averaged 12 (± 6)% (range 0-36%), inadequate for communication (L40 subject group). Performance did not correlate with disability: 11/17 (65%) of G70 subjects were severely disabled (i.e. ALSFRS-R < 5). All L40 subjects had visual impairments (e.g. nystagmus, diplopia, ptosis). P300 was larger and more anterior in G70 subjects. A 16-channel montage did not significantly improve accuracy. In conclusion, most people severely disabled by ALS could use a visual P300-based BCI for communication. In those who could not, visual impairment was the principal obstacle. For these individuals, auditory P300-based BCIs might be effective. VL - 15 UR - http://www.ncbi.nlm.nih.gov/pubmed/24555843 IS - 3-4 ER - TY - JOUR T1 - Nonuniform high-gamma (60-500 Hz) power changes dissociate cognitive task and anatomy in human cortex. JF - J Neurosci Y1 - 2011 A1 - Charles M Gaona A1 - Sharma, Mohit A1 - Zachary V. Freudenberg A1 - Breshears, Jonathan A1 - Bundy, David T A1 - Roland, Jarod A1 - Barbour, Dennis L A1 - Gerwin Schalk A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Analysis of Variance KW - Brain Mapping KW - Brain Waves KW - Cerebral Cortex KW - Cognition Disorders KW - Electroencephalography KW - Epilepsy KW - Evoked Potentials KW - Female KW - Humans KW - Male KW - Middle Aged KW - Neuropsychological Tests KW - Nonlinear Dynamics KW - Photic Stimulation KW - Reaction Time KW - Spectrum Analysis KW - Time Factors KW - Vocabulary AB -

High-gamma-band (>60 Hz) power changes in cortical electrophysiology are a reliable indicator of focal, event-related cortical activity. Despite discoveries of oscillatory subthreshold and synchronous suprathreshold activity at the cellular level, there is an increasingly popular view that high-gamma-band amplitude changes recorded from cellular ensembles are the result of asynchronous firing activity that yields wideband and uniform power increases. Others have demonstrated independence of power changes in the low- and high-gamma bands, but to date, no studies have shown evidence of any such independence above 60 Hz. Based on nonuniformities in time-frequency analyses of electrocorticographic (ECoG) signals, we hypothesized that induced high-gamma-band (60-500 Hz) power changes are more heterogeneous than currently understood. Using single-word repetition tasks in six human subjects, we showed that functional responsiveness of different ECoG high-gamma sub-bands can discriminate cognitive task (e.g., hearing, reading, speaking) and cortical locations. Power changes in these sub-bands of the high-gamma range are consistently present within single trials and have statistically different time courses within the trial structure. Moreover, when consolidated across all subjects within three task-relevant anatomic regions (sensorimotor, Broca's area, and superior temporal gyrus), these behavior- and location-dependent power changes evidenced nonuniform trends across the population. Together, the independence and nonuniformity of power changes across a broad range of frequencies suggest that a new approach to evaluating high-gamma-band cortical activity is necessary. These findings show that in addition to time and location, frequency is another fundamental dimension of high-gamma dynamics.

VL - 31 UR - http://www.ncbi.nlm.nih.gov/pubmed/21307246 IS - 6 ER - TY - JOUR T1 - Does the 'P300' speller depend on eye gaze?. JF - J Neural Eng Y1 - 2010 A1 - Peter Brunner A1 - Joshi, S A1 - S Briskin A1 - Jonathan Wolpaw A1 - H Bischof A1 - Gerwin Schalk KW - Adult KW - Event-Related Potentials, P300 KW - Eye Movements KW - Female KW - Humans KW - Male KW - Middle Aged KW - Models, Neurological KW - Photic Stimulation KW - User-Computer Interface KW - Young Adult AB -

Many people affected by debilitating neuromuscular disorders such as amyotrophic lateral sclerosis, brainstem stroke or spinal cord injury are impaired in their ability to, or are even unable to, communicate. A brain-computer interface (BCI) uses brain signals, rather than muscles, to re-establish communication with the outside world. One particular BCI approach is the so-called 'P300 matrix speller' that was first described by Farwell and Donchin (1988 Electroencephalogr. Clin. Neurophysiol. 70 510-23). It has been widely assumed that this method does not depend on the ability to focus on the desired character, because it was thought that it relies primarily on the P300-evoked potential and minimally, if at all, on other EEG features such as the visual-evoked potential (VEP). This issue is highly relevant for the clinical application of this BCI method, because eye movements may be impaired or lost in the relevant user population. This study investigated the extent to which the performance in a 'P300' speller BCI depends on eye gaze. We evaluated the performance of 17 healthy subjects using a 'P300' matrix speller under two conditions. Under one condition ('letter'), the subjects focused their eye gaze on the intended letter, while under the second condition ('center'), the subjects focused their eye gaze on a fixation cross that was located in the center of the matrix. The results show that the performance of the 'P300' matrix speller in normal subjects depends in considerable measure on gaze direction. They thereby disprove a widespread assumption in BCI research, and suggest that this BCI might function more effectively for people who retain some eye-movement control. The applicability of these findings to people with severe neuromuscular disabilities (particularly in eye-movements) remains to be determined.

VL - 7 UR - http://www.ncbi.nlm.nih.gov/pubmed/20858924 IS - 5 ER - TY - JOUR T1 - Electrocorticographic frequency alteration mapping for extraoperative localization of speech cortex. JF - Neurosurgery Y1 - 2010 A1 - Wu, Melinda A1 - Wisneski, Kimberly A1 - Gerwin Schalk A1 - Sharma, Mohit A1 - Roland, Jarod A1 - Breshears, Jonathan A1 - Charles M Gaona A1 - Leuthardt, E C KW - Acoustic Stimulation KW - Adolescent KW - Adult KW - Brain Mapping KW - Cerebral Cortex KW - Chi-Square Distribution KW - Electroencephalography KW - Epilepsy KW - Female KW - Humans KW - Male KW - Mass Spectrometry KW - Middle Aged KW - Photic Stimulation KW - Speech KW - Verbal Behavior KW - Young Adult AB -

OBJECTIVE: 

Electrocortical stimulation (ECS) has long been established for delineating eloquent cortex in extraoperative mapping. However, ECS is still coarse and inefficient in delineating regions of functional cortex and can be hampered by afterdischarges. Given these constraints, an adjunct approach to defining motor cortex is the use of electrocorticographic (ECoG) signal changes associated with active regions of cortex. The broad range of frequency oscillations are categorized into 2 main groups with respect to sensorimotor cortex: low-frequency bands (LFBs) and high-frequency bands (HFBs). The LFBs tend to show a power reduction, whereas the HFBs show power increases with cortical activation. These power changes associated with activated cortex could potentially provide a powerful tool in delineating areas of speech cortex. We explore ECoG signal alterations as they occur with activated region of speech cortex and its potential in clinical brain mapping applications.

METHODS: 

We evaluated 7 patients who underwent invasive monitoring for seizure localization. Each had extraoperative ECS mapping to identify speech cortex. Additionally, all subjects performed overt speech tasks with an auditory or a visual cue to identify associated frequency power changes in regard to location and degree of concordance with ECS results.

RESULTS: 

Electrocorticographic frequency alteration mapping (EFAM) had an 83.9% sensitivity and a 40.4% specificity in identifying any language site when considering both frequency bands and both stimulus cues. Electrocorticographic frequency alteration mapping was more sensitive in identifying the Wernicke area (100%) than the Broca area (72.2%). The HFB is uniquely suited to identifying the Wernicke area, whereas a combination of the HFB and LFB is important for Broca localization.

CONCLUSION: 

The concordance between stimulation and spectral power changes demonstrates the possible utility of EFAM as an adjunct method to improve the efficiency and resolution of identifying speech cortex.

VL - 66 UR - http://www.ncbi.nlm.nih.gov/pubmed/20087111 IS - 2 ER - TY - Generic T1 - Detection of spontaneous class-specific visual stimuli with high temporal accuracy in human electrocorticography. T2 - Conf Proc IEEE Eng Med Biol Soc Y1 - 2009 A1 - Miller, John W A1 - Hermes, Dora A1 - Gerwin Schalk A1 - Ramsey, Nick F A1 - Jagadeesh, Bharathi A1 - den Nijs, Marcel A1 - Ojemann, J G A1 - Rao, Rajesh P N KW - Algorithms KW - Electrocardiography KW - Evoked Potentials, Visual KW - Humans KW - Male KW - Pattern Recognition, Automated KW - Pattern Recognition, Visual KW - Photic Stimulation KW - Reproducibility of Results KW - Sensitivity and Specificity KW - User-Computer Interface KW - Visual Cortex AB - Most brain-computer interface classification experiments from electrical potential recordings have been focused on the identification of classes of stimuli or behavior where the timing of experimental parameters is known or pre-designated. Real world experience, however, is spontaneous, and to this end we describe an experiment predicting the occurrence, timing, and types of visual stimuli perceived by a human subject from electrocorticographic recordings. All 300 of 300 presented stimuli were correctly detected, with a temporal precision of order 20 ms. The type of stimulus (face/house) was correctly identified in 95% of these cases. There were approximately 20 false alarm events, corresponding to a late 2nd neuronal response to a previously identified event. JF - Conf Proc IEEE Eng Med Biol Soc VL - 2009 ER - TY - JOUR T1 - Overlap and refractory effects in a brain-computer interface speller based on the visual P300 event-related potential. JF - J Neural Eng Y1 - 2009 A1 - Martens, S M M A1 - Jeremy Jeremy Hill A1 - Farquhar, Jason A1 - Schölkopf, B KW - Algorithms KW - Brain KW - Cognition KW - Computer Simulation KW - Electroencephalography KW - Event-Related Potentials, P300 KW - Humans KW - Models, Neurological KW - Pattern Recognition, Automated KW - Photic Stimulation KW - Semantics KW - Signal Processing, Computer-Assisted KW - Task Performance and Analysis KW - User-Computer Interface KW - Writing AB -

We reveal the presence of refractory and overlap effects in the event-related potentials in visual P300 speller datasets, and we show their negative impact on the performance of the system. This finding has important implications for how to encode the letters that can be selected for communication. However, we show that such effects are dependent on stimulus parameters: an alternative stimulus type based on apparent motion suffers less from the refractory effects and leads to an improved letter prediction performance.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/19255462 IS - 2 ER - TY - JOUR T1 - Towards an independent brain-computer interface using steady state visual evoked potentials. JF - Clin Neurophysiol Y1 - 2008 A1 - Brendan Z. Allison A1 - Dennis J. McFarland A1 - Gerwin Schalk A1 - Zheng, Shi Dong A1 - Moore-Jackson, Melody A1 - Jonathan Wolpaw KW - Adolescent KW - Adult KW - Attention KW - Brain KW - Brain Mapping KW - Dose-Response Relationship, Radiation KW - Electroencephalography KW - Evoked Potentials, Visual KW - Female KW - Humans KW - Male KW - Pattern Recognition, Visual KW - Photic Stimulation KW - Spectrum Analysis KW - User-Computer Interface AB -

OBJECTIVE: 

Brain-computer interface (BCI) systems using steady state visual evoked potentials (SSVEPs) have allowed healthy subjects to communicate. However, these systems may not work in severely disabled users because they may depend on gaze shifting. This study evaluates the hypothesis that overlapping stimuli can evoke changes in SSVEP activity sufficient to control a BCI. This would provide evidence that SSVEP BCIs could be used without shifting gaze.

METHODS: 

Subjects viewed a display containing two images that each oscillated at a different frequency. Different conditions used overlapping or non-overlapping images to explore dependence on gaze function. Subjects were asked to direct attention to one or the other of these images during each of 12 one-minute runs.

RESULTS: 

Half of the subjects produced differences in SSVEP activity elicited by overlapping stimuli that could support BCI control. In all remaining users, differences did exist at corresponding frequencies but were not strong enough to allow effective control.

CONCLUSIONS: 

The data demonstrate that SSVEP differences sufficient for BCI control may be elicited by selective attention to one of two overlapping stimuli. Thus, some SSVEP-based BCI approaches may not depend on gaze control. The nature and extent of any BCI's dependence on muscle activity is a function of many factors, including the display, task, environment, and user.

SIGNIFICANCE: 

SSVEP BCIs might function in severely disabled users unable to reliably control gaze. Further research with these users is necessary to explore the optimal parameters of such a system and validate online performance in a home environment.

VL - 119 UR - http://www.ncbi.nlm.nih.gov/pubmed/18077208 IS - 2 ER - TY - JOUR T1 - Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. JF - Neurology Y1 - 2005 A1 - Kübler, A. A1 - Nijboer, F A1 - Mellinger, Jürgen A1 - Theresa M Vaughan A1 - Pawelzik, H A1 - Gerwin Schalk A1 - Dennis J. McFarland A1 - Niels Birbaumer A1 - Jonathan Wolpaw KW - Aged KW - Amyotrophic Lateral Sclerosis KW - Electroencephalography KW - Evoked Potentials, Motor KW - Evoked Potentials, Somatosensory KW - Female KW - Humans KW - Imagination KW - Male KW - Middle Aged KW - Motor Cortex KW - Movement KW - Paralysis KW - Photic Stimulation KW - Prostheses and Implants KW - Somatosensory Cortex KW - Treatment Outcome KW - User-Computer Interface AB -

People with severe motor disabilities can maintain an acceptable quality of life if they can communicate. Brain-computer interfaces (BCIs), which do not depend on muscle control, can provide communication. Four people severely disabled by ALS learned to operate a BCI with EEG rhythms recorded over sensorimotor cortex. These results suggest that a sensorimotor rhythm-based BCI could help maintain quality of life for people with ALS.

VL - 64 UR - http://www.ncbi.nlm.nih.gov/pubmed/15911809 IS - 10 ER -