TY - JOUR T1 - A graphical model framework for decoding in the visual ERP-based BCI speller. JF - Neural Comput Y1 - 2011 A1 - Martens, S M M A1 - Mooij, J M A1 - Jeremy Jeremy Hill A1 - Farquhar, Jason A1 - Schölkopf, B KW - Artificial Intelligence KW - Computer User Training KW - Discrimination Learning KW - Electroencephalography KW - Evoked Potentials KW - Evoked Potentials, Visual KW - Humans KW - Language KW - Models, Neurological KW - Models, Theoretical KW - Reading KW - Signal Processing, Computer-Assisted KW - User-Computer Interface KW - Visual Cortex KW - Visual Perception AB -

We present a graphical model framework for decoding in the visual ERP-based speller system. The proposed framework allows researchers to build generative models from which the decoding rules are obtained in a straightforward manner. We suggest two models for generating brain signals conditioned on the stimulus events. Both models incorporate letter frequency information but assume different dependencies between brain signals and stimulus events. For both models, we derive decoding rules and perform a discriminative training. We show on real visual speller data how decoding performance improves by incorporating letter frequency information and using a more realistic graphical model for the dependencies between the brain signals and the stimulus events. Furthermore, we discuss how the standard approach to decoding can be seen as a special case of the graphical model framework. The letter also gives more insight into the discriminative approach for decoding in the visual speller system.

VL - 23 UR - http://www.ncbi.nlm.nih.gov/pubmed/20964540 IS - 1 ER - TY - JOUR T1 - Transition from the locked in to the completely locked-in state: a physiological analysis. JF - Clin Neurophysiol Y1 - 2011 A1 - Murguialday, A Ramos A1 - Jeremy Jeremy Hill A1 - Bensch, M A1 - Martens, S M M A1 - S Halder A1 - Nijboer, F A1 - Schoelkopf, Bernhard A1 - Niels Birbaumer A1 - Gharabaghi, A KW - Adult KW - Amyotrophic Lateral Sclerosis KW - Area Under Curve KW - Brain KW - Communication Aids for Disabled KW - Disease Progression KW - Electroencephalography KW - Electromyography KW - Humans KW - Male KW - Signal Processing, Computer-Assisted KW - User-Computer Interface AB -

OBJECTIVE: 

To clarify the physiological and behavioral boundaries between locked-in (LIS) and the completely locked-in state (CLIS) (no voluntary eye movements, no communication possible) through electrophysiological data and to secure brain-computer-interface (BCI) communication.

METHODS: 

Electromyography from facial muscles, external anal sphincter (EAS), electrooculography and electrocorticographic data during different psychophysiological tests were acquired to define electrophysiological differences in an amyotrophic lateral sclerosis (ALS) patient with an intracranially implanted grid of 112 electrodes for nine months while the patient passed from the LIS to the CLIS.

RESULTS: 

At the very end of the LIS there was no facial muscle activity, nor external anal sphincter but eye control. Eye movements were slow and lasted for short periods only. During CLIS event related brainpotentials (ERP) to passive limb movements and auditory stimuli were recorded, vibrotactile stimulation of different body parts resulted in no ERP response.

CONCLUSIONS: 

The results presented contradict the commonly accepted assumption that the EAS is the last remaining muscle under voluntary control and demonstrate complete loss of eye movements in CLIS. The eye muscle was shown to be the last muscle group under voluntary control. The findings suggest ALS as a multisystem disorder, even affecting afferent sensory pathways.

SIGNIFICANCE: 

Auditory and proprioceptive brain-computer-interface (BCI) systems are the only remaining communication channels in CLIS.

VL - 122 UR - http://www.ncbi.nlm.nih.gov/pubmed/20888292 IS - 5 ER - TY - JOUR T1 - Overlap and refractory effects in a brain-computer interface speller based on the visual P300 event-related potential. JF - J Neural Eng Y1 - 2009 A1 - Martens, S M M A1 - Jeremy Jeremy Hill A1 - Farquhar, Jason A1 - Schölkopf, B KW - Algorithms KW - Brain KW - Cognition KW - Computer Simulation KW - Electroencephalography KW - Event-Related Potentials, P300 KW - Humans KW - Models, Neurological KW - Pattern Recognition, Automated KW - Photic Stimulation KW - Semantics KW - Signal Processing, Computer-Assisted KW - Task Performance and Analysis KW - User-Computer Interface KW - Writing AB -

We reveal the presence of refractory and overlap effects in the event-related potentials in visual P300 speller datasets, and we show their negative impact on the performance of the system. This finding has important implications for how to encode the letters that can be selected for communication. However, we show that such effects are dependent on stimulus parameters: an alternative stimulus type based on apparent motion suffers less from the refractory effects and leads to an improved letter prediction performance.

VL - 6 UR - http://www.ncbi.nlm.nih.gov/pubmed/19255462 IS - 2 ER -