<?xml version="1.0" encoding="UTF-8"?><xml><records><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Herff, C.</style></author><author><style face="normal" font="default" size="100%">Heger, D.</style></author><author><style face="normal" font="default" size="100%">Pesters, Adriana de</style></author><author><style face="normal" font="default" size="100%">Telaar, D.</style></author><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Gerwin Schalk</style></author><author><style face="normal" font="default" size="100%">Schultz, T.</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Brain-to-text: Decoding spoken sentences from phone representations in the brain.</style></title><secondary-title><style face="normal" font="default" size="100%">Journal of Neural Engineering</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">automatic speech recognition</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">broadband gamma</style></keyword><keyword><style  face="normal" font="default" size="100%">ECoG</style></keyword><keyword><style  face="normal" font="default" size="100%">Electrocorticography</style></keyword><keyword><style  face="normal" font="default" size="100%">pattern recognition</style></keyword><keyword><style  face="normal" font="default" size="100%">speech decoding</style></keyword><keyword><style  face="normal" font="default" size="100%">speech production</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2015</style></year><pub-dates><date><style  face="normal" font="default" size="100%">06/2015</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://journal.frontiersin.org/article/10.3389/fnins.2015.00217/abstract</style></url></web-urls></urls><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">It has long been speculated whether communication between humans and machines based on natural speech related cortical activity is possible. Over the past decade, studies have suggested that it is feasible to recognize isolated aspects of speech from neural signals, such as auditory features, phones or one of a few isolated words. However, until now it remained an unsolved challenge to decode continuously spoken speech from the neural substrate associated with speech and language processing. Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings.Specifically, we implemented a system, which we call Brain-To-Text that models single phones, employs techniques from automatic speech recognition (ASR), and thereby transforms brain activity while speaking into the corresponding textual representation. Our results demonstrate that our system can achieve word error rates as low as 25% and phone error rates below 50%. Additionally, our approach contributes to the current understanding of the neural basis of continuous speech production by identifying those cortical regions that hold substantial information about individual phones. In conclusion, the Brain-To- Text system described in this paper represents an important step toward human-machine communication based on imagined speech.</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">A L Ritaccio</style></author><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Gunduz, Aysegul</style></author><author><style face="normal" font="default" size="100%">Hermes, Dora</style></author><author><style face="normal" font="default" size="100%">Hirsch, Lawrence J</style></author><author><style face="normal" font="default" size="100%">Jacobs, Joshua</style></author><author><style face="normal" font="default" size="100%">Kamada, Kyousuke</style></author><author><style face="normal" font="default" size="100%">Kastner, Sabine</style></author><author><style face="normal" font="default" size="100%">Robert T. Knight</style></author><author><style face="normal" font="default" size="100%">Lesser, Ronald P</style></author><author><style face="normal" font="default" size="100%">Miller, Kai</style></author><author><style face="normal" font="default" size="100%">Sejnowski, Terrence</style></author><author><style face="normal" font="default" size="100%">Worrell, Gregory</style></author><author><style face="normal" font="default" size="100%">Gerwin Schalk</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Proceedings of the Fifth International Workshop on Advances in Electrocorticography.</style></title><secondary-title><style face="normal" font="default" size="100%">Epilepsy Behav</style></secondary-title><alt-title><style face="normal" font="default" size="100%">Epilepsy Behav</style></alt-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">Brain Mapping</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">electrical stimulation mapping</style></keyword><keyword><style  face="normal" font="default" size="100%">Electrocorticography</style></keyword><keyword><style  face="normal" font="default" size="100%">functional mapping</style></keyword><keyword><style  face="normal" font="default" size="100%">Gamma-frequency electroencephalography</style></keyword><keyword><style  face="normal" font="default" size="100%">High-frequency oscillations</style></keyword><keyword><style  face="normal" font="default" size="100%">Neuroprosthetics</style></keyword><keyword><style  face="normal" font="default" size="100%">Seizure detection</style></keyword><keyword><style  face="normal" font="default" size="100%">Subdural grid</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2014</style></year><pub-dates><date><style  face="normal" font="default" size="100%">12/2014</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.ncbi.nlm.nih.gov/pubmed/25461213</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">41</style></volume><pages><style face="normal" font="default" size="100%">183-92</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;The Fifth International Workshop on Advances in Electrocorticography convened in San Diego, CA, on November 7-8, 2013. Advancements in methodology, implementation, and commercialization across both research and in the interval year since the last workshop were the focus of the gathering. Electrocorticography (ECoG) is now firmly established as a preferred signal source for advanced research in functional, cognitive, and neuroprosthetic domains. Published output in ECoG fields has increased tenfold in the past decade. These proceedings attempt to summarize the state of the art.&lt;/p&gt;</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">A L Ritaccio</style></author><author><style face="normal" font="default" size="100%">Beauchamp, Michael</style></author><author><style face="normal" font="default" size="100%">Bosman, Conrado</style></author><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Chang, Edward</style></author><author><style face="normal" font="default" size="100%">Nathan E. Crone</style></author><author><style face="normal" font="default" size="100%">Gunduz, Aysegul</style></author><author><style face="normal" font="default" size="100%">Disha Gupta</style></author><author><style face="normal" font="default" size="100%">Robert T. Knight</style></author><author><style face="normal" font="default" size="100%">Leuthardt, Eric</style></author><author><style face="normal" font="default" size="100%">Litt, Brian</style></author><author><style face="normal" font="default" size="100%">Moran, Daniel</style></author><author><style face="normal" font="default" size="100%">Ojemann, Jeffrey</style></author><author><style face="normal" font="default" size="100%">Parvizi, Josef</style></author><author><style face="normal" font="default" size="100%">Ramsey, Nick</style></author><author><style face="normal" font="default" size="100%">Rieger, Jochem</style></author><author><style face="normal" font="default" size="100%">Viventi, Jonathan</style></author><author><style face="normal" font="default" size="100%">Voytek, Bradley</style></author><author><style face="normal" font="default" size="100%">Williams, Justin</style></author><author><style face="normal" font="default" size="100%">Gerwin Schalk</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Proceedings of the Third International Workshop on Advances in Electrocorticography.</style></title><secondary-title><style face="normal" font="default" size="100%">Epilepsy Behav</style></secondary-title><alt-title><style face="normal" font="default" size="100%">Epilepsy Behav</style></alt-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">Brain Mapping</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">Electrocorticography</style></keyword><keyword><style  face="normal" font="default" size="100%">Gamma-frequency electroencephalography</style></keyword><keyword><style  face="normal" font="default" size="100%">high-frequency oscillation</style></keyword><keyword><style  face="normal" font="default" size="100%">Neuroprosthetics</style></keyword><keyword><style  face="normal" font="default" size="100%">Seizure detection</style></keyword><keyword><style  face="normal" font="default" size="100%">Subdural grid</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2012</style></year><pub-dates><date><style  face="normal" font="default" size="100%">12/2012</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.ncbi.nlm.nih.gov/pubmed/23160096</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">25</style></volume><pages><style face="normal" font="default" size="100%">605-13</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">The Third International Workshop on Advances in Electrocorticography (ECoG) was convened in Washington, DC, on November 10-11, 2011. As in prior meetings, a true multidisciplinary fusion of clinicians, scientists, and engineers from many disciplines gathered to summarize contemporary experiences in brain surface recordings. The proceedings of this meeting serve as evidence of a very robust and transformative field but will yet again require revision to incorporate the advances that the following year will surely bring.</style></abstract><issue><style face="normal" font="default" size="100%">4</style></issue></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">A L Ritaccio</style></author><author><style face="normal" font="default" size="100%">Emrich, Joseph F</style></author><author><style face="normal" font="default" size="100%">H Bischof</style></author><author><style face="normal" font="default" size="100%">Gerwin Schalk</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Rapid Communication with a &quot;P300&quot; Matrix Speller Using Electrocorticographic Signals (ECoG).</style></title><secondary-title><style face="normal" font="default" size="100%">Front Neurosci</style></secondary-title><alt-title><style face="normal" font="default" size="100%">Front Neurosci</style></alt-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">Electrocorticography</style></keyword><keyword><style  face="normal" font="default" size="100%">event-related potential</style></keyword><keyword><style  face="normal" font="default" size="100%">P300</style></keyword><keyword><style  face="normal" font="default" size="100%">speller</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2011</style></year><pub-dates><date><style  face="normal" font="default" size="100%">02/2011</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.ncbi.nlm.nih.gov/pubmed/21369351</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">5</style></volume><pages><style face="normal" font="default" size="100%">5</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;&lt;span style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;A&amp;nbsp;&lt;/span&gt;&lt;span class=&quot;highlight&quot; style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;brain-computer interface&lt;/span&gt;&lt;span style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;&amp;nbsp;(&lt;/span&gt;&lt;span class=&quot;highlight&quot; style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;BCI&lt;/span&gt;&lt;span style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;) can provide a non-muscular communication channel to severely disabled people. One particular realization of a&amp;nbsp;&lt;/span&gt;&lt;span class=&quot;highlight&quot; style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;BCI&lt;/span&gt;&lt;span style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;&amp;nbsp;is the P300 matrix speller that was originally described by Farwell and Donchin (1988). This speller uses event-related potentials (ERPs) that include the P300 ERP. All previous online studies of the P300 matrix speller used scalp-recorded electroencephalography (EEG) and were limited in their communication performance to only a few characters per minute. In our study, we investigated the feasibility of using electrocorticographic (ECoG) signals for online operation of the matrix speller, and determined associated spelling rates. We used the matrix speller that is implemented in the BCI2000 system. This speller used ECoG signals that were recorded from frontal, parietal, and occipital areas in one subject. This subject spelled a total of 444 characters in online experiments. The results showed that the subject sustained a rate of 17&amp;thinsp;characters/min (i.e., 69&amp;thinsp;bits/min), and achieved a peak rate of 22&amp;thinsp;characters/min (i.e., 113&amp;thinsp;bits/min). Detailed analysis of the results suggests that ERPs over visual areas (i.e., visual evoked potentials) contribute significantly to the performance of the matrix speller&amp;nbsp;&lt;/span&gt;&lt;span class=&quot;highlight&quot; style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;BCI&lt;/span&gt;&lt;span style=&quot;font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 17px;&quot;&gt;&amp;nbsp;system. Our results also point to potential reasons for the apparent advantages in spelling performance of ECoG compared to EEG. Thus, with additional verification in more subjects, these results may further extend the communication options for people with serious neuromuscular disabilities.&lt;/span&gt;&lt;/p&gt;</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>47</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Gerwin Schalk</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Brain-Computer Interaction.</style></title><secondary-title><style face="normal" font="default" size="100%">5th Intl. Conference on Augmented Cognition</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">BCI</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">neural engineering</style></keyword><keyword><style  face="normal" font="default" size="100%">neural prosthesis</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2009</style></year><pub-dates><date><style  face="normal" font="default" size="100%">2009</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://link.springer.com/chapter/10.1007%2F978-3-642-02812-0_81</style></url></web-urls></urls><publisher><style face="normal" font="default" size="100%">Springer</style></publisher><isbn><style face="normal" font="default" size="100%">978-3-642-02811-3</style></isbn><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">&lt;p&gt;&lt;span style=&quot;color: #333333; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 13px; line-height: 20px;&quot;&gt;Detection and automated interpretation of attention-related or intention-related brain activity carries significant promise for many military and civilian applications. This interpretation of brain activity could provide information about a person’s intended movements, imagined movements, or attentional focus, and thus could be valuable for optimizing or replacing traditional motor-based communication between a person and a computer or other output devices. We describe here the objective and preliminary results of our studies in this area.&lt;/span&gt;&lt;/p&gt;</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Friedrich, Elisabeth V. C.</style></author><author><style face="normal" font="default" size="100%">Dennis J. McFarland</style></author><author><style face="normal" font="default" size="100%">Neuper, Christa</style></author><author><style face="normal" font="default" size="100%">Theresa M Vaughan</style></author><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Jonathan Wolpaw</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">A scanning protocol for a sensorimotor rhythm-based brain-computer interface.</style></title><secondary-title><style face="normal" font="default" size="100%">Biological psychology</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">BCI</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">scanning protocol</style></keyword><keyword><style  face="normal" font="default" size="100%">sensorimotor rhythm</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2009</style></year><pub-dates><date><style  face="normal" font="default" size="100%">02/2009</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.ncbi.nlm.nih.gov/pubmed/18786603</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">80</style></volume><pages><style face="normal" font="default" size="100%">169–175</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">The scanning protocol is a novel brain-computer interface (BCI) implementation that can be controlled with sensorimotor rhythms (SMRs) of the electroencephalogram (EEG). The user views a screen that shows four choices in a linear array with one marked as target. The four choices are successively highlighted for 2.5s each. When a target is highlighted, the user can select it by modulating the SMR. An advantage of this method is the capacity to choose among multiple choices with just one learned SMR modulation. Each of 10 naive users trained for ten 30 min sessions over 5 weeks. User performance improved significantly (p&lt;0.001) over the sessions and ranged from 30 to 80% mean accuracy of the last three sessions (chance accuracy=25%). The incidence of correct selections depended on the target position. These results suggest that, with further improvements, a scanning protocol can be effective. The ultimate goal is to expand it to a large matrix of selections.</style></abstract></record><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>17</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Klobassa, D. S.</style></author><author><style face="normal" font="default" size="100%">Theresa M Vaughan</style></author><author><style face="normal" font="default" size="100%">Peter Brunner</style></author><author><style face="normal" font="default" size="100%">Schwartz, N. E.</style></author><author><style face="normal" font="default" size="100%">Jonathan Wolpaw</style></author><author><style face="normal" font="default" size="100%">Neuper, C.</style></author><author><style face="normal" font="default" size="100%">Sellers, E. W.</style></author></authors></contributors><titles><title><style face="normal" font="default" size="100%">Toward a high-throughput auditory P300-based brain-computer interface.</style></title><secondary-title><style face="normal" font="default" size="100%">Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology</style></secondary-title></titles><keywords><keyword><style  face="normal" font="default" size="100%">brain-computer interface</style></keyword><keyword><style  face="normal" font="default" size="100%">brain-machine interface</style></keyword><keyword><style  face="normal" font="default" size="100%">EEG</style></keyword><keyword><style  face="normal" font="default" size="100%">event-related potential</style></keyword><keyword><style  face="normal" font="default" size="100%">P300</style></keyword><keyword><style  face="normal" font="default" size="100%">Rehabilitation</style></keyword></keywords><dates><year><style  face="normal" font="default" size="100%">2009</style></year><pub-dates><date><style  face="normal" font="default" size="100%">07/2009</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">http://www.ncbi.nlm.nih.gov/pubmed/19574091</style></url></web-urls></urls><volume><style face="normal" font="default" size="100%">120</style></volume><pages><style face="normal" font="default" size="100%">1252–1261</style></pages><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">OBJECTIVE:
Brain-computer interface (BCI) technology can provide severely disabled people with non-muscular communication. For those most severely disabled, limitations in eye mobility or visual acuity may necessitate auditory BCI systems. The present study investigates the efficacy of the use of six environmental sounds to operate a 6x6 P300 Speller.
METHODS:
A two-group design was used to ascertain whether participants benefited from visual cues early in training. Group A (N=5) received only auditory stimuli during all 11 sessions, whereas Group AV (N=5) received simultaneous auditory and visual stimuli in initial sessions after which the visual stimuli were systematically removed. Stepwise linear discriminant analysis determined the matrix item that elicited the largest P300 response and thereby identified the desired choice.
RESULTS:
Online results and offline analyses showed that the two groups achieved equivalent accuracy. In the last session, eight of 10 participants achieved 50% or more, and four of these achieved 75% or more, online accuracy (2.8% accuracy expected by chance). Mean bit rates averaged about 2 bits/min, and maximum bit rates reached 5.6 bits/min.
CONCLUSIONS:
This study indicates that an auditory P300 BCI is feasible, that reasonable classification accuracy and rate of communication are achievable, and that the paradigm should be further evaluated with a group of severely disabled participants who have limited visual mobility.
SIGNIFICANCE:
With further development, this auditory P300 BCI could be of substantial value to severely disabled people who cannot use a visual BCI.</style></abstract></record></records></xml>