01857nas a2200421 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520059500243653001800838653002900856653003500885653002500920653002300945653004300968653003201011653002101043653002201064653001801086100001801104700001901122700002001141700001701161700002401178700001901202700002101221700002001242700002301262700002201285700001601307700002401323700002101347700001901368856004801387 2014 eng d a1525-506900aProceedings of the Fifth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fifth International Workshop on Advances in E c12/2014 a183-920 v413 a
The Fifth International Workshop on Advances in Electrocorticography convened in San Diego, CA, on November 7-8, 2013. Advancements in methodology, implementation, and commercialization across both research and in the interval year since the last workshop were the focus of the gathering. Electrocorticography (ECoG) is now firmly established as a preferred signal source for advanced research in functional, cognitive, and neuroprosthetic domains. Published output in ECoG fields has increased tenfold in the past decade. These proceedings attempt to summarize the state of the art.
10aBrain Mapping10abrain-computer interface10aelectrical stimulation mapping10aElectrocorticography10afunctional mapping10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aGunduz, Aysegul1 aHermes, Dora1 aHirsch, Lawrence, J1 aJacobs, Joshua1 aKamada, Kyousuke1 aKastner, Sabine1 aKnight, Robert, T.1 aLesser, Ronald, P1 aMiller, Kai1 aSejnowski, Terrence1 aWorrell, Gregory1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2546121302940nas a2200229 4500008004100000245006800041210006600109260001200175520223700187653002402424653002502448653002302473653002202496653002602518100001702544700002502561700001902586700002002605700001802625700001902643856004802662 2014 eng d00aSimultaneous Real-Time Monitoring of Multiple Cortical Systems.0 aSimultaneous RealTime Monitoring of Multiple Cortical Systems c10/20143 aOBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.10aauditory processing10aElectrocorticography10amovement intention10arealtime decoding10asimultaneous decoding1 aGupta, Disha1 aHill, Jeremy, Jeremy1 aBrunner, Peter1 aGunduz, Aysegul1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2508016101886nas a2200397 4500008004100000245009000041210006900131260001200200300001300212490000700225520069800232653001800930653003100948653002500979653004301004653003201047653002101079653002201100653001801122100001801140700001901158700002201177700002001199700002501219700002101244700001601265700001901281700001901300700001901319700002001338700002401358700001801382700002101400700001901421856004801440 2013 eng d00aProceedings of the Fourth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fourth International Workshop on Advances in c11/2013 a259–680 v293 aThe Fourth International Workshop on Advances in Electrocorticography (ECoG) convened in New Orleans, LA, on October 11–12, 2012. The proceedings of the workshop serves as an accurate record of the most contemporary clinical and experimental work on brain surface recording and represents the insights of a unique multidisciplinary ensemble of expert clinicians and scientists. Presentations covered a broad range of topics, including innovations in passive functional mapping, increased understanding of pathologic high-frequency oscillations, evolving sensor technologies, a human trial of ECoG-driven brain–machine interface, as well as fresh insights into brain electrical stimulation.10aBrain Mapping10aBrain–computer interface10aElectrocorticography10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aHirsch, Lawrence, J.1 aKanwisher, Nancy1 aLitt, Brian1 aMiller, Kai, J1 aMorani, Daniel1 aParvizi, Josef1 aRamsey, Nick, F1 aRichner, Thomas, J.1 aTandon, Niton1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2403489901889nas a2200469 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520052900243653001800772653002900790653002500819653004300844653003100887653002100918653002200939653001800961100001800979700002300997700002001020700001901040700001801059700002201077700002001099700001701119700002301136700002001159700001601179700001801195700002101213700001901234700001701253700001901270700002201289700002001311700002101331700001901352856004801371 2012 eng d a1525-506900aProceedings of the Third International Workshop on Advances in Electrocorticography.0 aProceedings of the Third International Workshop on Advances in E c12/2012 a605-130 v253 aThe Third International Workshop on Advances in Electrocorticography (ECoG) was convened in Washington, DC, on November 10-11, 2011. As in prior meetings, a true multidisciplinary fusion of clinicians, scientists, and engineers from many disciplines gathered to summarize contemporary experiences in brain surface recordings. The proceedings of this meeting serve as evidence of a very robust and transformative field but will yet again require revision to incorporate the advances that the following year will surely bring.10aBrain Mapping10abrain-computer interface10aElectrocorticography10aGamma-frequency electroencephalography10ahigh-frequency oscillation10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBeauchamp, Michael1 aBosman, Conrado1 aBrunner, Peter1 aChang, Edward1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aGupta, Disha1 aKnight, Robert, T.1 aLeuthardt, Eric1 aLitt, Brian1 aMoran, Daniel1 aOjemann, Jeffrey1 aParvizi, Josef1 aRamsey, Nick1 aRieger, Jochem1 aViventi, Jonathan1 aVoytek, Bradley1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2316009610628nas a2200313 4500008004100000022001400041245012900055210006900184260001200253520965800265653001209923653003109935653002509966653002409991653002910015653001310044653003110057653000810088653001710096653001310113100002510126700001710151700001910168700002010187700002210207700001810229700001910247856004810266 2012 eng d a1940-087X00aRecording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping.0 aRecording Human Electrocorticographic ECoG Signals for Neuroscie c05/20123 aNeuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), magnetoencephalography or functional magnetic-resonance imaging. These techniques have either inherently low temporal or low spatial resolution, and suffer from low signal-to-noise ratio and/or poor high-frequency sensitivity. Thus, they are suboptimal for exploring the short-lived spatio-temporal dynamics of many of the underlying brain processes. In contrast, the invasive technique of electrocorticography (ECoG) provides brain signals that have an exceptionally high signal-to-noise ratio, less susceptibility to artifacts than EEG, and a high spatial and temporal resolution (i.e., <1 cm/<1 millisecond, respectively). ECoG involves measurement of electrical brain signals using electrodes that are implanted subdurally on the surface of the brain. Recent studies have shown that ECoG amplitudes in certain frequency bands carry substantial information about task-related activity, such as motor execution and planning, auditory processing and visual-spatial attention. Most of this information is captured in the high gamma range (around 70-110 Hz). Thus, gamma activity has been proposed as a robust and general indicator of local cortical function. ECoG can also reveal functional connectivity and resolve finer task-related spatial-temporal dynamics, thereby advancing our understanding of large-scale cortical processes. It has especially proven useful for advancing brain-computer interfacing (BCI) technology for decoding a user's intentions to enhance or improve communication and control. Nevertheless, human ECoG data are often hard to obtain because of the risks and limitations of the invasive procedures involved, and the need to record within the constraints of clinical settings. Still, clinical monitoring to localize epileptic foci offers a unique and valuable opportunity to collect human ECoG data. We describe our methods for collecting recording ECoG, and demonstrate how to use these signals for important real-time applications such as clinical mapping and brain-computer interfacing. Our example uses the BCI2000 software platform and the SIGFRIED method, an application for real-time mapping of brain functions. This procedure yields information that clinicians can subsequently use to guide the complex and laborious process of functional mapping by electrical stimulation. PREREQUISITES AND PLANNING: Patients with drug-resistant partial epilepsy may be candidates for resective surgery of an epileptic focus to minimize the frequency of seizures. Prior to resection, the patients undergo monitoring using subdural electrodes for two purposes: first, to localize the epileptic focus, and second, to identify nearby critical brain areas (i.e., eloquent cortex) where resection could result in long-term functional deficits. To implant electrodes, a craniotomy is performed to open the skull. Then, electrode grids and/or strips are placed on the cortex, usually beneath the dura. A typical grid has a set of 8 x 8 platinum-iridium electrodes of 4 mm diameter (2.3 mm exposed surface) embedded in silicon with an inter-electrode distance of 1cm. A strip typically contains 4 or 6 such electrodes in a single line. The locations for these grids/strips are planned by a team of neurologists and neurosurgeons, and are based on previous EEG monitoring, on a structural MRI of the patient's brain, and on relevant factors of the patient's history. Continuous recording over a period of 5-12 days serves to localize epileptic foci, and electrical stimulation via the implanted electrodes allows clinicians to map eloquent cortex. At the end of the monitoring period, explantation of the electrodes and therapeutic resection are performed together in one procedure. In addition to its primary clinical purpose, invasive monitoring also provides a unique opportunity to acquire human ECoG data for neuroscientific research. The decision to include a prospective patient in the research is based on the planned location of their electrodes, on the patient's performance scores on neuropsychological assessments, and on their informed consent, which is predicated on their understanding that participation in research is optional and is not related to their treatment. As with all research involving human subjects, the research protocol must be approved by the hospital's institutional review board. The decision to perform individual experimental tasks is made day-by-day, and is contingent on the patient's endurance and willingness to participate. Some or all of the experiments may be prevented by problems with the clinical state of the patient, such as post-operative facial swelling, temporary aphasia, frequent seizures, post-ictal fatigue and confusion, and more general pain or discomfort. At the Epilepsy Monitoring Unit at Albany Medical Center in Albany, New York, clinical monitoring is implemented around the clock using a 192-channel Nihon-Kohden Neurofax monitoring system. Research recordings are made in collaboration with the Wadsworth Center of the New York State Department of Health in Albany. Signals from the ECoG electrodes are fed simultaneously to the research and the clinical systems via splitter connectors. To ensure that the clinical and research systems do not interfere with each other, the two systems typically use separate grounds. In fact, an epidural strip of electrodes is sometimes implanted to provide a ground for the clinical system. Whether research or clinical recording system, the grounding electrode is chosen to be distant from the predicted epileptic focus and from cortical areas of interest for the research. Our research system consists of eight synchronized 16-channel g.USBamp amplifier/digitizer units (g.tec, Graz, Austria). These were chosen because they are safety-rated and FDA-approved for invasive recordings, they have a very low noise-floor in the high-frequency range in which the signals of interest are found, and they come with an SDK that allows them to be integrated with custom-written research software. In order to capture the high-gamma signal accurately, we acquire signals at 1200Hz sampling rate-considerably higher than that of the typical EEG experiment or that of many clinical monitoring systems. A built-in low-pass filter automatically prevents aliasing of signals higher than the digitizer can capture. The patient's eye gaze is tracked using a monitor with a built-in Tobii T-60 eye-tracking system (Tobii Tech., Stockholm, Sweden). Additional accessories such as joystick, bluetooth Wiimote (Nintendo Co.), data-glove (5(th) Dimension Technologies), keyboard, microphone, headphones, or video camera are connected depending on the requirements of the particular experiment. Data collection, stimulus presentation, synchronization with the different input/output accessories, and real-time analysis and visualization are accomplished using our BCI2000 software. BCI2000 is a freely available general-purpose software system for real-time biosignal data acquisition, processing and feedback. It includes an array of pre-built modules that can be flexibly configured for many different purposes, and that can be extended by researchers' own code in C++, MATLAB or Python. BCI2000 consists of four modules that communicate with each other via a network-capable protocol: a Source module that handles the acquisition of brain signals from one of 19 different hardware systems from different manufacturers; a Signal Processing module that extracts relevant ECoG features and translates them into output signals; an Application module that delivers stimuli and feedback to the subject; and the Operator module that provides a graphical interface to the investigator. A number of different experiments may be conducted with any given patient. The priority of experiments will be determined by the location of the particular patient's electrodes. However, we usually begin our experimentation using the SIGFRIED (SIGnal modeling For Realtime Identification and Event Detection) mapping method, which detects and displays significant task-related activity in real time. The resulting functional map allows us to further tailor subsequent experimental protocols and may also prove as a useful starting point for traditional mapping by electrocortical stimulation (ECS). Although ECS mapping remains the gold standard for predicting the clinical outcome of resection, the process of ECS mapping is time consuming and also has other problems, such as after-discharges or seizures. Thus, a passive functional mapping technique may prove valuable in providing an initial estimate of the locus of eloquent cortex, which may then be confirmed and refined by ECS. The results from our passive SIGFRIED mapping technique have been shown to exhibit substantial concurrence with the results derived using ECS mapping. The protocol described in this paper establishes a general methodology for gathering human ECoG data, before proceeding to illustrate how experiments can be initiated using the BCI2000 software platform. Finally, as a specific example, we describe how to perform passive functional mapping using the BCI2000-based SIGFRIED system.
10aBCI200010abrain-computer interfacing10aElectrocorticography10aepilepsy monitoring10afunctional brain mapping10aissue 6410aMagnetic Resonance Imaging10aMRI10aneuroscience10aSIGFRIED1 aHill, Jeremy, Jeremy1 aGupta, Disha1 aBrunner, Peter1 aGunduz, Aysegul1 aAdamo, Matthew, A1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2278213102535nas a2200277 4500008004100000022001400041245009300055210006900148260001200217300000700229490000600236520172900242653002101971653002501992653001402017653001902031653002902050100002002079700001902099700001602118700001902134700001802153700001902171700001902190856004802209 2011 eng d a1662-516100aNeural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans.0 aNeural Correlates of Covert Attention in Electrocorticographic E c09/2011 a890 v53 aAttention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.
10acovert attention10aElectrocorticography10aintention10amotor response10avisual-spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2204615303409nas a2200253 4500008004100000022001400041245009700055210006900152260001200221300000600233490000600239520266600245653002902911653002502940653002802965653000902993653001203002100001903014700001803033700002203051700001503073700001903088856004803107 2011 eng d a1662-453X00aRapid Communication with a "P300" Matrix Speller Using Electrocorticographic Signals (ECoG).0 aRapid Communication with a P300 Matrix Speller Using Electrocort c02/2011 a50 v53 aA brain-computer interface (BCI) can provide a non-muscular communication channel to severely disabled people. One particular realization of a BCI is the P300 matrix speller that was originally described by Farwell and Donchin (1988). This speller uses event-related potentials (ERPs) that include the P300 ERP. All previous online studies of the P300 matrix speller used scalp-recorded electroencephalography (EEG) and were limited in their communication performance to only a few characters per minute. In our study, we investigated the feasibility of using electrocorticographic (ECoG) signals for online operation of the matrix speller, and determined associated spelling rates. We used the matrix speller that is implemented in the BCI2000 system. This speller used ECoG signals that were recorded from frontal, parietal, and occipital areas in one subject. This subject spelled a total of 444 characters in online experiments. The results showed that the subject sustained a rate of 17 characters/min (i.e., 69 bits/min), and achieved a peak rate of 22 characters/min (i.e., 113 bits/min). Detailed analysis of the results suggests that ERPs over visual areas (i.e., visual evoked potentials) contribute significantly to the performance of the matrix speller BCI system. Our results also point to potential reasons for the apparent advantages in spelling performance of ECoG compared to EEG. Thus, with additional verification in more subjects, these results may further extend the communication options for people with serious neuromuscular disabilities.
10abrain-computer interface10aElectrocorticography10aevent-related potential10aP30010aspeller1 aBrunner, Peter1 aRitaccio, A L1 aEmrich, Joseph, F1 aBischof, H1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/21369351