00307nas a2200109 4500008004100000245002000041210001900061300000800080100002000088700001900108856007000127 2018 eng d00aECoG-Based BCIs0 aECoGBased BCIs a2971 aGunduz, Aysegul1 aSchalk, Gerwin uhttps://www.neurotechcenter.org/publications/2018/ecog-based-bcis01929nas a2200265 4500008004100000245010300041210006900144260000800213300001100221490000600232520106300238653000801301653003001309653000901339653002501348653002501373100002001398700001901418700001801437700002401455700002601479700001901505700001901524856012001543 2016 eng d00aDifferential roles of high gamma and local motor potentials for movement preparation and execution0 aDifferential roles of high gamma and local motor potentials for  cMay a88-1020 v33 aDetermining a person’s intent, such as the planned direction of their movement, directly from their cortical activity could support important applications such as brain-computer interfaces (BCIs). Continuing development of improved BCI systems requires a better understanding of how the brain prepares for and executes movements. To contribute to this understanding, we recorded surface cortical potentials (electrocorticographic signals; ECoG) in 11 human subjects performing a delayed center-out task to establish the differential role of high gamma activity (HGA) and the local motor potential (LMP) as a function of time and anatomical area during movement preparation and execution. High gamma modulations mostly confirm previous findings of sensorimotor cortex involvement, whereas modulations in LMPs are observed in prefrontal cortices. These modulations include directional information during movement planning as well as execution. Our results suggest that sampling signals from these widely distributed cortical areas improves decoding accuracy.10aBCI10abrain-computer interfaces10aECoG10aElectrocorticography10asensorimotor systems1 aGunduz, Aysegul1 aBrunner, Peter1 aSharma, Mohit1 aLeuthardt, Eric, C.1 aRitaccio, Anthony, L.1 aPesaran, Bijan1 aSchalk, Gerwin uhttps://www.neurotechcenter.org/publications/2016/differential-roles-high-gamma-and-local-motor-potentials-movement01004nas a2200229 4500008004100000022001400041245009000055210006900145260000800214300001400222490000700236520032300243100001800566700002100584700001700605700002200622700002200644700002000666700002100686700001900707856004800726 2016 eng d a1525-506900aProceedings of the Eighth International Workshop on Advances in Electrocorticography.0 aProceedings of the Eighth International Workshop on Advances in  cNov a248–2520 v643 aExcerpted proceedings of the Eighth International Workshop on Advances in Electrocorticography (ECoG), which convened October 15-16, 2015 in Chicago, IL, are presented. The workshop series has become the foremost gathering to present current basic and clinical research in subdural brain signal recording and analysis.1 aRitaccio, A L1 aWilliams, Justin1 aDenison, Tim1 aFoster, Brett, L.1 aStarr, Philip, A.1 aGunduz, Aysegul1 aZijlmans, Maeike1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2778008502409nas a2200217 4500008004100000022001400041245012900055210006900184260000800253300001300261490000700274520171000281100002701991700002502018700002402043700002002067700001902087700001802106700001902124856004802143 2016 eng d a1932-620300aSpatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task.0 aSpatioTemporal Progression of Cortical Activity Related to Conti cNov ae01668720 v113 aHow the human brain plans, executes, and monitors continuous and fluent speech has remained largely elusive. For example, previous research has defined the cortical locations most important for different aspects of speech function, but has not yet yielded a definition of the temporal progression of involvement of those locations as speech progresses either overtly or covertly. In this paper, we uncovered the spatio-temporal evolution of neuronal population-level activity related to continuous overt speech, and identified those locations that shared activity characteristics across overt and covert speech. Specifically, we asked subjects to repeat continuous sentences aloud or silently while we recorded electrical signals directly from the surface of the brain (electrocorticography (ECoG)). We then determined the relationship between cortical activity and speech output across different areas of cortex and at sub-second timescales. The results highlight a spatio-temporal progression of cortical involvement in the continuous speech process that initiates utterances in frontal-motor areas and ends with the monitoring of auditory feedback in superior temporal gyrus. Direct comparison of cortical activity related to overt versus covert conditions revealed a common network of brain regions involved in speech that may implement orthographic and phonological processing. Our results provide one of the first characterizations of the spatiotemporal electrophysiological representations of the continuous speech process, and also highlight the common neural substrate of overt and covert speech. These results thereby contribute to a refined understanding of speech functions in the human brain.1 aBrumberg, Jonathan, S.1 aKrusienski, Dean, J.1 aChakrabarti, Shreya1 aGunduz, Aysegul1 aBrunner, Peter1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2787559002354nas a2200277 4500008004100000022001400041245008600055210006900141260001200210300000700222490000600229520153700235653003201772653002701804653002601831653002201857653001201879100001801891700002601909700001901935700002001954700001801974700001701992700001902009856004802028 2015 eng d a1662-516100aElectrocorticographic representations of segmental features in continuous speech.0 aElectrocorticographic representations of segmental features in c c02/2015 a970 v93 aAcoustic speech output results from coordinated articulation of dozens of muscles, bones and cartilages of the vocal mechanism. While we commonly take the fluency and speed of our speech productions for granted, the neural mechanisms facilitating the requisite muscular control are not completely understood. Previous neuroimaging and electrophysiology studies of speech sensorimotor control has typically concentrated on speech sounds (i.e., phonemes, syllables and words) in isolation; sentence-length investigations have largely been used to inform coincident linguistic processing. In this study, we examined the neural representations of segmental features (place and manner of articulation, and voicing status) in the context of fluent, continuous speech production. We used recordings from the cortical surface [electrocorticography (ECoG)] to simultaneously evaluate the spatial topography and temporal dynamics of the neural correlates of speech articulation that may mediate the generation of hypothesized gestural or articulatory scores. We found that the representation of place of articulation involved broad networks of brain regions during all phases of speech production: preparation, execution and monitoring. In contrast, manner of articulation and voicing status were dominated by auditory cortical responses after speech had been initiated. These results provide a new insight into the articulatory and auditory processes underlying speech production in terms of their motor requirements and acoustic correlates.10aelectrocorticography (ECoG)10amanner of articulation10aplace of articulation10aspeech processing10avoicing1 aLotte, Fabien1 aBrumberg, Jonathan, S1 aBrunner, Peter1 aGunduz, Aysegul1 aRitaccio, A L1 aGuan, Cuntai1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2575964702118nas a2200217 4500008004100000245008100041210006900122520141400191653002301605653003501628653001901663653003201682100001701714700001901731700002001750700001501770700001801785700002001803700001901823856005801842 2015 eng d00aIdentifying the Attended Speaker Using Electrocorticographic (ECoG) Signals.0 aIdentifying the Attended Speaker Using Electrocorticographic ECo3 aPeople affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control. Thus, they cannot use traditional assistive communication devices that depend on muscle control, or brain-computer interfaces (BCIs) that depend on the ability to control gaze. While auditory and tactile BCIs can provide communication to such individuals, their use typically entails an artificial mapping between the stimulus and the communication intent. This makes these BCIs difficult to learn and use. In this study, we investigated the use of selective auditory attention to natural speech as an avenue for BCI communication. In this approach, the user communicates by directing his/her attention to one of two simultaneously presented speakers. We used electrocorticographic (ECoG) signals in the gamma band (70–170 Hz) to infer the identity of attended speaker, thereby removing the need to learn such an artificial mapping. Our results from twelve human subjects show that a single cortical location over superior temporal gyrus or pre-motor cortex is typically sufficient to identify the attended speaker within 10 s and with 77% accuracy (50% accuracy due to chance). These results lay the groundwork for future studies that may determine the real-time performance of BCIs based on selective auditory attention to speech.10aauditory attention10aBrain-computer interface (BCI)10aCocktail Party10aelectrocorticography (ECoG)1 aDijkstra, K.1 aBrunner, Peter1 aGunduz, Aysegul1 aCoon, W.G.1 aRitaccio, A L1 aFarquhar, Jason1 aSchalk, Gerwin uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776341/01857nas a2200421 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520059500243653001800838653002900856653003500885653002500920653002300945653004300968653003201011653002101043653002201064653001801086100001801104700001901122700002001141700001701161700002401178700001901202700002101221700002001242700002301262700002201285700001601307700002401323700002101347700001901368856004801387 2014 eng d a1525-506900aProceedings of the Fifth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fifth International Workshop on Advances in E c12/2014 a183-920 v413 a

The Fifth International Workshop on Advances in Electrocorticography convened in San Diego, CA, on November 7-8, 2013. Advancements in methodology, implementation, and commercialization across both research and in the interval year since the last workshop were the focus of the gathering. Electrocorticography (ECoG) is now firmly established as a preferred signal source for advanced research in functional, cognitive, and neuroprosthetic domains. Published output in ECoG fields has increased tenfold in the past decade. These proceedings attempt to summarize the state of the art.

10aBrain Mapping10abrain-computer interface10aelectrical stimulation mapping10aElectrocorticography10afunctional mapping10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aGunduz, Aysegul1 aHermes, Dora1 aHirsch, Lawrence, J1 aJacobs, Joshua1 aKamada, Kyousuke1 aKastner, Sabine1 aKnight, Robert, T.1 aLesser, Ronald, P1 aMiller, Kai1 aSejnowski, Terrence1 aWorrell, Gregory1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2546121302940nas a2200229 4500008004100000245006800041210006600109260001200175520223700187653002402424653002502448653002302473653002202496653002602518100001702544700002502561700001902586700002002605700001802625700001902643856004802662 2014 eng d00aSimultaneous Real-Time Monitoring of Multiple Cortical Systems.0 aSimultaneous RealTime Monitoring of Multiple Cortical Systems c10/20143 aOBJECTIVE: Real-time monitoring of the brain is potentially valuable for performance monitoring, communication, training or rehabilitation. In natural situations, the brain performs a complex mix of various sensory, motor or cognitive functions. Thus, real-time brain monitoring would be most valuable if (a) it could decode information from multiple brain systems simultaneously, and (b) this decoding of each brain system were robust to variations in the activity of other (unrelated) brain systems. Previous studies showed that it is possible to decode some information from different brain systems in retrospect and/or in isolation. In our study, we set out to determine whether it is possible to simultaneously decode important information about a user from different brain systems in real time, and to evaluate the impact of concurrent activity in different brain systems on decoding performance. APPROACH: We study these questions using electrocorticographic signals recorded in humans. We first document procedures for generating stable decoding models given little training data, and then report their use for offline and for real-time decoding from 12 subjects (six for offline parameter optimization, six for online experimentation). The subjects engage in tasks that involve movement intention, movement execution and auditory functions, separately, and then simultaneously. Main Results: Our real-time results demonstrate that our system can identify intention and movement periods in single trials with an accuracy of 80.4% and 86.8%, respectively (where 50% would be expected by chance). Simultaneously, the decoding of the power envelope of an auditory stimulus resulted in an average correlation coefficient of 0.37 between the actual and decoded power envelopes. These decoders were trained separately and executed simultaneously in real time. SIGNIFICANCE: This study yielded the first demonstration that it is possible to decode simultaneously the functional activity of multiple independent brain systems. Our comparison of univariate and multivariate decoding strategies, and our analysis of the influence of their decoding parameters, provides benchmarks and guidelines for future research on this topic.10aauditory processing10aElectrocorticography10amovement intention10arealtime decoding10asimultaneous decoding1 aGupta, Disha1 aHill, Jeremy, Jeremy1 aBrunner, Peter1 aGunduz, Aysegul1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2508016103446nas a2200253 4500008004100000245011700041210006900158260001200227300001100239490000700250520261100257653003402868653002402902653003202926653002802958653002202986653003403008100002103042700001903063700002003082700002303102700001903125856004803144 2014 eng d00aSpatial and temporal relationships of electrocorticographic alpha and gamma activity during auditory processing.0 aSpatial and temporal relationships of electrocorticographic alph c08/2014 a188-950 v973 aNeuroimaging approaches have implicated multiple brain sites in musical perception, including the posterior part of the superior temporal gyrus and adjacent perisylvian areas. However, the detailed spatial and temporal relationship of neural signals that support auditory processing is largely unknown. In this study, we applied a novel inter-subject analysis approach to electrophysiological signals recorded from the surface of the brain (electrocorticography (ECoG)) in ten human subjects. This approach allowed us to reliably identify those ECoG features that were related to the processing of a complex auditory stimulus (i.e., continuous piece of music) and to investigate their spatial, temporal, and causal relationships. Our results identified stimulus-related modulations in the alpha (8-12 Hz) and high gamma (70-110 Hz) bands at neuroanatomical locations implicated in auditory processing. Specifically, we identified stimulus-related ECoG modulations in the alpha band in areas adjacent to primary auditory cortex, which are known to receive afferent auditory projections from the thalamus (80 of a total of 15,107 tested sites). In contrast, we identified stimulus-related ECoG modulations in the high gamma band not only in areas close to primary auditory cortex but also in other perisylvian areas known to be involved in higher-order auditory processing, and in superior premotor cortex (412/15,107 sites). Across all implicated areas, modulations in the high gamma band preceded those in the alpha band by 280 ms, and activity in the high gamma band causally predicted alpha activity, but not vice versa (Granger causality, p<1e(-8)). Additionally, detailed analyses using Granger causality identified causal relationships of high gamma activity between distinct locations in early auditory pathways within superior temporal gyrus (STG) and posterior STG, between posterior STG and inferior frontal cortex, and between STG and premotor cortex. Evidence suggests that these relationships reflect direct cortico-cortical connections rather than common driving input from subcortical structures such as the thalamus. In summary, our inter-subject analyses defined the spatial and temporal relationships between music-related brain activity in the alpha and high gamma bands. They provide experimental evidence supporting current theories about the putative mechanisms of alpha and gamma activity, i.e., reflections of thalamo-cortical interactions and local cortical neural activity, respectively, and the results are also in agreement with existing functional models of auditory processing.10aalpha and high gamma activity10aauditory processing10aelectrocorticography (ECoG)10afunctional connectivity10agranger causality10athalamo-cortical interactions1 aPotes, Cristhian1 aBrunner, Peter1 aGunduz, Aysegul1 aKnight, Robert, T.1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2476893301886nas a2200397 4500008004100000245009000041210006900131260001200200300001300212490000700225520069800232653001800930653003100948653002500979653004301004653003201047653002101079653002201100653001801122100001801140700001901158700002201177700002001199700002501219700002101244700001601265700001901281700001901300700001901319700002001338700002401358700001801382700002101400700001901421856004801440 2013 eng d00aProceedings of the Fourth International Workshop on Advances in Electrocorticography.0 aProceedings of the Fourth International Workshop on Advances in  c11/2013 a259–680 v293 aThe Fourth International Workshop on Advances in Electrocorticography (ECoG) convened in New Orleans, LA, on October 11–12, 2012. The proceedings of the workshop serves as an accurate record of the most contemporary clinical and experimental work on brain surface recording and represents the insights of a unique multidisciplinary ensemble of expert clinicians and scientists. Presentations covered a broad range of topics, including innovations in passive functional mapping, increased understanding of pathologic high-frequency oscillations, evolving sensor technologies, a human trial of ECoG-driven brain–machine interface, as well as fresh insights into brain electrical stimulation.10aBrain Mapping10aBrain–computer interface10aElectrocorticography10aGamma-frequency electroencephalography10aHigh-frequency oscillations10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBrunner, Peter1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aHirsch, Lawrence, J.1 aKanwisher, Nancy1 aLitt, Brian1 aMiller, Kai, J1 aMorani, Daniel1 aParvizi, Josef1 aRamsey, Nick, F1 aRichner, Thomas, J.1 aTandon, Niton1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2403489902234nas a2200181 4500008004100000245005700041210005200098260001200150300001400162490000600176520172300182100001701905700001901922700002001941700001901961700001901980856005301999 2013 eng d00aThe Tracking of Speech Envelope in the Human Cortex.0 aTracking of Speech Envelope in the Human Cortex c01/2013 ae53398 - 0 v83 aHumans are highly adept at processing speech. Recently, it has been shown that slow temporal information in speech (i.e., the envelope of speech) is critical for speech comprehension. Furthermore, it has been found that evoked electric potentials in human cortex are correlated with the speech envelope. However, it has been unclear whether this essential linguistic feature is encoded differentially in specific regions, or whether it is represented throughout the auditory system. To answer this question, we recorded neural data with high temporal resolution directly from the cortex while human subjects listened to a spoken story. We found that the gamma activity in human auditory cortex robustly tracks the speech envelope. The effect is so marked that it is observed during a single presentation of the spoken story to each subject. The effect is stronger in regions situated relatively early in the auditory pathway (belt areas) compared to other regions involved in speech processing, including the superior temporal gyrus (STG) and the posterior inferior frontal gyrus (Broca's region). To further distinguish whether speech envelope is encoded in the auditory system as a phonological (speech-related), or instead as a more general acoustic feature, we also probed the auditory system with a melodic stimulus. We found that belt areas track melody envelope weakly, and as the only region considered. Together, our data provide the first direct electrophysiological evidence that the envelope of speech is robustly tracked in non-primary auditory cortex (belt areas in particular), and suggest that the considered higher-order regions (STG and Broca's region) partake in a more abstract linguistic analysis.1 aKubanek, Jan1 aBrunner, Peter1 aGunduz, Aysegul1 aPoeppel, David1 aSchalk, Gerwin uhttp://dx.doi.org/10.1371%2Fjournal.pone.005339801823nas a2200253 4500008004100000022001400041245009200055210006900147260001200216300001200228490000700240520106200247653002101309653003201330653002901362100002001391700001901411700001601430700001901446700001801465700001901483700001901502856004801521 2012 eng d a1095-957200aDecoding covert spatial attention using electrocorticographic (ECoG) signals in humans.0 aDecoding covert spatial attention using electrocorticographic EC c05/2012 a2285-930 v603 a

This study shows that electrocorticographic (ECoG) signals recorded from the surface of the brain provide detailed information about shifting of visual attention and its directional orientation in humans. ECoG allows for the identification of the cortical areas and time periods that hold the most information about covert attentional shifts. Our results suggest a transient distributed fronto-parietal mechanism for orienting of attention that is represented by different physiological processes. This neural mechanism encodes not only whether or not a subject shifts their attention to a location, but also the locus of attention. This work contributes to our understanding of the electrophysiological representation of attention in humans. It may also eventually lead to brain-computer interfaces (BCIs) that optimize user interaction with their surroundings or that allow people to communicate choices simply by shifting attention to them.

10acovert attention10aelectrocorticography (ECoG)10avisual spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2236633301958nas a2200253 4500008004100000245010000041210006900141260001200210490000600222520117500228653002901403653000901432653003401441653003001475653002401505653002901529100001201558700002001570700001901590700001801609700001001627700001901637856004801656 2012 eng d00aDecoding Onset and Direction of Movements using Electrocorticographic (ECoG) Signals in Humans.0 aDecoding Onset and Direction of Movements using Electrocorticogr c08/20120 v53 aCommunication of intent usually requires motor function. This requirement can be limiting when a person is engaged in a task, or prohibitive for some people suffering from neuromuscular disorders. Determining a person's intent, e.g., where and when to move, from brain signals rather than from muscles would have important applications in clinical or other domains. For example, detection of the onset and direction of intended movements may provide the basis for restoration of simple grasping function in people with chronic stroke, or could be used to optimize a user's interaction with the surrounding environment. Detecting the onset and direction of actual movements are a first step in this direction. In this study, we demonstrate that we can detect the onset of intended movements and their direction using electrocorticographic (ECoG) signals recorded from the surface of the cortex in humans. We also demonstrate in a simulation that the information encoded in ECoG about these movements may improve performance in a targeting task. In summary, the results in this paper suggest that detection of intended movement is possible, and may serve useful functions.10abrain computer interface10aECoG10amovement direction prediction10amovement onset prediction10aneurorehabilitation10aperformance augmentation1 aWang, Z1 aGunduz, Aysegul1 aBrunner, Peter1 aRitaccio, A L1 aJi, Q1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2289105803280nas a2200229 4500008004100000022001400041245012300055210006900178260001200247300001000259490000700269520254700276653002402823653003202847653002402879653002002903100002102923700002002944700001902964700001902983856004803002 2012 eng d a1095-957200aDynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening.0 aDynamics of electrocorticographic ECoG activity in human tempora c07/2012 a841-80 v613 a

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

10aauditory processing10aelectrocorticography (ECoG)10ahigh gamma activity10asound intensity1 aPotes, Cristhian1 aGunduz, Aysegul1 aBrunner, Peter1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2253760001889nas a2200469 4500008004100000022001400041245008900055210006900144260001200213300001100225490000700236520052900243653001800772653002900790653002500819653004300844653003100887653002100918653002200939653001800961100001800979700002300997700002001020700001901040700001801059700002201077700002001099700001701119700002301136700002001159700001601179700001801195700002101213700001901234700001701253700001901270700002201289700002001311700002101331700001901352856004801371 2012 eng d a1525-506900aProceedings of the Third International Workshop on Advances in Electrocorticography.0 aProceedings of the Third International Workshop on Advances in E c12/2012 a605-130 v253 aThe Third International Workshop on Advances in Electrocorticography (ECoG) was convened in Washington, DC, on November 10-11, 2011. As in prior meetings, a true multidisciplinary fusion of clinicians, scientists, and engineers from many disciplines gathered to summarize contemporary experiences in brain surface recordings. The proceedings of this meeting serve as evidence of a very robust and transformative field but will yet again require revision to incorporate the advances that the following year will surely bring.10aBrain Mapping10abrain-computer interface10aElectrocorticography10aGamma-frequency electroencephalography10ahigh-frequency oscillation10aNeuroprosthetics10aSeizure detection10aSubdural grid1 aRitaccio, A L1 aBeauchamp, Michael1 aBosman, Conrado1 aBrunner, Peter1 aChang, Edward1 aCrone, Nathan, E.1 aGunduz, Aysegul1 aGupta, Disha1 aKnight, Robert, T.1 aLeuthardt, Eric1 aLitt, Brian1 aMoran, Daniel1 aOjemann, Jeffrey1 aParvizi, Josef1 aRamsey, Nick1 aRieger, Jochem1 aViventi, Jonathan1 aVoytek, Bradley1 aWilliams, Justin1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2316009610628nas a2200313 4500008004100000022001400041245012900055210006900184260001200253520965800265653001209923653003109935653002509966653002409991653002910015653001310044653003110057653000810088653001710096653001310113100002510126700001710151700001910168700002010187700002210207700001810229700001910247856004810266 2012 eng d a1940-087X00aRecording Human Electrocorticographic (ECoG) Signals for Neuroscientific Research and Real-time Functional Cortical Mapping.0 aRecording Human Electrocorticographic ECoG Signals for Neuroscie c05/20123 a

Neuroimaging studies of human cognitive, sensory, and motor processes are usually based on noninvasive techniques such as electroencephalography (EEG), magnetoencephalography or functional magnetic-resonance imaging. These techniques have either inherently low temporal or low spatial resolution, and suffer from low signal-to-noise ratio and/or poor high-frequency sensitivity. Thus, they are suboptimal for exploring the short-lived spatio-temporal dynamics of many of the underlying brain processes. In contrast, the invasive technique of electrocorticography (ECoG) provides brain signals that have an exceptionally high signal-to-noise ratio, less susceptibility to artifacts than EEG, and a high spatial and temporal resolution (i.e., <1 cm/<1 millisecond, respectively). ECoG involves measurement of electrical brain signals using electrodes that are implanted subdurally on the surface of the brain. Recent studies have shown that ECoG amplitudes in certain frequency bands carry substantial information about task-related activity, such as motor execution and planning, auditory processing and visual-spatial attention. Most of this information is captured in the high gamma range (around 70-110 Hz). Thus, gamma activity has been proposed as a robust and general indicator of local cortical function. ECoG can also reveal functional connectivity and resolve finer task-related spatial-temporal dynamics, thereby advancing our understanding of large-scale cortical processes. It has especially proven useful for advancing brain-computer interfacing (BCI) technology for decoding a user's intentions to enhance or improve communication and control. Nevertheless, human ECoG data are often hard to obtain because of the risks and limitations of the invasive procedures involved, and the need to record within the constraints of clinical settings. Still, clinical monitoring to localize epileptic foci offers a unique and valuable opportunity to collect human ECoG data. We describe our methods for collecting recording ECoG, and demonstrate how to use these signals for important real-time applications such as clinical mapping and brain-computer interfacing. Our example uses the BCI2000 software platform and the SIGFRIED method, an application for real-time mapping of brain functions. This procedure yields information that clinicians can subsequently use to guide the complex and laborious process of functional mapping by electrical stimulation. PREREQUISITES AND PLANNING: Patients with drug-resistant partial epilepsy may be candidates for resective surgery of an epileptic focus to minimize the frequency of seizures. Prior to resection, the patients undergo monitoring using subdural electrodes for two purposes: first, to localize the epileptic focus, and second, to identify nearby critical brain areas (i.e., eloquent cortex) where resection could result in long-term functional deficits. To implant electrodes, a craniotomy is performed to open the skull. Then, electrode grids and/or strips are placed on the cortex, usually beneath the dura. A typical grid has a set of 8 x 8 platinum-iridium electrodes of 4 mm diameter (2.3 mm exposed surface) embedded in silicon with an inter-electrode distance of 1cm. A strip typically contains 4 or 6 such electrodes in a single line. The locations for these grids/strips are planned by a team of neurologists and neurosurgeons, and are based on previous EEG monitoring, on a structural MRI of the patient's brain, and on relevant factors of the patient's history. Continuous recording over a period of 5-12 days serves to localize epileptic foci, and electrical stimulation via the implanted electrodes allows clinicians to map eloquent cortex. At the end of the monitoring period, explantation of the electrodes and therapeutic resection are performed together in one procedure. In addition to its primary clinical purpose, invasive monitoring also provides a unique opportunity to acquire human ECoG data for neuroscientific research. The decision to include a prospective patient in the research is based on the planned location of their electrodes, on the patient's performance scores on neuropsychological assessments, and on their informed consent, which is predicated on their understanding that participation in research is optional and is not related to their treatment. As with all research involving human subjects, the research protocol must be approved by the hospital's institutional review board. The decision to perform individual experimental tasks is made day-by-day, and is contingent on the patient's endurance and willingness to participate. Some or all of the experiments may be prevented by problems with the clinical state of the patient, such as post-operative facial swelling, temporary aphasia, frequent seizures, post-ictal fatigue and confusion, and more general pain or discomfort. At the Epilepsy Monitoring Unit at Albany Medical Center in Albany, New York, clinical monitoring is implemented around the clock using a 192-channel Nihon-Kohden Neurofax monitoring system. Research recordings are made in collaboration with the Wadsworth Center of the New York State Department of Health in Albany. Signals from the ECoG electrodes are fed simultaneously to the research and the clinical systems via splitter connectors. To ensure that the clinical and research systems do not interfere with each other, the two systems typically use separate grounds. In fact, an epidural strip of electrodes is sometimes implanted to provide a ground for the clinical system. Whether research or clinical recording system, the grounding electrode is chosen to be distant from the predicted epileptic focus and from cortical areas of interest for the research. Our research system consists of eight synchronized 16-channel g.USBamp amplifier/digitizer units (g.tec, Graz, Austria). These were chosen because they are safety-rated and FDA-approved for invasive recordings, they have a very low noise-floor in the high-frequency range in which the signals of interest are found, and they come with an SDK that allows them to be integrated with custom-written research software. In order to capture the high-gamma signal accurately, we acquire signals at 1200Hz sampling rate-considerably higher than that of the typical EEG experiment or that of many clinical monitoring systems. A built-in low-pass filter automatically prevents aliasing of signals higher than the digitizer can capture. The patient's eye gaze is tracked using a monitor with a built-in Tobii T-60 eye-tracking system (Tobii Tech., Stockholm, Sweden). Additional accessories such as joystick, bluetooth Wiimote (Nintendo Co.), data-glove (5(th) Dimension Technologies), keyboard, microphone, headphones, or video camera are connected depending on the requirements of the particular experiment. Data collection, stimulus presentation, synchronization with the different input/output accessories, and real-time analysis and visualization are accomplished using our BCI2000 software. BCI2000 is a freely available general-purpose software system for real-time biosignal data acquisition, processing and feedback. It includes an array of pre-built modules that can be flexibly configured for many different purposes, and that can be extended by researchers' own code in C++, MATLAB or Python. BCI2000 consists of four modules that communicate with each other via a network-capable protocol: a Source module that handles the acquisition of brain signals from one of 19 different hardware systems from different manufacturers; a Signal Processing module that extracts relevant ECoG features and translates them into output signals; an Application module that delivers stimuli and feedback to the subject; and the Operator module that provides a graphical interface to the investigator. A number of different experiments may be conducted with any given patient. The priority of experiments will be determined by the location of the particular patient's electrodes. However, we usually begin our experimentation using the SIGFRIED (SIGnal modeling For Realtime Identification and Event Detection) mapping method, which detects and displays significant task-related activity in real time. The resulting functional map allows us to further tailor subsequent experimental protocols and may also prove as a useful starting point for traditional mapping by electrocortical stimulation (ECS). Although ECS mapping remains the gold standard for predicting the clinical outcome of resection, the process of ECS mapping is time consuming and also has other problems, such as after-discharges or seizures. Thus, a passive functional mapping technique may prove valuable in providing an initial estimate of the locus of eloquent cortex, which may then be confirmed and refined by ECS. The results from our passive SIGFRIED mapping technique have been shown to exhibit substantial concurrence with the results derived using ECS mapping. The protocol described in this paper establishes a general methodology for gathering human ECoG data, before proceeding to illustrate how experiments can be initiated using the BCI2000 software platform. Finally, as a specific example, we describe how to perform passive functional mapping using the BCI2000-based SIGFRIED system.

10aBCI200010abrain-computer interfacing10aElectrocorticography10aepilepsy monitoring10afunctional brain mapping10aissue 6410aMagnetic Resonance Imaging10aMRI10aneuroscience10aSIGFRIED1 aHill, Jeremy, Jeremy1 aGupta, Disha1 aBrunner, Peter1 aGunduz, Aysegul1 aAdamo, Matthew, A1 aRitaccio, A L1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2278213101678nas a2200121 4500008004100000245008200041210006900123260001200192520120300204100002001407700001901427856011001446 2011 eng d00aDefense-related insights and solutions from neuroscience and neuroengineering0 aDefenserelated insights and solutions from neuroscience and neur c06/20113 aCommunication of intent usually requires motor function, which can be limiting during military missions. Determining a soldier's intent from brain signals rather than using muscles would have numerous applications for tactical combat. Brain-computer interfaces (BCIs) translate brain signals into machine readable form and could optimize a soldier's interaction with the surrounding environment. However, current BCI devices have largely remained laboratory curiosities, because current techniques either require extended training or do not have the requisite signal fidelity, because they are highly invasive and thus not safe or practical for use in humans, or because they rely on equipment (such as magnetic resonance imaging scanners) that do not allow for real-time applications and/or field deployment. The objective of our research program is to create a prototype of a system for communication and monitoring of orientation that uses brain signals to provide, in real time, an accurate assessment of the users intentional focus and imagined speech. We expect that our efforts will provide a prototype of the first intuitive brain-based communication and orientation system for human use. 1 aGunduz, Aysegul1 aSchalk, Gerwin uhttps://www.neurotechcenter.org/publications/2011/defense-related-insights-and-solutions-neuroscience-and01636nas a2200121 4500008004100000245008300041210006900124260001200193520120100205100002001406700001901426856006901445 2011 eng d00aDefense-related insights and solutions from neuroscience and neuroengineering.0 aDefenserelated insights and solutions from neuroscience and neur c06/20113 aCommunication of intent usually requires motor function, which can be limiting during military missions. Determining a soldier's intent from brain signals rather than using muscles would have numerous applications for tactical combat. Brain-computer interfaces (BCIs) translate brain signals into machine readable form and could optimize a soldier's interaction with the surrounding environment. However, current BCI devices have largely remained laboratory curiosities, because current techniques either require extended training or do not have the requisite signal fidelity, because they are highly invasive and thus not safe or practical for use in humans, or because they rely on equipment (such as magnetic resonance imaging scanners) that do not allow for real-time applications and/or field deployment. The objective of our research program is to create a prototype of a system for communication and monitoring of orientation that uses brain signals to provide, in real time, an accurate assessment of the users intentional focus and imagined speech. We expect that our efforts will provide a prototype of the first intuitive brain-based communication and orientation system for human use.1 aGunduz, Aysegul1 aSchalk, Gerwin uhttp://spie.org/Publications/Proceedings/Paper/10.1117/12.88818902535nas a2200277 4500008004100000022001400041245009300055210006900148260001200217300000700229490000600236520172900242653002101971653002501992653001402017653001902031653002902050100002002079700001902099700001602118700001902134700001802153700001902171700001902190856004802209 2011 eng d a1662-516100aNeural Correlates of Covert Attention in Electrocorticographic (ECoG) Signals in Humans.0 aNeural Correlates of Covert Attention in Electrocorticographic E c09/2011 a890 v53 a

Attention is a cognitive selection mechanism that allocates the limited processing resources of the brain to the sensory streams most relevant to our immediate goals, thereby enhancing responsiveness and behavioral performance. The underlying neural mechanisms of orienting attention are distributed across a widespread cortical network. While aspects of this network have been extensively studied, details about the electrophysiological dynamics of this network are scarce. In this study, we investigated attentional networks using electrocorticographic (ECoG) recordings from the surface of the brain, which combine broad spatial coverage with high temporal resolution, in five human subjects. ECoG was recorded when subjects covertly attended to a spatial location and responded to contrast changes in the presence of distractors in a modified Posner cueing task. ECoG amplitudes in the alpha, beta, and gamma bands identified neural changes associated with covert attention and motor preparation/execution in the different stages of the task. The results show that attentional engagement was primarily associated with ECoG activity in the visual, prefrontal, premotor, and parietal cortices. Motor preparation/execution was associated with ECoG activity in premotor/sensorimotor cortices. In summary, our results illustrate rich and distributed cortical dynamics that are associated with orienting attention and the subsequent motor preparation and execution. These findings are largely consistent with and expand on primate studies using intracortical recordings and human functional neuroimaging studies.

10acovert attention10aElectrocorticography10aintention10amotor response10avisual-spatial attention1 aGunduz, Aysegul1 aBrunner, Peter1 aDaitch, Amy1 aLeuthardt, E C1 aRitaccio, A L1 aPesaran, Bijan1 aSchalk, Gerwin uhttp://www.ncbi.nlm.nih.gov/pubmed/2204615302291nas a2200205 4500008004100000022001400041245005900055210005800114260001200172300001200184490000700196520169200203653001601895653001901911653002301930653002201953100002001975700001901995856007102014 2009 eng d a0165-168400aCorrentropy as a novel measure for nonlinearity tests.0 aCorrentropy as a novel measure for nonlinearity tests c01/2009 a14 - 230 v893 a

Nonlinearity tests have become an essential step in system analysis and modeling due to the computational demands and complexity of analysis involved in nonlinear modeling. Standard nonlinear measures are either too complicated to estimate accurately (such as Lyapunov exponents and correlation dimension), or not able to capture sufficient but not necessary conditions of nonlinearity (such as time asymmetry). Correntropy is a kernel-based similarity measure which contains the information of both statistical and temporal structure of the underlying dataset. The capability of preserving nonlinear characteristics makes correntropy a suitable candidate as a measure for determining nonlinear dynamics. Moreover, since correntropy makes use of kernel methods, its estimation is computationally efficient. Using correntropy as the test statistic, nonlinearity tests based on the null hypothesis that signals of interest are realizations of linear Gaussian stochastic processes are carried out via surrogate data methods. Experiments performed on linear Gaussian, linear non-Gaussian, and nonlinear systems with varying in-band noise levels, data lengths, and kernel sizes confirm that correntropy can be employed as a discriminative measure for detecting nonlinear characteristics in time series. Results of tests performed on data collected from natural systems are in agreement with findings in time series analysis literature.

10aCorrentropy10akernel methods10anonlinearity tests10asurrogate methods1 aGunduz, Aysegul1 aPrincipe, Jose uhttp://www.sciencedirect.com/science/article/pii/S016516840800211902457nas a2200349 4500008004100000022001400041245012600055210006900181260001200250300001200262490000700274520141700281653001501698653001001713653001801723653002601741653002101767653001301788653002401801653000901825653001101834653001801845653001901863653003101882653002301913653004101936100002001977700002301997700002002020700001902040856004802059 2009 eng d a1879-278200aMapping broadband electrocorticographic recordings to two-dimensional hand trajectories in humans Motor control features.0 aMapping broadband electrocorticographic recordings to twodimensi c11/2009 a1257-700 v223 a

Brain-machine interfaces (BMIs) aim to translate the motor intent of locked-in patients into neuroprosthetic control commands. Electrocorticographical (ECoG) signals provide promising neural inputs to BMIs as shown in recent studies. In this paper, we utilize a broadband spectrum above the fast gamma ranges and systematically study the role of spectral resolution, in which the broadband is partitioned, on the reconstruction of the patients' hand trajectories. Traditionally, the power of ECoG rhythms (<200-300 Hz) has been computed in short duration bins and instantaneously and linearly mapped to cursor trajectories. Neither time embedding, nor nonlinear mappings have been previously implemented in ECoG neuroprosthesis. Herein, mapping of neural modulations to goal-oriented motor behavior is achieved via linear adaptive filters with embedded memory depths and as a novelty through echo state networks (ESNs), which provide nonlinear mappings without compromising training complexity or increasing the number of model parameters, with up to 85% correlation. Reconstructed hand trajectories are analyzed through spatial, spectral and temporal sensitivities. The superiority of nonlinear mappings in the cases of low spectral resolution and abundance of interictal activity is discussed.

10aAlgorithms10aBrain10aBrain Mapping10aElectrodes, Implanted10aElectrodiagnosis10aEpilepsy10aFeasibility Studies10aHand10aHumans10aLinear Models10aMotor Activity10aNeural Networks (Computer)10aNonlinear Dynamics10aSignal Processing, Computer-Assisted1 aGunduz, Aysegul1 aSanchez, Justin, C1 aCarney, Paul, R1 aPrincipe, Jose uhttp://www.ncbi.nlm.nih.gov/pubmed/1964798102228nas a2200289 4500008004100000022001400041245012100055210006900176260001200245300001100257490000900268520131200277653001501589653001401604653003301618653002701651653001301678653002901691653001701720653003101737653003201768653002801800100002001828700002301848700001901871856004801890 2008 eng d a1557-170X00aElectrocorticographic interictal spike removal via denoising source separation for improved neuroprosthesis control.0 aElectrocorticographic interictal spike removal via denoising sou c08/2008 a5224-70 v20083 a

Electrocorticographic (ECoG) neuroprosthesis is a promising area of research that could provide channels of communication and control for patients who have lost their motor functions due to damage to the nervous system. However, implantation of subdural electrodes are clinically restricted to diagnostics of pre-surgical epileptic patients. Hence, interictal activity is present in the recordings across various areas of the sensorimotor cortex and suppresses the amplitude modulated features extracted to model hand trajectories. Denoising source separation is a recently introduced framework which extracts hidden structures of interest within the data through denoising the source estimates with filters designed around prior knowledge on the observations. Herein, we exploit the high amplitude quasiperiodic nature of the observed interictal spikes and show that removal of the interictal activity improves linear prediction of hand trajectories.

10aAlgorithms10aArtifacts10aDiagnosis, Computer-Assisted10aElectroencephalography10aEpilepsy10aEvoked Potentials, Motor10aMotor Cortex10aReproducibility of Results10aSensitivity and Specificity10aUser-Computer Interface1 aGunduz, Aysegul1 aSanchez, Justin, C1 aPrincipe, Jose uhttp://www.ncbi.nlm.nih.gov/pubmed/1916389505892nas a2200361 4500008004100000022001400041245010100055210006900156260001200225300001000237490000800247520480000255653001505055653002805070653001805098653002005116653002705136653002405163653001105187653000905198653001105207653003105218653003205249653002805281653004105309653002205350653002805372100002305400700002005423700002005443700001905463856004805482 2008 eng d a0165-027000aExtraction and localization of mesoscopic motor control signals for human ECoG neuroprosthetics.0 aExtraction and localization of mesoscopic motor control signals  c01/2008 a63-810 v1673 a

Electrocorticogram (ECoG) recordings for neuroprosthetics provide a mesoscopic level of abstraction of brain function between microwire single neuron recordings and the electroencephalogram (EEG). Single-trial ECoG neural interfaces require appropriate feature extraction and signal processing methods to identify and model in real-time signatures of motor events in spontaneous brain activity. Here, we develop the clinical experimental paradigm and analysis tools to record broadband (1Hz to 6kHz) ECoG from patients participating in a reaching and pointing task. Motivated by the significant role of amplitude modulated rate coding in extracellular spike based brain-machine interfaces (BMIs), we develop methods to quantify spatio-temporal intermittent increased ECoG voltages to determine if they provide viable control inputs for ECoG neural interfaces. This study seeks to explore preprocessing modalities that emphasize amplitude modulation across frequencies and channels in the ECoG above the level of noisy background fluctuations in order to derive the commands for complex, continuous control tasks. Preliminary experiments show that it is possible to derive online predictive models and spatially localize the generation of commands in the cortex for motor tasks using amplitude modulated ECoG.

10aAdolescent10aBiofeedback, Psychology10aBrain Mapping10aCerebral Cortex10aElectroencephalography10aEpilepsies, Partial10aFemale10aHand10aHumans10aMagnetic Resonance Imaging10aPhysical Therapy Modalities10aPsychomotor Performance10aSignal Processing, Computer-Assisted10aSpectrum Analysis10aUser-Computer Interface1 aSanchez, Justin, C1 aGunduz, Aysegul1 aCarney, Paul, R1 aPrincipe, Jose uhttp://www.ncbi.nlm.nih.gov/pubmed/1758250702708nas a2200373 4500008004100000022001400041245010900055210006900164260001200233300001100245490000600256520162400262653002201886653001201908653001001920653001801930653002501948653001501973653002901988653000902017653002402026653001702050653001202067653000902079653002502088653004102113653002602154100001602180700002302196700001902219700002802238700002002266856004802286 2006 eng d a1557-170X00aAnalysis of the correlation between local field potentials and neuronal firing rate in the motor cortex.0 aAnalysis of the correlation between local field potentials and n c09/2006 a6185-80 v13 a

Neuronal firing rate has been the signal of choice for invasive motor brain machine interfaces (BMI). The use of local field potentials (LFP) in BMI experiments may provide additional dendritic information about movement intent and may improve performance. Here we study the time-varying amplitude modulated relationship between local field potentials (LFP) and single unit activity (SUA) in the motor cortex. We record LFP and SUA in the primary motor cortex of rats trained to perform a lever pressing task, and evaluate the correlation between pairs of peri-event time histograms (PETH) and movement evoked local field potentials (mEP) at the same electrode. Three different correlation coefficients were calculated and compared between the neuronal PETH and the magnitude and power of the mEP. Correlation as high as 0.7 for some neurons occurred between the PETH and the mEP magnitude. As expected, the correlations between the single trial LFP and SUV are much lower due to the inherent variability of both signals.

10aAction Potentials10aAnimals10aBrain10aBrain Mapping10aElectric Stimulation10aElectrodes10aEvoked Potentials, Motor10aMale10aModels, Statistical10aMotor Cortex10aNeurons10aRats10aRats, Sprague-Dawley10aSignal Processing, Computer-Assisted10aSynaptic Transmission1 aWang, Yiwen1 aSanchez, Justin, C1 aPrincipe, Jose1 aMitzelfelt, Jeremiah, D1 aGunduz, Aysegul uhttp://www.ncbi.nlm.nih.gov/pubmed/1794674501203nas a2200169 4500008004100000022001400041245006900055210006700124260001200191300001100203490000600214520065400220100002000874700001900894700002000913856010000933 2005 eng d a1557-170X00aOn-line Detection of Perceptual Signatures in Multichannel ECoG.0 aOnline Detection of Perceptual Signatures in Multichannel ECoG c09/2005 a3683-60 v43 a

Neocortical ECoG studies have unveiled the presence of active states - spatial patterns of amplitude modulation- in the beta- gamma ranges in the presence of conditioned stimuli that resemble cinematographic frames. These sequences of active frames emerge with abrupt phase resettings, followed by resynchronization and stabilization over channels, and magnified intensity. An online pattern recognizer that captures the spatial and spectral characteristics of the active frames is presented. The results of detection are confirmed via high occurrences of pragmatic information, defined by the ratio of pattern intensity to pattern stability.

1 aGunduz, Aysegul1 aPrincipe, Jose1 aFreeman, Walter uhttp://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=1617281&abstractAccess=no&userType=inst