Document Type
Article
Publication Date
2014
DOI
10.1088/1741-2560/11/3/035015
Publication Title
Journal of Neural Engineering
Volume
11
Issue
3
Pages
035015 (1-8)
Abstract
Although brain-computer interfaces (BCIs) can be used in several different ways to restore communication, communicative BCI has not approached the rate or efficiency of natural human speech. Electrocorticography (ECoG) has precise spatiotemporal resolution that enables recording of brain activity distributed over a wide area of cortex, such as during speech production. In this study, we investigated words that span the entire set of phonemes in the General American accent using ECoG with 4 subjects. We classified phonemes with up to 36% accuracy when classifying all phonemes and up to 63% accuracy for a single phoneme. Further, misclassified phonemes follow articulation organization described in phonology literature, aiding classification of whole words. Precise temporal alignment to phoneme onset was crucial for classification success. We identified specific spatiotemporal features that aid classification, which could guide future applications. Word identification was equivalent to information transfer rates as high as 3.0 bits/s (33.6 words min), supporting pursuit of speech articulation for BCI control.
Original Publication Citation
Mugler, E. M., Patton, J. L., Flint, R. D., Wright, Z. A., Schuele, S. U., Rosenow, J., . . . Slutzky, M. W. (2014). Direct classification of all American English phonemes using signals from functional speech motor cortex. Journal of Neural Engineering, 11(3), 035015 doi:10.1088/1741-2560/11/3/035015
Repository Citation
Mugler, Emily M.; Patton, James L.; Flint, Robert D.; Wright, Zachary A.; Schuele, Stephan U.; Rosenow, Joshua; Shih, Jerry J.; Krusienski, Dean J.; and Slutzky, Marc W., "Direct Classification of All American English Phonemes Using Signals From Functional Speech Motor Cortex" (2014). Electrical & Computer Engineering Faculty Publications. 150.
https://digitalcommons.odu.edu/ece_fac_pubs/150
Comments
NOTE: This is the author's post-print version of a work that was published in Journal of Neural Engineering. The final version was published as:
Mugler, E. M., Patton, J. L., Flint, R. D., Wright, Z. A., Schuele, S. U., Rosenow, J., . . . Slutzky, M. W. (2014). Direct classification of all American English phonemes using signals from functional speech motor cortex. Journal of Neural Engineering, 11(3), 035015 doi:10.1088/1741-2560/11/3/035015
Available at: http://dx.doi.org/10.1088/1741-2560/11/3/035015