An accurate and rapidly calibrating speech neuroprosthesis.
Nicholas S CardMaitreyee WairagkarCarrina IacobacciXianda HouTyler Singer-ClarkFrancis R WillettErin M KunzChaofei FanMaryam Vahdati NiaDarrel R DeoAparna SrinivasanEun Young ChoiMatthew F GlasserLeigh R HochbergJaimie M HendersonKiarash ShahlaieDavid M BrandmanSergey D StaviskyPublished in: medRxiv : the preprint server for health sciences (2024)
Brain-computer interfaces can enable rapid, intuitive communication for people with paralysis by transforming the cortical activity associated with attempted speech into text on a computer screen. Despite recent advances, communication with brain-computer interfaces has been restricted by extensive training data requirements and inaccurate word output. A man in his 40's with ALS with tetraparesis and severe dysarthria (ALSFRS-R = 23) was enrolled into the BrainGate2 clinical trial. He underwent surgical implantation of four microelectrode arrays into his left precentral gyrus, which recorded neural activity from 256 intracortical electrodes. We report a speech neuroprosthesis that decoded his neural activity as he attempted to speak in both prompted and unstructured conversational settings. Decoded words were displayed on a screen, then vocalized using text-to-speech software designed to sound like his pre-ALS voice. On the first day of system use, following 30 minutes of attempted speech training data, the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. On the second day, the size of the possible output vocabulary increased to 125,000 words, and, after 1.4 additional hours of training data, the neuroprosthesis achieved 90.2% accuracy. With further training data, the neuroprosthesis sustained 97.5% accuracy beyond eight months after surgical implantation. The participant has used the neuroprosthesis to communicate in self-paced conversations for over 248 hours. In an individual with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore naturalistic communication after a brief training period.
Keyphrases
- electronic health record
- virtual reality
- clinical trial
- big data
- hearing loss
- deep learning
- randomized controlled trial
- high throughput
- white matter
- amyotrophic lateral sclerosis
- high resolution
- smoking cessation
- cerebral ischemia
- single cell
- study protocol
- subarachnoid hemorrhage
- phase ii
- drug induced
- carbon nanotubes
- loop mediated isothermal amplification
- sensitive detection