Nature news, 24 APRIL 2019 . Giorgia Guglielmi. "Technology could one day be used to help people who can’t talk to communicate".
In an effort to provide a voice for people who can’t speak, neuroscientists have designed a device that can transform brain signals into speech.
Two examples of a participant reading a sentence, followed by the synthesized version of the sentence generated from their brain activity.
Thursday, April 25, 2019
Speech synthesis from neural decoding of spoken sentences
Gopala K. Anumanchipalli, Josh Chartier & Edward F. Chang ; Nature volume 568, pages 493–498 (2019) doi:10.1038/s41586-019-1119-1
Technology that translates neural activity into speech would be transformative for people who are unable to communicate as a result of neurological impairments. Decoding speech from neural activity is challenging because speaking requires very precise and rapid multi-dimensional control of vocal tract articulators. Here we designed a neural decoder that explicitly leverages kinematic and sound representations encoded in human cortical activity to synthesize audible speech. Recurrent neural networks first decoded directly recorded cortical activity into representations of articulatory movement, and then transformed these representations into speech acoustics. In closed vocabulary tests, listeners could readily identify and transcribe speech synthesized from cortical activity. Intermediate articulatory dynamics enhanced performance even with limited data. Decoded articulatory representations were highly conserved across speakers, enabling a component of the decoder to be transferrable across participants. Furthermore, the decoder could synthesize speech when a participant silently mimed sentences. These findings advance the clinical viability of using speech neuroprosthetic technology to restore spoken communication.
Technology that translates neural activity into speech would be transformative for people who are unable to communicate as a result of neurological impairments. Decoding speech from neural activity is challenging because speaking requires very precise and rapid multi-dimensional control of vocal tract articulators. Here we designed a neural decoder that explicitly leverages kinematic and sound representations encoded in human cortical activity to synthesize audible speech. Recurrent neural networks first decoded directly recorded cortical activity into representations of articulatory movement, and then transformed these representations into speech acoustics. In closed vocabulary tests, listeners could readily identify and transcribe speech synthesized from cortical activity. Intermediate articulatory dynamics enhanced performance even with limited data. Decoded articulatory representations were highly conserved across speakers, enabling a component of the decoder to be transferrable across participants. Furthermore, the decoder could synthesize speech when a participant silently mimed sentences. These findings advance the clinical viability of using speech neuroprosthetic technology to restore spoken communication.
Erythropoietin and Friedreich Ataxia: Time for a Reappraisal?
Boesch S and Indelicato E (2019); Front. Neurosci. 13:386. doi: 10.3389/fnins.2019.00386
Despite several clinical trials in the past, no treatment is available for the treatment of FRDA. Current lines of research focus on gene therapy, frataxin replacement strategies and on regulation of key metabolic checkpoints such as NrF2. Due to potential crosstalk with all these mechanisms, interventions on the EPO pathway still represent a valuable research field. The recent development of small EPO mimetics which maintain cytoprotective properties without erythropoietic action may open a new era in EPO research for the treatment of FRDA.
Despite several clinical trials in the past, no treatment is available for the treatment of FRDA. Current lines of research focus on gene therapy, frataxin replacement strategies and on regulation of key metabolic checkpoints such as NrF2. Due to potential crosstalk with all these mechanisms, interventions on the EPO pathway still represent a valuable research field. The recent development of small EPO mimetics which maintain cytoprotective properties without erythropoietic action may open a new era in EPO research for the treatment of FRDA.
Subscribe to:
Posts (Atom)
