‘Multifunctional’ brain implant translates speech and gestures in real time
- Researchers from the University of California, San Francisco developed a new brain-computer interface that enables people with severe paralysis to speak and control a personalized virtual avatar simultaneously, according to findings published in Nature Neuroscience.
- Previous technology restored functions like speech or cursor control in isolation, but this system is the first to integrate both verbal and non-verbal communication using a surgically implanted array of 253 electrodes.
- Researcher Samantha Brosler explained that artificial intelligence translates brain activity in real time, allowing two independent decoders so participants can use speech, gestures, or both simultaneously.
- Participants were excited to see the system working in real time, with one laughing as his speech and gestures were successfully decoded together, providing what researchers called "expressive interaction."
- Researchers emphasize that testing in more participants with larger sets of phrases and gestures is required before the technology can be deployed for widespread patient use, as this system remains a proof of concept.
34 Articles
34 Articles
New brain computer interface restores simultaneous speech and physical gestures
A National Institutes of Health (NIH)-funded scientific team has shown that a new brain-computer interface (BCI) can allow people with vocal tract and bodily paralysis to convey both speech and upper-body gestures simultaneously.
Scientists at the University of California have developed an AI brain implant that enables paralyzed patients to speak and gesture. The technology decodes signals from the patients' brains and displays voice and gestures through a digital avatar. Lab tests have shown up to 88% accuracy. Read the full details.
In the world of medicine and neurology, a groundbreaking medical achievement has been made for patients who have lost their ability to speak and use motor skills due to severe strokes or Amyotrophic Lateral Sclerosis (ALS).
Observador
SIC NotíciasA team of U.S. researchers created a wired brain implant that captures movements, gestures and words from people suffering from neurodegenerative diseases or speech.
Work opens up the possibility of restoring the natural dynamism of communication in people who have lost their verbal and non-verbal abilities.
The Economist
Hindustan TimesA new device lets severely paralysed patients communicate more effectively
Eventually they might be able to control robots or exoskeletons
Coverage Details
Bias Distribution
- 43% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
