Brain Implant Enables Paralyzed Patients to Communicate via Speech and Gestures

Researchers at the University of California San Francisco have developed a brain implant that allows patients with severe paralysis to communicate through both speech and gestures simultaneously. The device uses a sensor array placed in the sensorimotor cortex to decode neural activity, which is then reflected through a digital avatar on a screen. The findings were published on Monday in the journal Nature Neuroscience.

The study involved three patients suffering from vocal tract and limb paralysis caused by strokes or neurodegenerative diseases such as amyotrophic lateral sclerosis. By utilizing machine learning, the system translated thoughts into commands for the avatar to perform actions like nodding, shrugging, or raising a fist while speaking. In some cases, the system achieved 100 percent average accuracy across speech and gesture decoding. The researchers noted that training the system on both modalities together improved overall performance and reduced errors.

While the current version of the device uses wires to connect implants to external processing units, Professor Edward Chang stated that the team will soon test a fully implantable wireless version. While center left framing emphasizes the restoration of the holistic and natural dynamism of human communication, center right framing highlights the potential for patients to eventually control robots or exoskeletons.