
A DARPA-funded research team has demonstrated for the first time in a human a technology that allows an individual to experience the sensation of touch directly in the brain through a neural interface system connected to a robotic arm.
By enabling two-way communication between brain and machineβoutgoing signals for movement and inbound signals for sensationβthe technology could ultimately support new ways for people to engage with each other and with the world.
The work was supported by DARPAβs Revolutionizing Prosthetics program, and performed by the University of Pittsburgh and the University of Pittsburgh Medical Center.
The results were detailed in a study published online today in the journal Science Translational Medicine and the technology was among a number of advanced demonstrations presented to President Barack Obama today at a White House innovation event in Pittsburgh.
βDARPA has previously demonstrated direct neural control of a robotic arm, and now weβve completed the circuit, sending information from a robotic arm back to the brain,β said Justin Sanchez, Director of DARPAβs Biological Technologies Office and the program manager for Revolutionizing Prosthetics. βThis new capability fundamentally changes the relationship between humans and machines.β
The volunteer for the study, Nathan Copeland, has lived with quadriplegia from the upper chest down since a 2004 car accident that broke his neck and injured his spinal cord.
Nearly ten years following his accident, after agreeing to participate in clinical trials, Nathan underwent surgery to have four microelectrode arraysβeach about half the size of a shirt buttonβplaced in his brain, two in the motor cortex and two in the sensory cortex regions that correspond to feeling in his fingers and palm.
The researchers ran wires from those arrays to a robotic arm developed by the Applied Physics Laboratory (APL) at Johns Hopkins University. The APL arm contains sophisticated torque sensors that can detect when pressure is being applied to any of its fingers, and can convert those physical βsensationsβ into electrical signals that the wires carry back to the arrays in Nathanβs brain to provide precise patterns of stimulation to his sensory neurons.
In the very first set of tests, in which researchers gently touched each of the robotic fingers while Nathan was blindfolded, he was able to report with nearly 100 percent accuracy which finger was being touched. The feeling, he reported, was as if his own hand were being touched.
βAt one point, instead of pressing one finger, the team decided to press two without telling him,β said Sanchez. βHe responded in jest asking whether somebody was trying to play a trick on him. That is when we knew that the feelings he was perceiving through the robotic hand were near-natural.β
These latest results build on a series of DARPA achievements in directly interfacing the brain with a robotic arm. Earlier studies with volunteers Tim Hemmes and Jan Scheuermann demonstrated motor control of the APL arm using a brain-machine interface. βBased on DARPAβs success with those early tests, we asked, βCan we do the experiment in reverse and do for sensation what we did for the motor system?ββ Sanchez said.
DARPA previewed its success with touch restoration in 2015 at βWait, What? A Future Technology Forum,β an event that brought together thought leaders and expert scientists and engineers to generate new ideas and accelerate the development of novel capabilities. Full, peer-reviewed details of the research are described for the first time in todayβs journal article.
The interface system is one of two dozen technological breakthroughs on display today at The White House Frontiers Conference, where Nathan and the lead researchers from Pitt talked about the technology, what it could mean for people living with spinal cord injury, and what new possibilities it could open for society.
Part of the Presidentβs Brain Initiative, DARPAβs Revolutionizing Prosthetics program is funding research to refine stimulation patterns and incorporate new types of sensations beyond pressure to achieve the goals of delivering near-natural motor control and sensation to users of prosthetics. Improvements in these and related neurotechnologies could someday lead to near-seamless combinations of the cognitive functions of the human brain and the computing processes of machines.
Revolutionizing Prosthetics is not DARPAβs only program to pursue the restoration of a sense of touch to amputees. The Agencyβs Hand Proprioception and Touch Interfaces (HAPTIX) program is pursuing an alternative approach, using the peripheral nervous system to communicate motor commands and sensory feedback between the brain and a prosthetic limb. The program plans to initiate take-home trials of a complete, FDA-approved HAPTIX prosthesis system by 2019.