World first: brain implant lets man speak with expression ― and sing, Device translates thought to speech in real time.
-
This post did not contain any content.
-
This post did not contain any content.
Ok.....that's a bit scary for me.
-
This post did not contain any content.
This is nothing short of stunning, had no idea anyone was even close to this sort of interface. And it's only an 8-bit input! Fuck me, I would have made a (totally ignorant) guess of at least a couple of thousand sensors.
Hoped for a video.
-
This is nothing short of stunning, had no idea anyone was even close to this sort of interface. And it's only an 8-bit input! Fuck me, I would have made a (totally ignorant) guess of at least a couple of thousand sensors.
Hoped for a video.
it's 256 electrodes, yes, but the article doesn't say whether those electrodes are simple digital signals or if each one has some analog range they resolve. Even if it's 100% binary, the tresholding (what level of neural activity is considered a 1 or 0) could be adaptive.
This is amazing technology. I can't imagine how it would feel to have your ability to speak and even sing back after losing it.
-
This post did not contain any content.
Study co-author Maitreyee Wairagkar, a neuroscientist at the University of California, Davis, and her colleagues trained deep-learning algorithms to capture the signals in his brain every 10 milliseconds. Their system decodes, in real time, the sounds the man attempts to produce rather than his intended words or the constituent phonemes — the subunits of speech that form spoken words.
This is a really cool approach. They're not having to determine speech meaning, but instead picking up signals after the person's brain has already done that part and is just trying to vocalize. I'm guessing they can capture nerve impulses that would be moving muscles in the face, mouth, lips, and possibly larynx and then using the AI to quickly determine which sounds that would produce in those few milliseconds those conditions exist. Then the machine to produces the sounds artificially. Because they're able to do this so fast (in 10 milliseconds) it can get close to human body response and reproduction of the specific sounds.
-
it's 256 electrodes, yes, but the article doesn't say whether those electrodes are simple digital signals or if each one has some analog range they resolve. Even if it's 100% binary, the tresholding (what level of neural activity is considered a 1 or 0) could be adaptive.
This is amazing technology. I can't imagine how it would feel to have your ability to speak and even sing back after losing it.
Ah! Didn't consider the input could be analog and not 1 or 0. That opens up a wide range!
-
This post did not contain any content.
This is exciting and terrifying. I am NOT looking forward to the future anymore.