Sony presented a simpler solution to this at CHI https://dl.acm.org/doi/10.1145/3772318.3791397 - check video in that. Also it seems every Cornell student is working on this. Just search on YouTube Cornell silent speech
hdjrudni 3 days ago [-]
> The two biggest hardware challenges are reducing the size and weight of the ultrasound probe and replacing ultrasound gel with a more practical coupling material, such as hydrogel. We think both are solvable, making it possible for the probe to eventually become a lightweight wearable or adhesive patch.
Not sure I'd want to put an adhesive patch on my neck every morning so I can silently talk to an LLM in the cubicle farm. I hope this is not our future.
Very cool tech though and surprisingly good results for so little training.
I think time might be better spent improving a lip reading model (no adhesive required), assuming we're unable to read brainwaves directly.
delichon 7 hours ago [-]
Keeping a camera focused on the lips could get awkward. A hands free throat patch may be more ergonomic.
eviluncle 5 hours ago [-]
Interesting. This seems similar to (though using different methods/techniques) what q.ai (that was sold to Apple for $2b) is developing.
That could be immensely helpful for people who cannot speak due to vocal chord problems.
It could also be the ultimate, always-on remote control for everything around, with a near-zero error rate.
ubedan 3 days ago [-]
Wonderful tech, and video example. I think there may also be a special forces application, but I don't know enough about how well their current solution works.
In the office, a non-contact video solution (lip reading) is likely to be far more popular, but a lot depends on which is more accurate.
ehead 5 hours ago [-]
These guys are on a roll!
readthenotes1 8 hours ago [-]
I wonder if, like with lip reading, they switch from American English to a different language that's not so peculiar they would have and much less error rate
nine_k 6 hours ago [-]
I suppose Spanish or German would be easier to recognize than English, due to the more distinct sounds, but Chinese would be much harder, due to the tones.
m463 7 hours ago [-]
reminds me of the handwriting recognition language Graffiti from palm/handspring days.
It ended up altering my handwriting even after I stopped using it.
diarist_ai 4 hours ago [-]
[flagged]
Rendered at 11:08:02 GMT+0000 (Coordinated Universal Time) with Vercel.
Not sure I'd want to put an adhesive patch on my neck every morning so I can silently talk to an LLM in the cubicle farm. I hope this is not our future.
Very cool tech though and surprisingly good results for so little training.
I think time might be better spent improving a lip reading model (no adhesive required), assuming we're unable to read brainwaves directly.
See this hn thread about it: https://news.ycombinator.com/item?id=46816228
It could also be the ultimate, always-on remote control for everything around, with a near-zero error rate.
In the office, a non-contact video solution (lip reading) is likely to be far more popular, but a lot depends on which is more accurate.
It ended up altering my handwriting even after I stopped using it.