It’s small so should be cheap per chip. And it so much smarter than it ought to be for its size.
Problem is asic take forever to cut and are always months behind the latest open weight sota
dlcarrier 7 minutes ago [-]
Taalas uses a design that requires masked ROM layers specific to a model, but Etched uses a newer design with a specialized RAM that supports any transformer model.
rvz 1 hours ago [-]
2 hours and no comments makes me wonder if the Etched chip exists or not.
> Sohu figures are per chip, derived from Etched's published 8-chip server claim of 500,000 tok/s on Llama 70B; not independently verified. (claimed by Etched)
So these are not verified benchmarks and they are all claims. Again is this chip real?
It’s small so should be cheap per chip. And it so much smarter than it ought to be for its size.
Problem is asic take forever to cut and are always months behind the latest open weight sota
> Sohu figures are per chip, derived from Etched's published 8-chip server claim of 500,000 tok/s on Llama 70B; not independently verified. (claimed by Etched)
So these are not verified benchmarks and they are all claims. Again is this chip real?