This is a most excellent place for technology news and articles.
Clickbait article with some half truths. A discovery was made, it has little to do with Ai and real world applications will be much, MUCH more limited than what's being talked about here, and will also likely still take years to come out
Brother, have you heard of buses? Even INSIDE cpus/socs bus speeds are a limitation. Also i fucking hate how the first thing people mention now is how ai could benefit from a jump in computing power.
Edit: I havent dabbled that much in high speed stuff yet but isnt the picosecond range so fast that the capacitance of simple traces and connectors between chips influence the rising and falling edge of chips?
That's pretty much my understanding. Most of the advancements happened in memory speeds are related to the physical proximity of the memory and more efficient transmission/decoding.
GDDR7 chips for example are packed as close as physically possible to the GPU die, and have insane read speeds of 28 Gbps/pin (and a 5090 has a 512-bit bus). Most of the limitation is the connection between GPU and RAM, so speeding up the chips internally 1000x won't have a noticeable impact without also improving the memory bus.
Wow, finally graphene has been cracked. Exciting times for portable low-energy computing
Is that fast enough to put an LLM in swap and have decent performance?
Note that this in theory speaks to performance of a non volatile memory. It does not speak to cost.
We already have a faster than NAND non volatile storage in phase change memory . It failed due to expense.
If this thing is significantly more expensive even than RAM, then it may fail even if it is everything it says it is. If it is at least as cheap as ram, it'll be huge since it is faster than RAM and non volatile.
Swap is indicated by cost, not by non volatile characteristics.
