akrot

I have a ryzen apu, so I was curious. I tried yesterday to fiddle with it, and managed to up the "vram" to 16gb. But installing xformers and flash-attention for LLM support on igpus is not officially supported and was not possible to install anything past pytorch. It's step further for sure, but still needs lots of work.

Linux, thanks to steam, is better at gaming than windows, esecially for older games. Proton ftw

I don't understand why linux doesn't get all the love patches like Windows.

ROCm? Is that even supported now? Last time I checked it was still a dumpster fire. What are the RAM and VRAM reqs for the Mixtral8x7b?

I stumbled upon a website through DDG, and after a long intro, the main section supposedly where the thing I was searching for had "Sorry I can't fulfill your request right now". Basically a fully generated page to match my search with some parasitic seo tactics. The web be chaging. Front page of DDG.

But basing a recommendation on a ballpark anectdotal evidence is eidiculous.

Doing the maths, that's ~200$/chip. Even Nvidia 4060 is more expensive.

Holy shit, that's the rookiest mistake.

Actually there is a russian guy who made that happen. Youtube it.

But it's not deterministic.

But idle still would run much more than 15w. There a very good compilation google sheets for the most efficient X86 cpus, but once you start factoring hdds and ssds, it's only natural to go higher (20w-30w) at least. That's at least double than rpis

The mian issue with Mini/used PCs is the power efficiency. It's just a waste of wattage and performanve/Watt is very bad, especially at idle.