vrighter

joined 2 years ago
[–] vrighter@discuss.tchncs.de 2 points 8 months ago

if, on a modern gaming pc, you can get breakneck speeds of 5 tokens per second, then actually inference is quite energy intensive too. 5 per second of anything is very slow

[–] vrighter@discuss.tchncs.de 24 points 9 months ago

god of war live service? wtf???

[–] vrighter@discuss.tchncs.de 4 points 9 months ago

it doesn't allow changes to stuff that needs root access to change. If you have root access you can do anything, including switching images. It is not more secure. It's not less either

[–] vrighter@discuss.tchncs.de 2 points 9 months ago

validate against what? The "inner monologue" is the llm itself. It won't be any better than itself.

[–] vrighter@discuss.tchncs.de 18 points 9 months ago (2 children)

it's federated. It's the only way it can work. Everything still on that ist must suffer from the same thing. Federation means handing stuff to someone else. Once that's done, it's out of your hands forever.

[–] vrighter@discuss.tchncs.de 9 points 9 months ago

I'm not talking about drivers for stuff that is not the cpu itself. But the processor itself usually contains a bunch of peripherals that need their own stuff.

[–] vrighter@discuss.tchncs.de 13 points 9 months ago

it's very possible to get linux to run on a processor without having implemented al functionality. You can just not support some onboard peripherals yet and have to do some things inefficiently in software. You don't need good power management to simply be "running", etc.

Getting linux to run is the first step, not the last. It's the barest minimum you could do to have a product to sell. Running well, taking advantage of all hardware features properly is a whole different game.

[–] vrighter@discuss.tchncs.de 44 points 9 months ago (10 children)

do they come with all the necessary drivers? Or are they hoping they magically appear in the linux kernel after they've sold a bunch?

[–] vrighter@discuss.tchncs.de 8 points 9 months ago

nah, this is just copium. Apple don't release dev-kits to the general public. It was a real product, and it was a dud

[–] vrighter@discuss.tchncs.de 1 points 9 months ago

i would like to filter out all "massive multiplyer online arena shooter" There are way too much of them

[–] vrighter@discuss.tchncs.de 38 points 9 months ago (2 children)

Any processor can run llms. The only issue is how fast, and how much ram it has access to. And you can trade the latter for disk space if you're willing to sacrifice even more speed.

If it can add, it can run any model

[–] vrighter@discuss.tchncs.de 3 points 9 months ago

raytracing is insanely expensive. If you saw what current cards can render in real time, you would see a very very noisy, incomplete image that looks like shit. Without ai denoising and a lot of temporal shit (which only looks good in screenshots). It is very very very far from being able to render an actual frame with decent performance.

view more: ‹ prev next ›