Average gaming PC.
128GB ram and a 4070 12GB. Doesn't sound average.
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Average gaming PC.
128GB ram and a 4070 12GB. Doesn't sound average.
I thought I had a lot of RAM with 64
Well, you do.
64 gigs of ram costs less than $200 these days
No kidding. Steam survey definitely does not agree with this definition of average lmao
Yeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.
A dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.
You still need a GPU, otherwise your CPU is wasting precious operations drawing the screen instead of simulating dwarves.
I was gonna say, 4x the amount of RAM I have, made me feel inadequate. like, "am I really that poor now? is my 2080 now considered potato gaming?"
it's simply been so long since I've gone "ok I need to upgrade" that I'm starting to get suspicious
is my 2080 now considered potato gaming?"
I'm going to keep using this 1070 until it fails it I get bored of Skyrim.
At this rate it seems like I will also never be upgrading from the 1070. Miners, NFTs, supply chain, AI, tariffs... how is an honest guy supposed to just buy a decent GPU when squeezed between all that bs?
I got my 7900XTX for MSRP in 2023 and have no plans on "upgrading" any time soon. The same PC's 5800X3D is also showing no signs of letting up, and given the tariff bullshit going on right now, I plan on keeping it that way for as long as possible.
128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
Nuh-uh! You can configure Minecraft to use all that memory to run buttery smooth. Just make sure to not play longer than 15 minutes so you don't get the mother-of-god lagspike when the garbage collector finally runs.
So it is not running llms on an average gaming pc
I didn't see tokens/s anywhere?
Performance/vision based tests have tokens/s at the end of tables.