"Is for me? ππ"
~ AI
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
"UwU is all that wam for wittle old me?"
~ AI probably
Go China Go!
The West is its own enemy. Not only are our oligarchs against us, they are dimwitted and donβt plan ahead for anything but earnings reports.
THIS QUARTER'S earnings reports. sigh
It's telling that if someone powerful like a politician actually does their job, they're hailed by the general public as a hero.
Runaway Capitalism western civilization started at the end of the Vietnam War in America. The MIC went private and every motivation was for Wall Street means and shareholders, etc. Who were the ones that created the biggest demands of the drug trade and America made a new war for itself against itself to feed itself. The War on Drugs.
Now we are nearing the collapse. Trump is the cumulative representation of America. America is Trump. MIT predicted this civilization's decline at around 2040. And it looks like that should be the approximate set date for WW3 also given the current trends and shift in global super powers.
I sincerely hope this fucks up the market. I hope all the other manufacturers get fucked right up their greedy fucking asses.
With an unlubricated horse cock
Mr Hands, please save us!
Use lube, or find another phallic object. That poor horse deserved better.
This is not bad at all. Go for it π
I thought it would take yeeeeeaaaars to build new factories. That's what they were saying when it started.
The Chinese AI labs are really trying to pop the bubble, too.
How?
Well lemme ask you this. What if models 80-90% as good as Claude, with weights just thrown out there for any provider (or homelab) to host, flood the market? What if they're so dirt cheap to run, they're almost free, and don't even need Nvidia GPUs? What they need fewer resources to run with each update, instead of more?
...What if this already happened, and Big Tech is maddly lobbying to ban/censor them before people realize it, and that the "infinite scaling" thing is a big fat lie?
That's the state of things.
It turns out that off-shoring your economy to a political rival is a really dumb thing for a capitalist to do.
Yep, the Chinese models are already up 10 times cheaper and now that Anthropic, OpenAI, and Google, all are increasing prices up to 10 more for models like Opus, it will make Chinese models anywhere from 50 to 100 times cheaper.
American corps. are betting that since people have their workflow already established they won't switch to other providers, but that's not the case. There's already a mass move to Chinese models.
People keep talking about Chinese models, where are they? How do I used them instead of Claude? Are they safe?
ollama or llama.cpp to self host if you have a good mac or good video card. this is perfectly safe.
there are a bazillion hosted inference providers to choose from https://huggingface.co/docs/inference-providers/en/index be aware that you are sending your code to fuck knows who and they are sending back fuck knows what. ymmv, yolo.
hook one of them up to opencode.ai or pi.dev or one of the bazillion other 'harneses' or whatever we are calling it this week and try not to rm -r anything important.
for a good time try and get a chinese models to say something about tibet, or taiwan... its like having your own virtual tankie tamagochi!
be aware that you are sending your code to fuck knows who and they are sending back fuck knows what
So literally the same as Western-made AI?
The most famous is Deepseek. It's not even made by "AI" company, it was a side hustle from stock trading company. They released it for free just to flex.
Hyper scaling was always about cornering the computer market, It was never about providing us some vastly new and superior service.
They should be strung up. And middle management needs to return to fucking school.
Itβs like Kyle Kulinski said βIβm starting to understand re-education camps nowβ
Hyper scaling was always about cornering the computer market, It was never about providing us some vastly new and superior service.
Exactly, its a method of taking tens of billions of dollars in capital and buying a near monopoly. No other providers can compete if the hyperscalers buy all of the hardware, driving up the prices while also selling the service at a loss.
Nobody working out of their garage with a cool idea for a better service can compete if they can't get hardware and have to charge double what the hyperscalers are charging because they can't burn capital for years.
It's a practice that should be considered illegal market manipulation, because that's what it i
e: extraneous 'completely'
In a way it has actually.
Deepseek was big because not only did they publish the full model for everyone to use, but the MoE structure significantly brought down the hardware requirements in terms of processing power. As long as you have enough VRAM, you can run it on older hardware with no need for the latest Nvidia stuff.
Now they got v4 which many have found to be within a 10% margin of Claude and ChatGPT.
On top of that, China has cheapo VRAM GPUs available or soon to be released, like the MTT S80. Yeah it sucks as a Graphics card because the chip is behind, but you get 16Gb of GDDR6 for much cheaper than anything else.
But its not a conspiracy to fight China. The infinite scaling was just Nvidia solidifying themselves as the monopoly because they want all AI infrastructure to be dependent on them, which is why they still illegally export to China, despite an export ban attempting to reduce their potential competition.
Moore Threads (MTT) already has their own CUDA like system called MUSA, and I'm sure they'll be happy to put in proper hardware support for new stuff like Bf16 and FP8/4. It'll take a few years, but eventually China will catch up to the point where Nvidia gets shanked by cheaper hardware.
Please, please bring the world back to sanity. I was like, literally saving up to expand my homelab when my main server went down and have been utterly slapped by prices.
I bought a 2x16gb DDR4 kit for my home server just before it all went to shit. Feels good (though now I want to upgrade my gaming pc and I wish I had bought a DDR5 kit too)
Obviously this is good for RAM prices but does the NAND part affect SSD prices as well?
I'd skip spinning platters if I could get 4 TB of SSD for vheapt
Except maybe in America if MAGA dreams up some tariffs because Freedom (Chinese EVs have entered the chat).
But think about Samsung, SK Hynix and Micron shareholders
I do think of them.
Crazy how USA seems unable to keep up, and it appears its best chance of maintaining hegemony is bringing China down, not improving itself. Never expected to see this shift in my lifetime.
Not really that crazy when you consider that the people in charge could have had a sweetheart deal with manufacturers in China, but they cut off all trade partners and all soft power channels, because they're drooling buffoons who won't accept that the US shifted to a global economy decades ago nor do they grasp how global economies workβmainly because they fired every expert under the pretense of "government waste."
All they know how to do is grift and defraud, and the chance to maintain global hegemony is long past. It's China's time, now, and they know it.
Just look at the EV's. The CEO of Ford was shocked about the quality and innovation of the Chinese cars. He's driving a Xiaomi SU7 and refuses to give it up. At least Canada is now free of the US chains and letting Chinese EV's in. The movement is unstoppable in the rest of the world. The only place resisting innovation is the US with its current regime.
Another leg up for the Chinese from the American AI bubble! Think how long it would have taken to penetrate the memory market if there wasnβt an artificial shortage.
Why aren't data centers buying up all this RAM too?
I'm guessing because China isn't producing the type of RAM they want. Put it this way, when the AI bubble bursts we aren't going to have a load of RAM and GPUs suddenly available, because the AI data centre versions aren't in a format that's useful in consumer tech, or even all the data centre systems. They are optimised towards AI workloads and don't really work in normal computer systems. Equally that means that if the RAM that's been produced isn't in this AI workload optimised format, then the data centres can't use it.
The crime isn't that the AI data centres were using a lot of the RAM, it was that the manufacturers were letting them by producing all their RAM in the required format.
I just bought 2x 8gb ddr3 for β¬25 so I can play games from 10+ years ago.
Come and join us at c/patientgamers
Damn you Mr Xi
Assuming we'd let China sell chips in the US. Gotta block competition and keep prices high.
Thank you China