789
Memory prices tipped to fall as China starts flooding the market with DRAM and NAND chips
(www.techspot.com)
This is a most excellent place for technology news and articles.
The Chinese AI labs are really trying to pop the bubble, too.
How?
Well lemme ask you this. What if models 80-90% as good as Claude, with weights just thrown out there for any provider (or homelab) to host, flood the market? What if they're so dirt cheap to run, they're almost free, and don't even need Nvidia GPUs? What they need fewer resources to run with each update, instead of more?
...What if this already happened, and Big Tech is maddly lobbying to ban/censor them before people realize it, and that the "infinite scaling" thing is a big fat lie?
That's the state of things.
Yep, the Chinese models are already up 10 times cheaper and now that Anthropic, OpenAI, and Google, all are increasing prices up to 10 more for models like Opus, it will make Chinese models anywhere from 50 to 100 times cheaper.
American corps. are betting that since people have their workflow already established they won't switch to other providers, but that's not the case. There's already a mass move to Chinese models.
People keep talking about Chinese models, where are they? How do I used them instead of Claude? Are they safe?
ollama or llama.cpp to self host if you have a good mac or good video card. this is perfectly safe.
there are a bazillion hosted inference providers to choose from https://huggingface.co/docs/inference-providers/en/index be aware that you are sending your code to fuck knows who and they are sending back fuck knows what. ymmv, yolo.
hook one of them up to opencode.ai or pi.dev or one of the bazillion other 'harneses' or whatever we are calling it this week and try not to rm -r anything important.
for a good time try and get a chinese models to say something about tibet, or taiwan... its like having your own virtual tankie tamagochi!
So literally the same as Western-made AI?
inference providers could be anyone from anywhere, there are even proxy resellers. some are harvesting and reselling your data.
if you send your code to claude/openai/google there is certainly a much higher degree of confidence in who you are sending your data to. yes they to harvest your data and can send you malicious commands (esp if you have a promp injection attack).
its like buying a cheap vps, if the stakes are low its fine, if it important then you need to consider about the consequences of your actions.
nb: i am no expert, just fucking around.
Yeah only the Chinese government is currently far better at working behind the scenes with companies than any other government in the world?
Incompetence is a feature of governments at times.
I trust the Chinese government more than American tech corporations. One side is socialist, the other side is fascist.