On the plus side, the industry is rapidly moving towards locally-run AI models specifically because they don't want to purchase and run fleets of these absurd things or any other expensive hardware.
this post was submitted on 04 Jun 2024
386 points (91.4% liked)
Technology
59534 readers
3168 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
The tragic irony of the kind of misinformed article this is linking is that the server farms that would be running this stuff are fairly efficient. The water is reused and recycled, the heat is often used for other applications. Because wasting fewer resources is cheaper than wasting more resources.
But all those locally-run models on laptop CPUs and desktop GPUs? That's grid power being turned into heat and vented into a home (probably with air conditioning on).
The weird AI panic, driven by an attempt to repurpose the popular anti-crypto arguments whether they matched the new challenges or not, is going to PR this tech into wasting way more energy than it would otherwise by distributing it over billions of computer devices paid by individual users. And nobody is going to notice or care.
I do hate our media landscape sometimes.
But efficiency is not the only consideration, privacy and self reliance are important facets as well. Your argument about efficiënt computing is 100% valid but there is a lot more to it.
Oh, absolutely. There are plenty of good reasons to run any application locally, and a generative ML model is just another application. Some will make more sense running from server, some from client. That's not the issue.
My frustration is with the fact that a knee-jerk reaction took all the 100% valid concerns about wasteful power consumption on crypto and copy-pasted them to AI because they had so much fun dunking on cryptobros they didn't have time for nuance. So instead of solving the problem they added incentive for the tech companies owning this stuff to pass the hardware and power cost to the consumer (which they were always going to do) and minimize the perception of "costly water-chugging power-hungry server farms".
It's very dumb. The entire conversation around this has been so dumb from every angle, from the idiot techbros announcing the singularity to the straight-faced arguments that machine learning models are copy-pasting things they find on the Internet to the hyperbolic figures on potential energy and water cost. Every single valid concern or morsel of opportunity has been blown way out of reasonable proportion.
It's a model of how our entire way of interacting with each other and with the world has changed online and I hate it with my entire self.
Thanks for the perspective. I despise the way the generative models destroy income for entry level artists, the unhealthy amount it is used to avoid learning and homework in schools, and how none of the productivity gains will be shared with the working class. So my view around it is incredibly biased and when I hear any argument that puts AI into bad light I accept it without enough critical thinking.
From what I learned over the years: AI isn't likely to destroy income for entry-level artists. They destroy the quagmires those artists got stuck in. The artists this will replace first and foremost are those creating elevator music, unassuming PowerPoint presentation backgrounds, Stock photos of coffee mugs. All those things where you really don't need anything specific and don't really want to think about anything.
Now look how much is being paid for those artworks by the customers on Shutterstock and the like. Almost nothing. Now imagine what Shutterstock pays their artists. Fuck all is what. Artists might get a shred of credit here and there, a few pennies, and that's that. The market AI is “disrupting” as they say, is a self-exploitative freelancing hellhole. Most of those artists cannot live off their work, and to be frank: Their work isn't worth enough to most people to pay them the money they'd need to live.
Yet, while they chase the carrot dangling in front of them, dreaming of fame and collecting enough notoriety through that work to one day do their real art, instead of interchangeable throwaway-stuff made to fit into any situation at once, Corporations continue to bleed them dry, not allowing any progress for them whatsoever. Or do you know who made the last image of a coffee mug you saw in some advert?
The artists who manage to make a living (digital and analog) are those who manage to cultivate a following. Be that through Patreon, art exhibitions, whatever. Those artists will continue to make a living because people want them to do exactly what they do, not an imitation of it. They will continue to get commissioned because ´people want their specific style and ideas.
So in reality, it doesn't really destroy artists, it replaces one corpo-hellhole (freelancing artist) with another (freelancing AI trainer/prompter/etc)
load more comments
(5 replies)
The weird AI panic, driven by an attempt to repurpose the popular anti-crypto arguments whether they matched the new challenges or not, is going to PR this tech into wasting way more energy than it would otherwise by distributing it over billions of computer devices paid by individual users. And nobody is going to notice or care.
I think the idea was that these things are bad idea locally or otherwise, if you don't control them.
load more comments
(2 replies)
If I make a gas engine with 100% heat efficiency but only run it in my backyard, do the greenhouse gases not count because it's so efficient? Of course they do. The high efficiency of a data center is great, but that's not what the article laments. The problem it's calling out is the absurdly wasteful nature of why these farms will flourish: to power excessively animated programs to feign intelligence, vainly wasting power for what a simple program was already addressing.
It's the same story with lighting. LEDs seemed like a savior for energy consumption because they were so efficient. Sure they save energy overall (for now), but it prompted people to multiply the number of lights and total output by an order of magnitude simply because it's so cheap. This stems a secondary issue of further increasing light pollution and intrusion.
Greater efficiency doesn't make things right if it comes with an increase in use.
load more comments
(1 replies)
load more comments
(25 replies)
Yeah, I think the author misses the point in regard to power consumption. Companies will not buy loads of these and use them in addition to existing hardware. They will buy these to get rid of current hardware. It's not clear (yet) if that will increase, decrease or not affect power consumption.
The lack of last-last gen hardware on the used market suggests this isn't true. Even if it were available, the buyers will run it and the overall energy consumption will still increase. It's not like old hardware disappears after it's replaced with newer models.
load more comments
(2 replies)
load more comments
(4 replies)
This article is one of the most down-to-earth, realistic observations on technology I've ever read. Utterly striking as well.
Go Read This Article.
Agreed, stop scrolling the comments and go read it random reader.
I used to get so excited by tech advances but now I've gotten to the point where its still cool and a fascinating application of science... but this stuff is legitimately existential. The author raises great points around it.
load more comments
(2 replies)
load more comments
(11 replies)
Boiling the oceans for deepfake porn, scamcoins and worse web search.
load more comments
(3 replies)
I think the worst part of Huang's keynote wasn't that none of this mattered, it's that I don't think anyone in Huang's position is really thinking about any of this at all. I hope they're not, which at least means it's possible they can be convinced to change course. The alternative is that they do not care, which is a far darker problem for the world.
well yeah... they just don't care, after all the climate crisis is somebody else's problem... and what really matters is that the line goes up next quarter, mankind's future be damned
Innovation is a scam, it breeds endless bullshit we keep buying and talking about like 10 year olds with their latest gimmick.
Look, they replaced this button with A TOUCHSCREEN!
Look! This artficial face has PORES NOW!
LOOK! This coffee machine costs 2000$ now and uses PROPRIATARY SUPEREXPENSIVE CAPSULES!!
We need progress, which is harder to do because it takes a paradigm shift on an Individual and social level. It's much less gadgety.
Tech is neither good nor bad, but control of tech is a major issue.
You're not wrong. We've reached a point, technologically, where there is little-to-no true innovation left... and what I mean by that is that everything is now built on incredible amounts of work by others who came before. "Standing on the shoulders of giants", as it were. And yet we have a corrupt "patent" system that is exclusively used to steal the work of those giants while at the same time depriving all of humanity of true progress. And why? So that a handful of very rich people can get even more rich.
load more comments
(2 replies)
load more comments
(8 replies)
A lot of the "elites" (OpenAI board, Thiel, Andreessen, etc) are on the effective-accelerationism grift now. The idea is to disregard all negative effects of pursuing technological "progress," because techno-capitalism will solve all problems. They support burning fossil fuels as fast as possible because that will enable "progress," which will solve climate change (through geoengineering, presumably). I've seen some accelerationists write that it would be ok if AI destroys humanity, because it would be the next evolution of "intelligence." I dunno if they've fallen for their own grift or not, but it's obviously a very convenient belief for them.
Effective-accelerationism was first coined by Nick Land, who appears to be some kind of fascist.
load more comments
(1 replies)
The article is really interesting and all your comments too.
For now I have a negative bias towards AI as I only see its downsides, but I can see that not everyone thinks like me and it’s great to share knowledge and understanding.
load more comments
(1 replies)
My blood runs cold! My dignity has just been sold. nVidia is the centerfold.
Is nobody concerned about this:
Behind the wall, an army of robots, also powered by new Nvidia robotics processors, will assemble your food, no humans needed. We've already seen the introduction of these kinds of 'labor-saving' technologies in the form of self-checkout counters, food ordering kiosks, and other similar human-replacements in service industries, so there's no reason to think that this trend won't continue with AI.
not being seen as the paradise? It's like the enterprise crew is concerned about replicators because people will lose their jobs.
This is madness, to be honest, this is what humankind ultimately should evolve into. No stupid labour for anyone. But the truth is: capitalism will take care of that, it will make sure, that not everyone is free but that a small percentage is more free and the rest is fucked.There lies the problem not in being able to make human labour obsolete.
The issue with "Human jobs will be replaced" is that society still requires humans to have a paying job to survive.
I would love a world where nobody had to do dumb labour anymore, and everyone's needs are still met.
Yup. Realistic result of things becoming automated is that we have several decades of social strife grappling with the fact there's too many people for the amount of human labor actually needed, until there's enough possibly violent unrest for the powers that be to realize "oh, maybe we shouldn't require people to have jobs that don't exist "
load more comments
(1 replies)
The notion that everyone must earn their own living is going to be a problem soon.
load more comments
(2 replies)
So if each GPU takes 1,800W, isn’t that the equivalent of what a handheld hair dryer consumes?
It’s more than your average space heater.
And that energy doesn't just go away after computing. You'll have the equivalent of an average space heater of heat coming out of your computer. It'd be awesome to compute with heating energy when needed, but when you need AC it's going to be a bitch.
Yes, and you leave it on all day at full blast. And you have a dedicated building where there's thousands of them doing the same.
load more comments
(1 replies)
Yes, but they are not gaming devices. They are meant to efficiently compute things. When used for that purpose they use little energy compared to other devices doing the same thing.
Well, this is fucking bleak. Everybody, I urge you to read this article.
I did it because you urged me.
what a dumb future
Elysium incoming
But without even just the cool space station to just stare at longingly…
Im starting to wonder if the Butlerian Jihad isn't a good idea after all.
Where my futurists now? Tell me again how a technological advancement will free humans from drudgery to engage in more free and enlightened pursuits?
For thousands of years the ruling class has tolerated the rest of us because they needed us for labor and protection. We're approaching the first time in human history where this may no longer be the case. If any of us are invited to the AI utopia, I suspect it will only be to worship those who control it. I'm not sure what utility we'll have to offer beyond that. I doubt they'll keep us around just to collect UBI checks.
Holy crap, I thought I hated AI and I was uncertain. Now I'm sure I hate AI
You still need a massive fleet of these to train those multi-billion parameter models.
On the invocation side, if you have a cloud SaaS service like ChatGPT, hosted Anthropic, or AWS Bedrock, these could answer questions quickly. But they cost a lot to operate at scale. I have a feeling the bean-counters are going to slow down the crazy overspending.
We're heading into a world where edge computing is more cost and energy efficient to operate. It's also more privacy-friendly. I'm more enthused about a running these models on our phones and in-home devices. There, the race will be for TOPS vs power savings.
I like that the writer thought re climate change. I think it's been 1 of the biggest global issues for a long time. I hope there'll be increasing use of sustainable energy for not just data centers but the whole tech world in the coming years.
I think a digital waiter doesn't need a rendered human face. We have food ordering kiosks. Those aren't ai. I think those suffice. A self-checkout grocer kiosk doesn't need a face too.
I think "client help" is where ai can at least aid. Imagine a firm that's been operating for decades and encountered so many kinds of client complaints. It can feed all those data to a large language model. With that model responding to most of the client complaints, the firm can reduce the number of their client support people. The model will pass the complaints that are so complex or that it doesn't know how to address to the client support people. The model will handle the easy and medium complaints; the client support people will handle the rest.
Idk whether the government or the public should stop ai from taking human jobs or let it. I'm torn. Optimistically, workers can find new jobs. But we should imagine that at least 1 human will be fired and can't find a new job. He'll be jobless for months. He'll have an epic headache as he can't pay next month's bills.
All these issues are valid and need solving but I'm kind of tired of people implying we shouldn't do certain work because of efficiency.
And tech gets all the scrutiny for some reason (it's transparency?). I can't recall the last time I've seen an article on industrial machine efficiency and how we should just stop producing whatever.
What we really need to do is find ways to improve efficiency on all work while moving towards carbon neutrality. All work is valid.
If I want to compute pi for no reason or drive to the Grand Canyon for lunch, I should be able to do so.
Disagree that all work is valid. That only makes sense in a world with no resource constraints
load more comments
(14 replies)
view more: next ›