this post was submitted on 29 Aug 2024
124 points (96.3% liked)

Technology

59495 readers
3114 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

cross-posted from: https://lemmy.ml/post/19683130

The ideologues of Silicon Valley are in model collapse.

To train an AI model, you need to give it a ton of data, and the quality of output from the model depends upon whether that data is any good. A risk AI models face, especially as AI-generated output makes up a larger share of what’s published online, is “model collapse”: the rapid degradation that results from AI models being trained on the output of AI models. Essentially, the AI is primarily talking to, and learning from, itself, and this creates a self-reinforcing cascade of bad thinking.

We’ve been watching something similar happen, in real time, with the Elon Musks, Marc Andreessens, Peter Thiels, and other chronically online Silicon Valley representatives of far-right ideology. It’s not just that they have bad values that are leading to bad politics. They also seem to be talking themselves into believing nonsense at an increasing rate. The world they seem to believe exists, and which they’re reacting and warning against, bears less and less resemblance to the actual world, and instead represents an imagined lore they’ve gotten themselves lost in.

top 7 comments
sorted by: hot top controversial new old
[–] Badeendje@lemmy.world 38 points 2 months ago (2 children)

Rofl.. excellent comparison between AI and loons like Elmo on the self reinforcing that leads to collapse..

[–] andrewrgross@slrpnk.net 15 points 2 months ago (1 children)

I was trying to explain what AI alignment is to my mom, and I ended up using the behavior of companies like OpenAI, and how they're distorted by profit motive as an example of a misaligned decision making system. And I realized that late stage capitalism is basically the paperclip maximizer made real.

This is a very good article. I think AI models have more to teach us about epistemology than people want to believe right now.

[–] Badeendje@lemmy.world 7 points 2 months ago (1 children)

Yeah... It's like pole fucker bob has been sniffing his own farts, while the weavers are telling him his new invisible clothes look awesome.

But then, the supreme court in the US rules money is speech and this means that billionaires are very important and have much important things to say. So until the US eliminates that line of thinking, they are probably in for some more if these smegheads determining public discourse and steering the country towards their preferred cliff.

[–] SlopppyEngineer@lemmy.world 6 points 2 months ago

Wouldn't be the first time a country is wrecked by the actions of the elite. It's usually that or getting wrecked by the elite in another country.

[–] TheFriar@lemm.ee 11 points 2 months ago

Hey, hey, hey. Leave Elmo out of this. Elon is no Elmo. He fuckin wishes.

[–] Diplomjodler3@lemmy.world 11 points 2 months ago (1 children)

They're huffing their own farts just like the models try to learn from their own garbage. Pretty apt comparison.

[–] cm0002@lemmy.world 9 points 2 months ago

Well South Park did try to warn us years ago