this post was submitted on 08 May 2024
1716 points (99.3% liked)

Technology

59534 readers
3168 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Hypx@fedia.io 66 points 6 months ago (6 children)

Eventually, we will need a fediverse version of StackOverflow, Quora, etc.

[–] thfi@discuss.tchncs.de 77 points 6 months ago (6 children)

Those would be harvested to train LLMs even without asking first. 😐

[–] sramder@lemmy.world 45 points 6 months ago (1 children)

At this point I’m assuming most if not all of these content deals are essentially retroactive. They already scrapped the content and found it useful enough to try and secure future use, or at least exclude competitors.

[–] rickyrigatoni@lemm.ee 13 points 6 months ago (1 children)

They scraped the content, liked the results, and are only making these deals because it's cheaper than getting sued.

[–] AeroLemming@lemm.ee 3 points 6 months ago

Can they really sue (with a chance of winning) if you scrape content that's submitted by users? That's insane.

[–] linearchaos@lemmy.world 34 points 6 months ago (1 children)

Honestly? I'm down with that. And when the LLM's end up pricing themselves out of usefulness, we'll still have the fediverse version. Having free sites on the net with solid crowd-sourced information is never a bad thing even if other people pick up the data and use it.

It's when private sites like Duolingo and Reddit crowd source the information and then slowly crank down the free aspect that we have the problems.

The Ad sponsored web model is not viable forever.

[–] bort@sopuli.xyz 18 points 6 months ago

The Ad sponsored web model is not viable forever.

a thousand times this

[–] danc4498@lemmy.world 27 points 6 months ago

I’d rather the harvesting be open to all than only the company hosting it.

[–] mox@lemmy.sdf.org 10 points 6 months ago

Assuming the federated version allowed contributor-chosen licenses (similar to GitHub), any harvesting in violation of the license would be subject to legal action.

Contrast that with Stack Exchange, where I assume the terms dictated by Stack Exchange deprive contributors of recourse.

[–] chameleon@kbin.social 7 points 6 months ago

SO already was. Not even harvested as much as handed to them. Periodic data dumps and a general forced commitment to open information were a big part of the reason they won out over other sites that used to compete with them. SO most likely wouldn't have existed if Experts Exchange didn't paywall their entire site.

As with everything else, AI companies believe their training data operates under fair use, so they will discard the CC-SA-4.0 license requirements regardless of whether this deal exists. (And if a court ever finds it's not fair use, they are so many layers of fucked that this situation won't even register.)

[–] Rolando@lemmy.world 2 points 6 months ago (1 children)

But users and instances would be able to state that they do not want their content commercialized. On StackOverflow you have no control over that.

[–] ArbitraryValue@sh.itjust.works 5 points 6 months ago (1 children)

You can state what you don't want, but no one will be paying attention. Except maybe the LLM reading your posts...

[–] pivot_root@lemmy.world 1 points 6 months ago (1 children)

Yup. Laws are only suggestions until you get caught.

[–] ArbitraryValue@sh.itjust.works 3 points 6 months ago* (last edited 6 months ago)

I suspect it isn't even illegal, but I'm not an expert.

[–] thejml@lemm.ee 17 points 6 months ago (2 children)

Not fediverse, but open-source and community run: https://codidact.com

[–] avidamoeba@lemmy.ca 4 points 6 months ago* (last edited 6 months ago)

Oh this looks decent. British non-profit, I like it. Registering.

[–] linearchaos@lemmy.world 3 points 6 months ago (1 children)

Smells too much like duo-lingo. Here, everyone jump in and answers all the questions. 5 years later, ohh look at this gold mine of community data we own....

[–] residentmarchant@lemmy.world 8 points 6 months ago (1 children)

This was actually the whole original point of Duolingo. The founder previously created Recaptcha to crowd source machine vision of scanned books.

His whole thing is crowd sourcing difficult tasks that machines struggle with by providing some sort of reason to do it (prevent spam at first and learn a language now)

From what I understand Duolingo just got too popular and the subscription service they offer made them enough money to be happy with.

[–] linearchaos@lemmy.world 1 points 6 months ago

Duolingo has been systematically enshittifying the free/ad supported service. Now every time you fart, you get a big unskippable ad trying to get you to subscribe to their service for free for 14 days without telling you the price. They took all that crowdsourced data that weren't going to profit off of and are making the app a miserable experience without it.

[–] BraveLittleToaster@lemmy.world 6 points 6 months ago (1 children)

Everything you write on here is public. There's nothing stopping anyone from using that data for training

[–] VirtualOdour@sh.itjust.works 4 points 6 months ago

Yeah but didn't you see the sovereign citizens who think licenses are magic posting giant copyright notices after their posts? Lol

It's so childish, ai tools will help billions of the poorest people access life saving knowledge and services, help open source devs like myself create tools that free people from the clutches of capitalism, but they like living in a world of inequity because their generational wealth earned from centuries of exploitation of the impoverished allows them a better education, better healthcare, and better living standards than the billions of impoverished people on the planet so they'll fight to maintain their privilege even if they're fighting against their own life getting better too. The most pathetic thing is they pretend to be fighting a moral crusade, as if using the answers they freely posted and never expected anything in return for is a real injustice!

And yes I know people are going to pretend that they think tech bros won't allow poor people to use their tech and they base this on assuming how everything always works will suddenly just flip Into reverse at some point or something? Like how mobile phones are only for rich people and only rich people can sell via the internet and only rich people can start a YouTube channel...

[–] linearchaos@lemmy.world 4 points 6 months ago

We needed it a few years ago.

[–] NoIWontPickAName@kbin.earth 3 points 6 months ago (2 children)
[–] rickyrigatoni@lemm.ee 9 points 6 months ago (2 children)
[–] brbposting@sh.itjust.works 8 points 6 months ago

how is feddi formed

[–] HowManyNimons@lemmy.world 1 points 6 months ago (1 children)

Arguably, they need to do way instain mother> who kill thier babbys. becuse these babby cant frigth back?

It's important to remember that it was on the news this mroing a mother in ar who had kill her three kids.

[–] NoIWontPickAName@kbin.earth 1 points 6 months ago

Too much, can’t figure it out

[–] Syrc@lemmy.world 2 points 6 months ago* (last edited 6 months ago) (1 children)

Hey, early Yahoo answers was very useful. A de-shittified, federated, stripped down to the bare questions-answers network could be neat.

[–] Scrollone@feddit.it 1 points 6 months ago
[–] avidamoeba@lemmy.ca 3 points 6 months ago

We already have the SO data. We could populate such a tool with it and start from there.