Technology

72996 readers

4360 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

L3s@lemmy.world

enu@lemmy.world

technopagan@lemmy.world

L4s@lemmy.world

L3s@hackingne.ws

L4s@hackingne.ws

Why Is There an AI Hype? | The Luddite (theluddite.org)

submitted 1 year ago by _number8_@lemmy.world to c/technology@lemmy.world

25 comments fedilink hide all child comments

Companies are training LLMs on all the data that they can find, but this data is not the world, but discourse about the world. The rank-and-file developers at these companies, in their naivete, do not see that distinction....So, as these LLMs become increasingly but asymptotically fluent, tantalizingly close to accuracy but ultimately incomplete, developers complain that they are short on data. They have their general purpose computer program, and if they only had the entire world in data form to shove into it, then it would be complete.

you are viewing a single comment's thread
view the rest of the comments

[+] FaceDeer@fedia.io -6 points 1 year ago* (last edited 1 year ago) (1 children)

Companies are training LLMs on all the data that they can find, but this data is not the world, but discourse about the world.

I mean, the same can be said for your own senses. "You" are actually just a couple of kilograms of pink jelly sealed in a bone shell, being stimulated by nerves that lead out to who knows what. Most likely your senses are giving you a reasonably accurate view of the world outside but who can really tell for sure?

So, as these LLMs become increasingly but asymptotically fluent, tantalizingly close to accuracy but ultimately incomplete, developers complain that they are short on data.

Don't let the perfect be the enemy of the good. If an LLM is able to get asymptotically close to accurate (for whatever measure of "accurate" you happen to be using) then that's really super darned good. Probably even good enough. You wouldn't throw out an AI translator or artist or writer just because there's one human out there that's "better" than it.

AI doesn't need to be "complete" for it to be incredible.

[–] afraid_of_zombies@lemmy.world 3 points 1 year ago

I do sorta see the argument. We don't fully see with our eyes, we also see with our mind. So the LLM is learning about how we see the world. Like a scanner darkly hehe.

Not really sure how big of a deal this is it or even if it is a problem. I need to know what the subjective taste of a recipe is, not the raw data of what it is physically.