this post was submitted on 12 Jun 2024
393 points (95.4% liked)
Technology
59569 readers
3431 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I thought the main issue was that AI don't really know how to say I don't know or second guess themselves, as it would take a lot more robust architecture with multiple feedback loops. Like a brain.
Anyway, LLM's aren't the only AI that do this. So them being trained on Facebook data certainly isn't the whole issue.
Yeah it's the old garbage in, garbage out problem, the AI algorithms don't really understand what they are outputting.
I think at this point voice recognition and text generation AI would be more useful as something like a phone assistant. You could tell it complex things like "Mute my phone for the next 2 hours" or "Notify me if I receive an email from John Smith." Those sort of things could be easily done by AI algorithms that A) Understand your voice and B) Are programmed to know all the features of the OS. Hopefully with a known dataset like a phone OS there shouldn't be hallucination problems, the AI could just act as an OS concierge.
The narrow purpose models seem to be the most successful, so this would support the idea that a general AI isn't going to happen from LLMs alone. It's interesting that hallucinations are seen as a problem yet are probably part of why LLMs can be creative (much like humans). We shouldn't want to stop them, but just control when they happen and be aware of when the AI is off the tracks. A group of different models working together and checking each other might work (and probably has already been tried, it's hard to keep up).
Yeah the hallucinations could be very useful for art and creative stepping stones. But not as much for factual information.
Seems Siri and Alexa could already do things like that without needing LLMs trained on Facebook shit.