this post was submitted on 03 Mar 2025
883 points (99.3% liked)

Technology

64937 readers
4010 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
883
Judges Are Fed up With Lawyers Using AI That Hallucinate Court Cases (www.404media.co)
submitted 1 week ago by some_guy@lemmy.sdf.org to c/technology@lemmy.world
125 comments fedilink hide all child comments
 

But the explanation and Ramirez’s promise to educate himself on the use of AI wasn’t enough, and the judge chided him for not doing his research before filing. “It is abundantly clear that Mr. Ramirez did not make the requisite reasonable inquiry into the law. Had he expended even minimal effort to do so, he would have discovered that the AI-generated cases do not exist. That the AI-generated excerpts appeared valid to Mr. Ramirez does not relieve him of his duty to conduct a reasonable inquiry,” Judge Dinsmore continued, before recommending that Ramirez be sanctioned for $15,000.

Falling victim to this a year or more after the first guy made headlines for the same is just stupidity.

you are viewing a single comment's thread
view the rest of the comments
[–] Moose@moose.best 5 points 1 week ago (1 children)

I don't know if I would call it lying per-se, but yes I have seen instances of AI's being told not to use a specific tool and them using them anyways, Neuro-sama comes to mind. I think in those cases it is mostly the front end agreeing not to lie (as that is what it determines the operator would want to hear) but having no means to actually control the other functions going on.

[–] webghost0101@sopuli.xyz 1 points 6 days ago* (last edited 6 days ago)

Neurosama is a fun example but we dont really know the sauce vedal coocked up.

When i say proven i mean 32 page research paper specifically looking into it.

https://arxiv.org/abs/2407.12831

They found that even a model trained specifically on honesty will lie if it has an incentive.

The reasoning models will output that they used the forbidden tool in their reasoning window before lying in the final output.