A French data scientist and lawyer, Damien Charlotin, has catalogued at least 490 court filings in the past six months that contained “hallucinations,” which are AI responses that contain false or misleading information. … But even high-profile companies have submitted problematic legal documents. A federal judge in Colorado ruled that a lawyer for MyPillow Inc., filed a brief containing nearly 30 defective citations as part of a defamation case against the company and founder Michael Lindell.

https://apnews.com/article/artificial-intelligence-tools-work-errors-skills-fddcd0a5c86c20a4748dc65ba38f77fa

5 Comments

  1. Power-Equality on

    Further context from article below. TL;DR hundreds of AI hallucination mistake-filled legal briefs have been catalogued by a business school researcher. A lot seem to come from non-attorneys representing themselves in the USA. One prominent case comes from billionaire Mike Lindell of MyPillow.

    *Charlotin, a senior research fellow at HEC Paris, a business school located just outside France’s capital city, created a database to track cases in which a judge ruled that generative AI produced hallucinated content such as fabricated case law and false quotes. The majority of rulings are from U.S. cases in which plaintiffs represented themselves without an attorney, he said. While most judges issued warnings about the errors, some levied fines.*

  2. meme headlines

    “AI Writes Legal Briefs, Accidentally Invents Laws That Don’t Exist”

    “Mistake-Filled AI Briefs Remind Lawyers That Robots Also Dream”

    “Legal AI Produces Hallucinations, Attorneys Forced To Remember How To Read”

    “AI Promises Efficiency, Delivers Fictional Court Cases Instead”

    “Law Firms Discover Critical Step: Reading What The Robot Actually Wrote”

    “New AI Tool Guarantees Mistakes, Lawyers Celebrate Job Security”

    “Briefs Written By AI Contain Errors, Lawyers Pretend They’re Creative Interpretation”

    “Artificial Intelligence Suggests Laws, Human Intelligence Suggests Panic”

    “Legal Professionals Shocked To Learn AI Is Not Licensed To Practice Law”

    “AI Briefs Full of Hallucinations, Court Considers Rewriting Entire Legal System”

  3. This is why im not worried about AI taking 98% of jobs in 5 years or whatever other nonsense the tech bros are claiming 

  4. The thing I find most amusing about the LLM “AI” bubble is the number of people who pretend that the AI is only hallucinating when it says things they don’t like.