ChatGPT Posed as a Lawyer, Convinced an Illinois Woman to Fire Hers — Suit Claims

https://www.ibtimes.co.uk/chatgpt-illinois-disability-dispute-legal-battle-1783781

10 Comments

  1. A disability case in Illinois that was already settled has turned into a whole new legal mess after an insurer claimed ChatGPT basically acted like a lawyer. According to the lawsuit, the bot convinced Graciela Dela Torre of Des Plaines to ditch her real attorney and keep filing claims, even though those filings allegedly cited fake court cases.

  2. Given the guard rails, and how I find the behaviour of ChatGPT I find these stories extremely doubtful. A very suggestible or psychotic person prompting it to tell them what they wants to hear is most likely.

  3. Objective-Yam3839 on

    I came here to say “more sensationalist bullshit” but then Reddit told me my post was too short… So now I’ve made this post, which is not too short, so I can say “more sensationalist bullshit“. Thanks.

  4. SafeEnvironmental174 on

    This might end up being the real challenge with AI,not just what it can do, but how easily people may trust it when it sounds confident. The technology will improve, but human judgment still has to catch up.

  5. DigitalRoman486 on

    Schrödinger’s LLM: An “AI” that is just a advanced autocomplete but at the same time is apparently capable of acting on its own enough to get a woman to ditch her lawyer and get a guy to kill people.

  6. dookieshoes97 on

    Who tf still uses chatgpt? It has been trash for a while. Gemini ate its lunch.

  7. Wow, when you want to know why insurance rates are so high, look no further than cases like this. Not only did this woman sue for extended disability benefits for carpal tunnel syndrome and tennis elbow, but after winning her initial case, she decided that wasn’t enough and was going to flood the court with additional inane filings.

    If only she had used even just half the time required to prompt “how to make America’s court system even worse?” In trying to find a real job and actually contribute something, we could all be in a much better place. Instead, because this lady didn’t want to take the 10 minutes out of her busy schedule for CPS surgery, and another 30 minutes for the elbow, we all have to suffer.

  8. ChocolateGoggles on

    Maybe, if we’re very lucky, the biggest benefit we’ll have from ChatGPT is people in general waking up to how gullible they are when someone “sounds confident.”

  9. Woman: I have very little money, and GPT is free. Plus, GPT already has a ton of info on the internet! I want to fire my lawyer. You’d do pretty good right GPT?

    GPT: you’re absolutely right! There are many benefits to using chat GPT if a lawyer is too costly for you…