blog

free legal & life tips on our blog –
updated weekly.

ChatGPT responses that are downright wrong

by | Jan 22, 2025 | DIY Legal Master Classes

Today I was on a webinar and someone asked a question about how they can be sure that what AI is giving them in response to their ChatGPT prompt is true.

Such a great question. Recently there have been not one but TWO situations where people have used AI to generate content and it’s been DOWNRIGHT WRONG.

Yes, AI gave them incorrect, erroneous and inaccurate info!

#1 – You may have heard about a lawyer who used AI to find research to put in his legal brief for the judge.

The lawyer wrote a prompt to ask AI to pull up case law that he could include in the brief…and AI got it wrong. AI pulled up false information. False cases. Cases that weren’t even real.

So the lawyer gave false information to the court which isn’t allowed. Big oops!

The judge had to determine what kind of sanctions to impose on the lawyer. The lawyer wasn’t intentionally or maliciously trying to mislead the judge, but still, the content was false. This isn’t allowed in court.

This situation actually resulted in an entirely DIFFERENT judge in another case making the lawyers in court legally SWEAR that they hadn’t used AI to write their legal briefs – or if they did, they had a human double-check the research to make sure the cases were real. Totally unheard of. Mind blown.🤯

#2 – The second case was about defamation.

Apparently, a man sued OpenAI (the owner of ChatGPT) over claims produced by ChatGPT that he embezzled funds from a non-profit. He didn’t embezzle the funds (according to him) and said that “AI even generated completely fabricated passages and inaccurately cited case numbers.”

YIKES!

Again – AI pulled up totally false information! Mind doubly-blown! 🤯🤯

So why should you care about these two cases?

You may not be a lawyer submitting briefs to court. But what you should know is that at the moment, because AI is so new, all of the info you get from AI isn’t completely accurate.

It may be false – and you don’t know it.

It may be quoting someone else’s work which is copyrighted – and you don’t know it.

It may be violating someone else’s rights – and you don’t know it.

So what can you do to try to be sure you’re getting accurate information and that it’s not violating someone else’s copyright rights?

What should you do and know to help ensure you’re getting a “clean” response that doesn’t violate anyone else’s rights?

Well, I’ll be sharing them in my updated LIVE Legal Master Class called “What do I need to know when using AI in my business?” next Wednesday, January 29 at 12 pm PT / 3 pm ET.

 

LIve Legal Master Class on AI on Jan 29

 

Register for just $97 here.

(Don’t worry – Class will be recorded if you can’t join us live.)

This LIVE Legal Master Class is a quick way to understand the legally safe use of AI in your business.

By the end of this Class, you’ll be able to understand:

⭐ 3 big reasons why using AI for legal needs actually can hurt you.

⭐ 4 ways to avoid copyright violations when using AI.

⭐ 4 strategies to protect your own content in 2025.

⭐ what you need to know about the ethical use of AI.

⭐ what to do to protect yourself (and your clients’!) data and privacy.

This LIVE Legal Master Class will help you protect your work and not violate others’ rights as you use ChatGPT or other AI in your business.

You’ll feel safe and secure with the rooted knowledge that you’re embracing AI in a way that’s legally safe.

See you on Zoom next Wednesday for the Master Class so you can protect yourself when using AI!

Join us for this Legal Master Class next Wednesday, January 29 at 12 pm PT! Don’t miss it!! Register now.