Skip to content
Plainly

checking3 min read

Catch AI making things up

AI sounds just as sure when it's wrong. Here's what to double check before it costs you points.

from Plainly, a free weekly email. get the free AI study kit

A black and white photo of a student reading a textbook beside a laptop

read this one twice

the prompt this whole guide is built on

List every claim in your last answer that I should double check, and tell me where I could verify each one: my textbook, my notes, or a source I can actually open.

AI sounds exactly as sure of itself when it's wrong as when it's right. That's the whole problem. It'll hand you a quote nobody said, a page number that doesn't exist or a study that was never published, all in the same calm voice as everything else.

Focus on the answers that would cost you points if they're wrong. Here's that list, and the fastest way to check each one.

Always check these

  • Quotes. If you can't find the exact words in the original, they don't go in your work.
  • Citations and links. Open every single one. Made up titles and authors can look perfect.
  • Numbers, dates and names. Check them against your textbook or notes.
  • Anything your professor explained differently. Your class beats the internet.
  • Recent news. The AI might not know what happened lately.

How to check fast

  1. Paste the prompt above right after any answer you plan to use. It gets the AI to list its own shaky claims.
  2. Open each source yourself. A dead link or a page about something else means the claim goes.
  3. Search quotes in quotation marks, or find them in the actual book or article.
  4. If you can't verify something in a few minutes, drop it.

Make it show its work

For each claim in your answer, tell me whether it came from what I gave you or from your general knowledge, and how sure you are. If you're not sure a source exists, say so.

Check against your source

Here's the section from my textbook: [paste it]. Compare it with your answer and list anything that doesn't match.

that's it. go try it tonight.

worth sending to someone?

get a new one every week

Sign up and get the free AI study kit: 23 prompts sorted by when you need them, from the first week of class to the night before a test. 9 of them aren't in any guide here.

Free, one email a week, unsubscribe whenever.