Let AI Teach Me · Against hallucination

Run the AI's answer through three checks first

Feeling sourced is not the same as having evidence. Before you brief it, run the claim through three gates: sources, cross-check, and uncertainty.

Four-panel comic: Alice takes an AI conclusion that feels sourced straight into a briefing, then crashes because a link won't open and there's only one source

A citation can look complete and still be a dead link. A single source can sound certain and still not count as a cross-check.

Monday morning, before standup, you ask AI whether a new policy will hit the team. It gives a clear conclusion, plus an “industry association report,” a “research-institute brief,” and three links. The page is laid out like a memo that's already been researched.

You don't have time to open them one by one, so you paste the conclusion straight into the briefing. When the manager asks for evidence, the first link is a 404, the second dumps you on the homepage, and the third opens — but the content is the same association report. Three links. One piece of evidence.

The crash is specific: AI was both the answerer and the checker. It can dress up what it just wrote so it looks more like evidence, but repeating itself is not an outside check. You need to give verification three different jobs.

Try it once · How would you ask AI to check
Alice
Alice
Online
AI just handed you a claim ready for the briefing: “The new policy will cut filing costs for small and mid-size teams by 30%.” Which check instruction do you send first?
Three gates, three different problems:
Ask for sources: Make every claim point back to an original you can open. Stops content invented from thin air.
Cross-check: Find independent sources and check them against each other. Stops bias from a single piece of evidence.
Flag uncertainty: Separate what's confirmed, what's inferred, and what's missing. Stops unknowns being written as facts.
Now set up a full check. Pick 3–5 actions below, and I'll tell you how far this set of checks can take you.
0 selected, need at least 3 more
Evidence
    After the three checks, how should you write the conclusion

    Don't write the check result as just “trustworthy” or “not.” A result you can act on needs at least four blocks: the judgment, the evidence, the next step, and open questions. Whoever picks it up later knows what they can use, and what's only a lead.

    Even if all three pass, open the most important original. Cross-check can shrink the error range; it can't tell you what the page actually says. The model shrinks what still needs a check. You make the key evidence land.

    Having a source is only the start. Usable means you can open it, it can cross-check, and you're willing to mark what you don't know.