Skip to main content
MENTORSURGE

Practical AI · Lesson 3 of 5

Check an AI Answer Before You Rely on It

Break an AI answer into claims, find the original source for each one, and check dates and scope. A worked example about emergency funds and FDIC insurance.

12-minute lessonBeginnerUpdated

In this lesson you will

Break an AI answer into separate claims, check each one against an original source, and end with a clear list of what is confirmed, what is wrong, and what is still unknown.

The idea in plain language

FactOpenAI's help center says ChatGPT can produce incorrect or misleading outputs, including fabricated quotes, studies, citations, or references, and may sound confident even when it is wrong. It recommends verifying important information from reliable sources.

Checking an answer is a routine, not a feeling. Work through it in five steps:

  1. Split it into claims. Dates, numbers, names, and statements of fact, kept separate from opinions and suggestions.
  2. Ask what supports each claim. Request the original source and the exact passage.
  3. Open the source yourself. Confirm the page exists and says what the answer claims. A real link can still support a different sentence.
  4. Check date and scope. An accurate figure from an old year, or a different country or group, can still mislead.
  5. Decide. Keep what is confirmed, fix what is wrong, and say what is still unknown.

Worked example

IllustrationChecking a fictional AI answer about emergency funds

Suppose an assistant answered: “The FDIC covers $250,000 per person at every bank, everyone needs exactly six months of expenses saved, and 63% of adults can cover a $400 emergency with cash.” Here is what checking each claim against the original sources finds:

Claim-by-claim check (fictional AI answer, real sources)
ClaimWhat the source saysStatus
FDIC covers $250,000 per person at every bankAt least $250,000 per depositor, per ownership category, at each FDIC-insured bank (FDIC)Partly right: missing the ownership-category detail and the word “insured”
Everyone needs exactly six months savedThe amount depends on your situation (CFPB)Not supported
63% can cover $400 with cash63% of adults said they would cover a $400 expense with cash or its equivalent, in the survey of 2025 (Federal Reserve, May 2026)Supported, once the year and definition are added

All three claims needed a correction or added context, and one was not supported at all. None of that was visible from how confident the answer sounded.

Try it: review an answer of your own

Practice prompt
Help me review the answer pasted below. Do not treat your earlier answer as proof.
Separate its factual claims from opinions and suggestions. Make a table with:
claim; why it matters; original source supplied; what I need to check; status.
Use "unverified" until I have checked the original source myself. Do not invent links, quotes, or citations. If a source is unavailable or you cannot access it, say so. Flag dates, quantities, names, and anything that depends on current information.
Answer to review:
[Paste a short answer about a low-stakes topic. Remove personal or confidential information first.]

Then open at least three sources yourself and update the status column.

Check the result yourself

Limits of this lesson

  • Asking a second chatbot is not a substitute for opening the source.
  • This routine is for everyday research. It does not replace professional advice on financial, medical, legal, or other high-stakes decisions.
  • Sometimes the honest result is “I do not have enough evidence yet.” That is a good outcome.

Keep the human review

Examples are practice exercises, not tested AI outputs or a promise of results. During practice, do not give an assistant permission to send, publish, buy, or change anything in an account.

Sources

Facts on this page were checked against these sources on October 7, 2026. Figures marked Illustration are arithmetic examples, not forecasts.

  1. OpenAI Help Center, Does ChatGPT tell the truth? (checked October 7, 2026) (opens in a new tab)
    Hallucinations and verification advice.
  2. FDIC, Understanding Deposit Insurance (opens in a new tab)
    Deposit insurance wording used in the example.
  3. CFPB, An essential guide to building an emergency fund (opens in a new tab)
    Emergency fund sizing guidance used in the example.
  4. Federal Reserve, Economic Well-Being of U.S. Households in 2025 (published May 2026) (opens in a new tab)
    The $400 survey figure used in the example.

Go deeper

Related articles from the MentorSurge archive. Articles reflect the date they were published; check time-sensitive figures.

About this lesson: original MentorSurge teaching material for general education. It is not individualized financial, investment, tax, or legal advice. Spotted an error? Tell us.

Next lesson

Keep Private Information Out of AI Tools

How to redact personal and financial details and review AI tool data settings.

Previous lesson

Turn Rough Notes into a Clear Plan

How to use AI to structure notes into an action plan while keeping unknowns visible.