Search vs generation

Beginner · 6 min · Decide when a question needs live web access and when the model's memory is enough.

  • research
  • verification

An AI answer comes from one of two places: the model’s memory — patterns absorbed during training, frozen at its training cutoff — or live sources fetched right now by a search-connected tool. The words look identical either way, so before trusting any fact, ask which one you just got.

What each mode is good at

The traps on each side

Memory fails through staleness and confident invention — the mechanism behind the hallucinations lesson. Retrieval fails differently: a page can be real and still not support the claim, and search results can be thin or misleading. Live search makes answers checkable — it does not make them checked. That is the next lesson’s job.

A bad example

Ask (no web access): “What does the new data-protection amendment require for small businesses?”

The amendment is recent — possibly newer than the model’s training data. Memory answers with the average of what it saw: plausible, structured, and quietly a year out of date.

A better example

Ask (web-connected): “Find the current text of the amendment and summarize what it requires for small businesses, linking each requirement to the section of the official text it comes from.”

Now the answer arrives with pointers you can open — and “the retrieved text does not cover this” becomes a possible, correct answer.

The five-second test

Before trusting a fact: would this fact survive a year unchanged? If yes, generation is usually enough. If no — or if being wrong costs money, time or compliance — ask a search-connected tool and require sources. The test takes five seconds and prevents most stale-fact mistakes.

A closing habit that makes the distinction physical: when a fact matters, copy the source line into your own notes as you verify it. Notes that carry a pointer per fact are what you actually trust later — and the pointers make rechecking cheap when the world moves. Memory starts the work; sourced notes finish it.

Practice

Choose when search changes the answer

You are using an AI assistant that can answer from its training memory or search the live web. For one of these requests, only a live, sourced answer is safe to act on.

Pick the request that needs live sources before you trust the answer.

Choose one option
Hint

Would the correct answer have been different a year ago?

The word 'still' assumes yesterday's fact is today's — what could confirm that?

Transfer

Next

Next: Inspect the citations — the source exists. Now: does it actually say what the answer claims?