AI Hallucination and Grounding Anchors
The tendency of a model to invent plausible specifics when evidence is missing or contradictory, and the practice of supplying unambiguous statements that anchor it to fact.
Analogy Mental model
A tour guide who does not know when the temple was built but cannot bear silence, so he glances at the paint and invents a royal commission with total confidence.
In practice What you actually do
Hallucination about your product usually starts with your own vagueness. Three countermeasures: a dedicated facts page listing founding year, headquarters, supported platforms, exact prices, and what the product explicitly does not do; sentences in the affirmative or negative with no hedging; and the elimination of contradictions between pages.
Where people get burned Pitfalls
Models also invent URLs by completing a pattern they have seen. Watch analytics for visitors from an assistant landing on errors, and redirect the invented addresses that recur to the real pages they were reaching for.
This entry was written in English from the Chinese original, not machine-translated. Read the Chinese version →