Why AI invents facts, and what to do about it
A language model does not look anything up. It predicts the next piece of text that best fits everything before it, so an invented citation comes out of the same mechanism that produces a correct one. The model has no internal signal separating the two. That is why the fix is never to ask it to be more careful. The fix is to hand it the source and check the answer against that source.
4 min read