Plausibility, fabrication and reliability

A model that continues text plausibly continues it plausibly when it has no basis for the answer, and the wrong answer arrives in the same confident register as the right one. This chapter derives that behaviour from the machinery of the first two chapters, sorts tasks by where the answer actually lives, works through a fabricated regulatory citation and the cost of checking it, and shows the design move that keeps a number that must not be invented out of the weights. It closes by handing off to tokens, the unit everything in this topic was measured in.

What a language model is — read the current version at https://daviddominguez.dev/learn/en/what-a-language-model-is/plausibility-fabrication-and-reliability

Back to top