Temperature

In plain terms

A knob for randomness in token selection.

Technical definition

A scalar dividing logits before softmax; higher values flatten the distribution, increasing diversity.

Related terms