Decoder-only autoregressive LMs

Causal masking plus massive web corpora underpin emergent prompting behaviours.

They pair naturally with rollout sampling KV-cache optimisation tricks powering interactive interfaces.