Skip to content
ai

Autoregressive

Autoregressive Generation

Definition

Autoregressive models generate sequences one token at a time, conditioning each new token on all previously generated tokens. GPT-style language models are autoregressive — they predict the next token given the full left context.

This sequential generation allows flexible open-ended text production but makes parallel decoding difficult.


Ship secure code faster

Crash Override integrates security into the developer workflow. No context switching, no waiting on reviews.