AI
Transformer
An architecture that processes input in parallel using self-attention, replacing recurrence and enabling training on much larger datasets.
Introduced in 2017 (Vaswani et al.), the transformer is the architecture behind GPT, Claude, Gemini and most current language models. Its parallelism makes it efficient on modern hardware, and its attention mechanism lets it weight relationships between any positions in the input regardless of distance.