The Illustrated Transformer(opens in a new tab)
A visual walk through the Transformer from Attention Is All You Need: how each word becomes query, key and value vectors, how attention scores are computed and combined across heads, and how the encoder and decoder stacks fit together.