Foundations
Transformers
Queries, keys and values, scaled dot-product attention, multiple heads and positional information, assembled into the transformer block that language models are built from. Model cards, serving configs and kernels all assume this vocabulary.
Questions
Question Difficulty Success