Foundations 0/0

Foundations

Transformers

Queries, keys and values, scaled dot-product attention, multiple heads and positional information, assembled into the transformer block that language models are built from. Model cards, serving configs and kernels all assume this vocabulary.

0 / 4 solved

Questions

0/4 solved
Question Tags Difficulty Success
1. Who's Looking at Whom?
attentionencoder-decoder +1
Medium 71%
2. Why is dot-product attention scaled?
Machine LearningDeep Learning Architecture
Medium 80%
3. Eight Eyes Are Better Than One
multi-head attentiontransformer
Medium —
4. Order, Please
positional encodingself-attention +1
Medium 80%