Inference 0/0

Inference

Attention internals

Attention as it runs during generation: causal masks, rotary position embeddings, grouped-query and multi-head latent attention, and stretching a model to longer contexts. Each choice changes how much memory every generated token costs.

0 / 10 solved

Questions

0/10 solved
Question Tags Difficulty Success
1. Decode-Step Attention Shapes
attentiontransformers +3
Medium —
2. No Peeking Ahead
attentiontransformers +1
Medium —
3. The Saturation Trap
attentiontransformers +1
Medium —
4. Fewer Keys, Same Heads
gqakv-cache +1
Medium —
5. Spin to Encode
attentiontransformers +1
Hard 80%
6. Position Encoding Showdown
alibirope +1
Hard —
7. KV Bytes Per Token: MHA, GQA, MLA
mlakv-cache +3
Hard —
8. The Sink That Never Drains
attention-sinksstreamingllm +1
Hard —
9. Split the KV, Not the Query
flash-decodingmemory-bound +1
Hard —
10. NTK-by-Parts
yarnrope +1
Insane —