Why is dot-product attention scaled?

To prevent dot-product magnitudes from growing with dimension and pushing softmax into low-gradient regions

To force every attention row to have unit Euclidean norm

To make attention invariant to arbitrary rotations of the value vectors

To ensure that the attention matrix remains symmetric