Who's Looking at Whom?

In the decoder of an encoder-decoder transformer (e.g., the original machine translation model), the cross-attention sublayer computes attention where the queries come from the decoder's own sequence, but the keys and values come from where?

A

The raw token embeddings of the target sequence before any layers

B

The encoder's output representations of the source sequence

C

The decoder's own previous layer output (same as queries)

D

A separate learned embedding table unrelated to either sequence