Question 81
In the Transformer architecture, the core mechanism that allows model tokens to dynamically attend to all other tokens in a sequence simultaneously is:
$Scaled Dot-Product Self-Attention computes Attention(Q, K, V) = softmax(QK^T / sqrt(d_{k})) V, modeling parallel relationships across tokens.$