Attention masks
Causal masking zeroes softmax mass on future timestep columns enforcing autoregressive likelihoods.
Padding masks discard padded keys so minibatches aggregate heterogeneous lengths safely.
Causal masking zeroes softmax mass on future timestep columns enforcing autoregressive likelihoods.
Padding masks discard padded keys so minibatches aggregate heterogeneous lengths safely.