This folder contains annotated reading material for the lab page.
Compare math-level attention with kernel/runtime choices: SDPA, FlashAttention and PagedAttention.
Running code is optional. The expected outcome is that you can explain the mechanism, the relevant state/shape, the common misunderstanding, and the interview answer.