InfraLens

Lab 05: Sequence / Context Parallel

This folder contains annotated reading material for the lab page.

Reading focus

Read sequence/context parallelism as sharding long-context buffers along the token axis.

Source of truth

Running code is optional. The expected outcome is that you can explain the mechanism, the relevant state/shape, the common misunderstanding, and the interview answer.