InfraLens

Lab 07: 3D Parallelism Plan

This folder contains annotated reading material for the lab page.

Reading focus

Read a 3D plan as mapping DP/FSDP, TP and PP groups onto hardware topology.

Source of truth

Running code is optional. The expected outcome is that you can explain the mechanism, the relevant state/shape, the common misunderstanding, and the interview answer.