{
  "title": "A batch changes with new requests and completion",
  "caption": "Mixed prefill/decode scheduling is an assumption. Horizontal spacing shows iteration sequence, not elapsed time. These batches are an explanatory example.",
  "alt": "Continuous batching: with five example batches, B is completed after batch 3, A is completed after batch 4 and C is completed after batch 5.",
  "sources": [
    {
      "file": "content/blog/2026-06-11_life-of-a-request-vllm/post.md",
      "description": "Mechanism and scope from the current article; concrete requests/tokens are illustrative."
    },
    {
      "file": "/Users/jiwenbo/Documents/GitHub/Blog_Illustration_Skill/examples/animated-flow-2026-10-16/01-vllm-batching/diagram.svg",
      "sha256": "6a1a0718795a7df85c7824cf0166c1f5a129c3bab7b6faf009efd4e4c3215b80",
      "description": "Skill source illustration; imported, not an observed runtime trace."
    }
  ],
  "limitations": [
    "Playback time helps show the example. It is not measured latency or throughput.",
    "This is a constructed execution trace. It is not a captured vLLM serving run.",
    "Playback timing is an example, not measured runtime. The original SVG from the Skill has no changes."
  ]
}