BLOG ILLUSTRATION / EXECUTION STORY

Reasoning pauses for a tool

This example has a queue, prefill, reasoning, a tool wait, more reasoning and an answer. History retention is different from active model computation. The exact hosted sequence and cache management stay unknown.

Reasoning pauses for a toolThis example has a queue, prefill, reasoning, a tool wait, more reasoning and an answer. History retention is different from active model computation. The exact hosted sequence and cache management stay unknown. MODEL / RUNTIME Queue request metadata Prefill prompt processing Reason A model work Tool call typed arguments External tool external wait User: answer pending History: retained Complete release state Answer visible response Reason B Model continues.
This request example has visible output, model work, tool waits and retained history. Until the answer, the user may see only an optional preamble. A tool wait is different from active model computation. Longer work can keep state for a longer time, but the exact hosted sequence and retention stay unknown. The author made this explanatory diagram with example playback, and animation time is not measured runtime. Open full-size SVG