Expand description
Bounded request registration and cancellation, independent of the GPU worker.
Structsยง
Constantsยง
Functionsยง
- id ๐
- tool_
call_ ๐id - OpenAI-style identifier minted for one decoded model tool call.
Bounded request registration and cancellation, independent of the GPU worker.