Skip to main content

Module registry

Module registry 

Source
Expand description

Bounded request registration and cancellation, independent of the GPU worker.

Structsยง

Registry ๐Ÿ”’
Ticket ๐Ÿ”’

Constantsยง

CANCELLED ๐Ÿ”’
COMPLETED ๐Ÿ”’
LIVE ๐Ÿ”’

Functionsยง

id ๐Ÿ”’
tool_call_id ๐Ÿ”’
OpenAI-style identifier minted for one decoded model tool call.