Expand description
Round-robin GPU scheduling. Each active request owns its decoding state.
Structs§
- Active 🔒
- Generated
Text 🔒 - Raw decoded bytes are used for reconciliation and limits. Only parsed content is published to clients and retained in session history.
- Pending 🔒
- Worker 🔒
Enums§
- Phase 🔒