Expand description
Bounded conversation history, committed at the final-response publication boundary.
Structsยง
- Commit ๐
- Session ๐
- Session
Stats ๐ - Store ๐
- Turn ๐
- Pin a session through admission, prefill and decode. Drop rolls back cancelled turns.