Skip to main content

Module sampling

cherenkov

Module sampling 

Source
Expand description

Request-owned sampling state. GPU logits are borrowed after synchronization.

Structs§

Sampler 🔒
Sampling

Functions§

nucleus 🔒
rank 🔒