Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Developer environment reference

Unset these overrides for normal inference. Fake reads and skipped stages produce invalid outputs.

VariableValue / defaultPurpose
CHERENKOV_FAKEexperts; offSkip real expert reads for attribution; invalid numerics.
CHERENKOV_SKIPcomma-separated experts,shared,lmhead,mixer; emptySkip selected decode stages; invalid numerics.
CHERENKOV_LAYERSinteger; allCap decoder blocks for debugging.
CHERENKOV_TRACEpresence; offPrint per-step timing and residency detail.
CHERENKOV_SPIN0 to block; spinning defaultShared-event waiting policy.
CHERENKOV_LOOKAHEAD0 to disable; enabledOne-block router lookahead and reads.
CHERENKOV_ROWS_MAXinteger; 4Cap rows in the short-prompt prefill path.
CHERENKOV_POOLset; copy pool defaultResidency-set pool over mapped experts; requires 4-bit throughout.
CHERENKOV_PREFILL_MINinteger; 64Prompt length selecting the batched prefill engine.
CHERENKOV_PREFILL_CHUNKpositive integer; adaptivePrefill rows per chunk; capped at 1,024 under --check.
CHERENKOV_DUMP_ARGMAXoutput path; offPer-prompt-row position, argmax, and maximum logit.
CHERENKOV_DUMP_LOGITSoutput path; offLast prompt row’s f32 little-endian logits.
CHERENKOV_DUMP_LAoutput path; offJSON lookahead predictions and outcomes.
CHERENKOV_DUMP_EXPERTSoutput path; offJSON expert history.
CHERENKOV_DUMP_ROUTESoutput path; offJSON route history.
CHERENKOV_DUMP_STATESoutput path; offRouter states: JSON header plus binary records.
CHERENKOV_DUMP_TOKENSoutput path; offJSON prompt and generated token IDs.

CHERENKOV_MODEL_DIR selects the packed model for real-weight tests. Otherwise they use the managed model, or skip if it is absent. Other CPU and kernel tests need no checkpoint.