Prompt fixtures
chat_template.jinja is copied unchanged from the
checkpoint.
references.json contains 20 contexts, expected text or errors, token IDs,
input hashes, and generator versions.
References were generated with Transformers 4.57.6, Jinja2 3.1.6, and tokenizers 0.22.2. To regenerate:
- Use the recorded checkpoint and versions.
- Render each saved
contextwith Transformers’_compile_jinja_template. - Check nonempty successful cases with
AutoTokenizer.apply_chat_template, using bothtokenize=Falseandtokenize=True. - Replace the expected text, token IDs, or error. Use
add_special_tokens=Falsefor tokenization. Do not use Cherenkov to generate reference outputs.
Empty-message cases call the template directly because the Transformers wrapper indexes the first message before rendering.
Cargo tests need no Python. Text and error checks always run. Token checks
require CHERENKOV_MODEL_DIR with the matching tokenizer; weights and GPU are
not needed. Hash checks reject stale inputs.