Skip to main content

prepare

Function prepare 

Source
pub fn prepare(
    model_dir: &Path,
    output: Option<&Path>,
    experts: &[u32],
) -> Result<()>
Expand description

Prepare selected precisions without loading the inference engine. Low-bit stores always derive from the aligned Q4 base, which is retained for reuse.