Struct Layout 

pub struct Layout {

    pub bits: u32,
    pub stride: usize,
    pub mat: usize,
    pub scale_bytes: usize,
    pub gate_w: usize,
    pub up_w: usize,
    pub down_w: usize,
    pub gate_s: usize,
    pub gate_b: usize,
    pub up_s: usize,
    pub up_b: usize,
    pub down_s: usize,
    pub down_b: usize,
}

Expert record layout shared by the packer, prefill, and decode. Low-bit records keep the base order: three weight matrices followed by six scale/bias blocks copied verbatim from the 4-bit record.

Fields

bits: u32

stride: usize

mat: usize

scale_bytes: usize

gate_w: usize

up_w: usize

down_w: usize

gate_s: usize

gate_b: usize

up_s: usize

up_b: usize

down_s: usize

down_b: usize

Implementations

impl Layout

pub fn four_bit(e: &ExpertLayout) -> Self

Preserve the base store’s offsets verbatim; prefill and decode use this same description rather than reconstructing the record layout.

pub fn kind(&self) -> u8

Address-table tag shared with the decode shaders.

pub fn new(e: &ExpertLayout, bits: u32) -> Result<Self>

fn manifest_json(&self, records: usize) -> String

Trait Implementations

impl Clone for Layout

fn clone(&self) -> Layout

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Layout

impl Debug for Layout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.