pub enum TensorEncoding {
Dense {
tensor: StoredTensor,
},
Affine {
bits: u8,
group_size: u64,
group_axis: usize,
packing: BitPacking,
codes: StoredTensor,
scales: StoredTensor,
offset: AffineOffset,
},
Ggml {
encoding: GgmlEncoding,
data: DataSpan,
},
Opaque {
name: String,
metadata: Value,
data: Vec<DataSpan>,
},
}Expand description
Storage layout and quantization metadata, with explicit references to all data.
Variants§
Dense
Addressable scalar values with explicit shape and strides.
Fields
§
tensor: StoredTensorPhysical view of the scalar values.
Affine
Grouped integer codes reconstructed using scales and an affine offset.
Fields
§
packing: BitPackingOrder of codes within each storage word.
§
codes: StoredTensorPacked integer codes.
§
scales: StoredTensorOne scale per quantization group.
§
offset: AffineOffsetAdditive biases or integer zero points, one per group.
Ggml
GGML blocks whose layout is determined by the encoding code.
Opaque
Uninterpreted storage retained for a future adapter.
Implementations§
Trait Implementations§
Source§impl Clone for TensorEncoding
impl Clone for TensorEncoding
Source§fn clone(&self) -> TensorEncoding
fn clone(&self) -> TensorEncoding
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TensorEncoding
impl Debug for TensorEncoding
Source§impl<'de> Deserialize<'de> for TensorEncoding
impl<'de> Deserialize<'de> for TensorEncoding
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<TensorEncoding, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<TensorEncoding, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Serialize for TensorEncoding
impl Serialize for TensorEncoding
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
Auto Trait Implementations§
impl Freeze for TensorEncoding
impl RefUnwindSafe for TensorEncoding
impl Send for TensorEncoding
impl Sync for TensorEncoding
impl Unpin for TensorEncoding
impl UnsafeUnpin for TensorEncoding
impl UnwindSafe for TensorEncoding
Blanket Implementations§
impl<T> AutoreleaseSafe for Twhere
T: ?Sized,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more