pub struct QuantizeCtx {
pub absmax_k: KernelHandle,
pub quantize_k: KernelHandle,
pub stream: u64,
}Expand description
2026-09-25: Kernels and stream for load-time NVFP4 quantization (quantize_to_nvfp4).
Fields§
§absmax_k: KernelHandle§quantize_k: KernelHandle§stream: u64Trait Implementations§
Source§impl Clone for QuantizeCtx
impl Clone for QuantizeCtx
Source§fn clone(&self) -> QuantizeCtx
fn clone(&self) -> QuantizeCtx
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for QuantizeCtx
Auto Trait Implementations§
impl Freeze for QuantizeCtx
impl RefUnwindSafe for QuantizeCtx
impl Send for QuantizeCtx
impl Sync for QuantizeCtx
impl Unpin for QuantizeCtx
impl UnwindSafe for QuantizeCtx
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more