gdn_exact_carry

Function gdn_exact_carry 

Source
pub fn gdn_exact_carry(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    h_table: DevicePtr,
    query: DevicePtr,
    key: DevicePtr,
    value: DevicePtr,
    gate: DevicePtr,
    beta: DevicePtr,
    output: DevicePtr,
    carry_base: DevicePtr,
    slot_tab: DevicePtr,
    pend: DevicePtr,
    seq_floats: u32,
    batch_size: u32,
    num_k_heads: u32,
    num_v_heads: u32,
    k_dim: u32,
    strides: [u32; 4],
    engaged_flag: DevicePtr,
    stream: u64,
) -> Result<()>
Expand description

2026-10-01: Carried-state exact verify (gdn_exact_carry{2,3,4} or its _lazy form, chosen by the caller’s kernel; gdn_exact_carry.cu in the model directory): the stash protocol of gdn_carry_wy around the strided FP32 decode’s per-token chain. Rows are sequence-major, b * K + t: FP32 q and k at qk_stride, v at v_stride, gate and beta at gb_stride, the FP32 output at out_stride, all in floats.