pub struct LoraRoute {
pub a_table: DevicePtr,
pub b_table: DevicePtr,
pub scale_table: DevicePtr,
pub k_in: u32,
pub n_out: u32,
pub max_rank: u32,
}Expand description
2026-09-25: Per-(layer, module) routing tables that apply_lora_bgmv reads: the
[max_loras] device tables of A and B pool addresses (a_table / b_table, 0 = the slot
does not adapt this module), the [max_loras] f32 scale_table, and the projection dims.
The addresses are fixed when the pool is packed, so the adapter for each row is chosen only
by the per-step seq_slot buffer. Installed by copy onto the layer next to the active
LoraPair, which the unrouted path uses.
Fields§
§a_table: DevicePtr§b_table: DevicePtr§scale_table: DevicePtr§k_in: u32§n_out: u32§max_rank: u32Trait Implementations§
Auto Trait Implementations§
impl Freeze for LoraRoute
impl RefUnwindSafe for LoraRoute
impl Send for LoraRoute
impl Sync for LoraRoute
impl Unpin for LoraRoute
impl UnwindSafe for LoraRoute
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more