pub struct EpRoutingTable {
pub local_token_indices: Vec<u32>,
pub local_expert_ids: Vec<u32>,
pub local_weights: Vec<f32>,
pub remote_token_indices: Vec<u32>,
pub remote_expert_ids: Vec<u32>,
pub remote_weights: Vec<f32>,
}Expand description
2026-09-25: Top-k assignments split into a local bucket (expert in this
rank’s range) and a remote bucket (any other expert). Entry i of a bucket
is the triple (*_token_indices[i], *_expert_ids[i], *_weights[i]), in
the order the assignments were given.
Fields§
§local_token_indices: Vec<u32>§local_expert_ids: Vec<u32>2026-09-25: Global expert ids, not rank-relative.
local_weights: Vec<f32>§remote_token_indices: Vec<u32>§remote_expert_ids: Vec<u32>2026-09-25: Global expert ids, not rank-relative.
remote_weights: Vec<f32>Implementations§
Source§impl EpRoutingTable
impl EpRoutingTable
pub fn local_count(&self) -> usize
pub fn remote_count(&self) -> usize
Sourcepub fn total_count(&self) -> usize
pub fn total_count(&self) -> usize
2026-09-25: Equals num_tokens * top_k of the build call.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for EpRoutingTable
impl RefUnwindSafe for EpRoutingTable
impl Send for EpRoutingTable
impl Sync for EpRoutingTable
impl Unpin for EpRoutingTable
impl UnwindSafe for EpRoutingTable
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more