List of all items

Structs

• Sampler
• SamplingParams

Functions

• apply_dry_penalty
• apply_lz_penalty
• apply_penalties_and_bias
• argmax_bf16
• argmax_f32
• argmax_first_wins_f32
• feed_argmax::bf16_to_f32
• feed_argmax::feed_argmax
• feed_argmax::feed_argmax_f32
• feed_argmax::masked_last_wins
• feed_argmax::masked_row
• feed_argmax::plain_kernel_argmax
• last_entropy
• low_entropy_token_count
• sample_with_params
• sample_with_params_history
• sample_with_params_seeded
• total_sampled_token_count

Constants

• feed_argmax::BLOCK
• feed_argmax::NO_ID
• feed_argmax::PLAIN_FLOOR