Skip to main content

Module ssd

Module ssd 

Source
Expand description

The standard SSD kernels reused by both the γ and β passes. Standard MIMO-first SSD kernels reused by the double-SSD γ and β passes.

Three exact reformulations (Minimal / Serial / SerialRecalculated) that agree on values and gradients; selected via Mamba3SsdPath and dispatched by [Mamba3DoubleSsdInput::run].

Re-exports§

pub use serial_recalculated::Mamba3DoubleSsdAutodiffBackendExt;
pub use serial_recalculated::Mamba3DoubleSsdBackendExt;
pub use ssd_path::Mamba3DoubleSsdInput;

Modules§

minimal
Matmul/segsum MIMO-first SSD with plain autodiff backward.
serial
Serial-over-chunks SSD with plain autodiff backward.
serial_recalculated
Serial-over-chunks SSD with a custom recompute backward. Double-SSD serial scan with a custom, memory-efficient backward.
ssd_path
The Mamba3DoubleSsdInput bundle and its run() dispatch.