Skip to main content

Module serial_recalculated

Module serial_recalculated 

Source
Expand description

Serial-over-chunks SSD with a custom recompute backward. Single-SSD serial scan with a custom, memory-efficient backward.

The forward + Mamba3SingleSsdBackendExt impl live in serial_recalculated; the registered autodiff [backward] node and the recompute-based gradient math in [combined_backward] save training memory by recomputing intermediates instead of storing them.

Modules§

backward
The registered custom Backward node (autodiff op).
combined_backward
Recompute-based gradient math (the memory-efficient backward).
serial_recalculated 🔒
Serial SSD with a custom, memory-efficient backward (Mamba-3 single-SSD)

Traits§

Mamba3SingleSsdAutodiffBackendExt
Marker for an autodiff-capable backend that also implements the SSD extension trait (so the custom memory-efficient backward is available).
Mamba3SingleSsdBackendExt
Extends the backend for the memory-efficient single-ssd form serial SSD.