Expand description
Serial-over-chunks SSD with a custom recompute backward. Single-SSD serial scan with a custom, memory-efficient backward.
The forward + Mamba3SingleSsdBackendExt impl live in
serial_recalculated; the registered autodiff [backward] node and the
recompute-based gradient math in [combined_backward] save training memory
by recomputing intermediates instead of storing them.
Modules§
- backward
- The registered custom
Backwardnode (autodiff op). - combined_
backward - Recompute-based gradient math (the memory-efficient backward).
- serial_
recalculated 🔒 - Serial SSD with a custom, memory-efficient backward (Mamba-3 single-SSD)
Traits§
- Mamba3
Single SsdAutodiff Backend Ext - Marker for an autodiff-capable backend that also implements the SSD extension trait (so the custom memory-efficient backward is available).
- Mamba3
Single SsdBackend Ext - Extends the backend for the memory-efficient single-ssd form serial SSD.