Expand description
Serial-over-chunks SSD with a custom recompute backward. Single-SSD serial scan with a custom, memory-efficient backward.
The forward + Mamba3SingleSsdBackendExt impl live in
serial_recalculated; the registered autodiff backward node and the
recompute-based gradient math in combined_backward save training memory
by recomputing intermediates instead of storing them.
Modules§
- backward
- The registered custom
Backwardnode (autodiff op). - combined_
backward - Recompute-based gradient math (the memory-efficient backward).
- diag
- The same-step γ-correction on primitives — forward and analytic backward.
- serial_
recalculated 🔒 - Serial SSD with a custom, memory-efficient backward (Mamba-3 single-SSD)
Traits§
- Mamba3
Single SsdAutodiff Backend Ext - Marker for an autodiff-capable backend that also implements the extension trait (so the custom memory-efficient backward is available).
- Mamba3
Single SsdBackend Ext - Extends the backend for the memory-efficient single-ssd form serial SSD.