Expand description
Serial-over-chunks SSD with a custom recompute backward. Double-SSD serial scan with a custom, memory-efficient backward.
The forward + Mamba3DoubleSsdBackendExt impl live in
serial_recalculated; the registered autodiff backward node and the
recompute-based gradient math in combined_backward save training memory
by recomputing intermediates instead of storing them.
Modules§
- backward
- The registered custom
Backwardnode (autodiff op). - combined_
backward - Recompute-based gradient math (the memory-efficient backward).
- serial_
recalculated 🔒 - Serial SSD with a custom, memory-efficient backward (Mamba-3 double-SSD)
Traits§
- Mamba3
Double SsdAutodiff Backend Ext - Marker for an autodiff-capable backend that also implements the extension trait (so the custom memory-efficient backward is available).
- Mamba3
Double SsdBackend Ext - Extends the backend for the memory-efficient serial recalculated SSD.