Skip to main content

Module cache

Module cache 

Source
Expand description

§Mamba-3 Cache and Pathway Selection

Mamba3Cache / Mamba3Caches are enums tagging which SSD pathway a cache belongs to (DoubleSsd | SingleSsd). Supplying one of these to Mamba3::forward / Mamba3::step is what selects the pathway at runtime; a missing cache defaults to SingleSsd.

The two pathways’ SSM accumulators differ mid-sequence, so the cache types are kept distinct to prevent silently mixing them inside a chunked pass. They coincide at sequence boundaries, however — where caches are actually produced and consumed — so the From impls at the bottom convert between them by a lossless field-by-field move (see the note there).

Enums§

Mamba3Cache
A pathway-tagged bundle of per-block cache, so a single dispatch entry can accept / return either cache family.
Mamba3Caches
A pathway-tagged bundle of per-layer caches, so a single dispatch entry can accept / return either cache family.