Struct Mamba2CacheConfig 

pub struct Mamba2CacheConfig {
    pub batch: usize,
    pub state_rank: usize,
    pub conv_kernel: usize,
    pub conv_dim: usize,
    pub per_head_dim: usize,
    pub nheads: usize,
}

Configuration / factory for a single Mamba2Cache.

Fields

batch: usize

Batch size.

state_rank: usize

state_rank — the number of latent dimensions in the SSM hidden state. Corresponds to state_rank in Mamba2Config.

conv_kernel: usize

Causal convolution window length. Corresponds to conv_kernel in Mamba2Config.

conv_dim: usize

Number of channels entering (and leaving) the depthwise convolution. Equal to d_inner + 2 · ngroups · state_rank.

per_head_dim: usize

Head dimension per_head_dim. Corresponds to per_head_dim in Mamba2Config.

nheads: usize

Number of SSM heads nheads.

Implementations

impl Mamba2CacheConfig

pub fn new(batch: usize, conv_dim: usize, nheads: usize) -> Self

Create a new instance of the config.

Arguments

Required Arguments

batch

Batch size.

conv_dim

Number of channels entering (and leaving) the depthwise convolution. Equal to d_inner + 2 · ngroups · state_rank.

nheads

Number of SSM heads nheads.

Default Arguments

state_rank

state_rank — the number of latent dimensions in the SSM hidden state. Corresponds to state_rank in Mamba2Config.

• Defaults to 128

conv_kernel

Causal convolution window length. Corresponds to conv_kernel in Mamba2Config.

• Defaults to 4

per_head_dim

Head dimension per_head_dim. Corresponds to per_head_dim in Mamba2Config.

• Defaults to 64

impl Mamba2CacheConfig

pub fn with_state_rank(self, state_rank: usize) -> Self

Sets the value for the field state_rank.

state_rank — the number of latent dimensions in the SSM hidden state. Corresponds to state_rank in Mamba2Config.

• Defaults to 128

pub fn with_conv_kernel(self, conv_kernel: usize) -> Self

Sets the value for the field conv_kernel.

Causal convolution window length. Corresponds to conv_kernel in Mamba2Config.

• Defaults to 4

pub fn with_per_head_dim(self, per_head_dim: usize) -> Self

Sets the value for the field per_head_dim.

Head dimension per_head_dim. Corresponds to per_head_dim in Mamba2Config.

• Defaults to 64

impl Mamba2CacheConfig

pub fn new_from_block_config(batch: usize, block_config: Mamba2Config) -> Self

Derive cache shapes from a Mamba-2 block configuration plus a batch size.

pub fn init(&self, device: &Device) -> Mamba2Cache

Allocate zero-initialised cache tensors on device.

Zero initialisation is correct because:

• The convolution cache represents “no previous tokens” (identity padding).
• The SSM state represents h₀ = 0 (zero initial condition), which is the standard default. Learnable initial state (if configured) are added on top of this inside Mamba2::forward / Mamba2::step.

Trait Implementations

impl Clone for Mamba2CacheConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for Mamba2CacheConfig

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for Mamba2CacheConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Mamba2CacheConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for Mamba2CacheConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for Mamba2CacheConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.