Struct Mamba2CachesConfig 

pub struct Mamba2CachesConfig {
    pub n_real_caches: usize,
    pub cache: Mamba2CacheConfig,
}

Configuration / factory for Mamba2Caches.

Fields

n_real_caches: usize

Number of cache slots. Equals the number of virtual layers in the network (one cache per layer, even when layers share weights).

cache: Mamba2CacheConfig

Shared configuration that determines the shape of each individual cache tensor.

Implementations

impl Mamba2CachesConfig

pub fn new(n_real_caches: usize, cache: Mamba2CacheConfig) -> Self

Create a new instance of the config.

Arguments

Required Arguments

n_real_caches

Number of cache slots. Equals the number of virtual layers in the network (one cache per layer, even when layers share weights).

cache

Shared configuration that determines the shape of each individual cache tensor.

impl Mamba2CachesConfig

pub fn new_from_block_config( n_real_caches: usize, batch: usize, block_config: Mamba2Config, ) -> Self

Convenience constructor that derives cache shapes directly from a Mamba2Config block configuration.

pub fn init<B: Backend>(&self, device: &B::Device) -> Mamba2Caches<B>

Allocate all cache tensors (zero-initialised) on device.

Trait Implementations

impl Clone for Mamba2CachesConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for Mamba2CachesConfig

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for Mamba2CachesConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Mamba2CachesConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for Mamba2CachesConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for Mamba2CachesConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.