Struct Mamba1CachesConfig 

pub struct Mamba1CachesConfig {
    pub n_real_caches: usize,
    pub cache: Mamba1CacheConfig,
}

Configuration / factory for Mamba1Caches.

Fields

n_real_caches: usize

Number of cache slots. Equals the number of virtual layers in the network (one cache per layer, even when layers share weights).

cache: Mamba1CacheConfig

Shared configuration that determines the shape of each individual cache tensor.

Implementations

impl Mamba1CachesConfig

pub fn new(n_real_caches: usize, cache: Mamba1CacheConfig) -> Self

Create a new instance of the config.

Arguments

Required Arguments

n_real_caches

Number of cache slots. Equals the number of virtual layers in the network (one cache per layer, even when layers share weights).

cache

Shared configuration that determines the shape of each individual cache tensor.

impl Mamba1CachesConfig

pub fn new_from_block_config( n_real_caches: usize, batch: usize, block_config: Mamba1Config, ) -> Self

Convenience constructor that derives cache shapes directly from a Mamba1Config block configuration.

pub fn init(&self, device: &Device) -> Mamba1Caches

Allocate all cache tensors (zero-initialised) on device.

Trait Implementations

impl Clone for Mamba1CachesConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for Mamba1CachesConfig

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for Mamba1CachesConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Mamba1CachesConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for Mamba1CachesConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for Mamba1CachesConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.