Enum ResidualsConfigSerde 

enum ResidualsConfigSerde {
    Standard,
    MultiGate {
        n_stream: usize,
        init_bias: f64,
        per_virtual_layer: bool,
    },
}

Variants

Standard

Plain additive Pre-LN residual.

MultiGate

Multi-Gate Residuals over n_stream streams.

Fields

n_stream: usize

Number of parallel residual streams n.

init_bias: f64

Initial gate bias (see MultiGateResidualConfig::init_bias).

per_virtual_layer: bool

true ⇒ one MGR per virtual layer; false ⇒ one per real layer (reused across virtual passes). See MultiGate::per_virtual.

Trait Implementations

impl<'de> Deserialize<'de> for ResidualsConfigSerde

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for ResidualsConfigSerde

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.