Struct RmsNormGatedConfig 

pub struct RmsNormGatedConfig {
    pub d_model: usize,
    pub norm_before_gate: bool,
}

Configuration to create a RmsNormGated layer.

Fields

d_model: usize

The size of the input features.

norm_before_gate: bool

Whether to apply normalization before gating. Default: true

Implementations

impl RmsNormGatedConfig

pub fn new(d_model: usize) -> Self

Create a new instance of the config.

Arguments

Required Arguments

d_model

The size of the input features.

Default Arguments

norm_before_gate

Whether to apply normalization before gating. Default: true

• Defaults to true

impl RmsNormGatedConfig

pub fn with_norm_before_gate(self, norm_before_gate: bool) -> Self

Sets the value for the field norm_before_gate.

Whether to apply normalization before gating. Default: true

• Defaults to true

impl RmsNormGatedConfig

pub fn init<B: Backend>(&self, device: &B::Device) -> RmsNormGated<B>

Initialize a new RmsNormGated module.

Trait Implementations

impl Clone for RmsNormGatedConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for RmsNormGatedConfig

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for RmsNormGatedConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for RmsNormGatedConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for RmsNormGatedConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for RmsNormGatedConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.