Skip to main content

Module misc

Module misc 

Source
Expand description

Tensor helpers: segsum, gqa, typed split, and sanity guards.

Modules§

gqa
Group→head expansion of B/C (GQA-style sharing). Grouped-Query Attention (GQA) dimension expansion.
rope
sanity
Optional NaN/Inf guards gated by crate::DENY_NAN / crate::DENY_INF. Optional NaN/Inf guards for debugging numerical issues.
segsum
Stable segment-sum → 1-semiseparable mask (log-space prefix-sum differences). Stable segment-sum, the building block of the SSD 1-semiseparable mask L.
split
Typed-array variant of split_with_sizes for clean destructuring. Typed-array variants of [Tensor::split_with_sizes].