Definition
A constant-memory replacement for attention that does retrieval by tracking which information patterns persist over time.
Spectral Koopman Attention, a sequence-mixing layer that maintains streaming Gram, cross-covariance, and lag-one covariance sufficient statistics and uses a Koopman-derived spectral filter to suppress transient modes.
Also called: Spectral Koopman Attention