Definition
Bilinear interactions are operations where two inputs multiply each other — explicit in gating mechanisms (GLU, SwiGLU) and implicit anywhere a network computes a product of two learned representations. They give networks a clean way to express “use A to decide how much of B to pass through.”