Glossary · Term

residual connection

← all terms

Definition

A shortcut wire in a neural network that adds the input of a layer back to its output.

An additive skip connection that adds a block's input to its output, originally introduced in ResNet, foundational in transformer architectures.

Also called: skip connection