Concept · 1 episode(s)

Saddle Points

← all concepts

Definition

Saddle points are locations in a dynamical or optimization landscape where the local gradient vanishes but the point is stable along some directions and unstable along others, unlike a true minimum or maximum. In hidden-state dynamics, trajectories can linger near a saddle for a long time before finally being pushed away along an unstable direction, which shows up as slow, indecisive computation right before the system commits to an answer.

Episodes covering this