Definition
Plain language
Figuring out which step in a long process actually deserves the credit (or blame) for the final outcome.
As stated in the literature
The problem of attributing scalar return to specific actions or decisions in a sequential process, especially difficult when reward is sparse or arrives only at the end.
Also called: credit-assignment
Why it matters: Solving credit assignment well is what lets reinforcement learning work over long horizons and sparse rewards, instead of just memorizing short tactical patterns.
For example, an agent wins a long game and we need to figure out whether the clever opening move or a routine endgame play deserves the reward signal.
Heard on the show
“That's the famous credit assignment problem.”Episode 008 — Why Long-Horizon AI Agents Get Stuck, and a Milestone-Based Fix That Helps