Definition
Plain language
Figuring out which step in a long process actually deserves the credit (or blame) for the final outcome.
As stated in the literature
The problem of attributing scalar return to specific actions or decisions in a sequential process, especially difficult when reward is sparse or arrives only at the end.
Also called: credit-assignment
Why it matters: Solving credit assignment well is what lets reinforcement learning work over long horizons and sparse rewards, instead of just memorizing short tactical patterns.
For example, an agent wins a long game and we need to figure out whether the clever opening move or a routine endgame play deserves the reward signal.
Heard on the show
“So "credit assignment," as measured here, is partly agreement with the benchmark's opinion about capital efficiency.”Episode 245 — Fifteen Models Ran Football Clubs for Twenty Years, and Size Didn't Decide It