Definition
Plain language
Figuring out which step in a long process actually deserves the credit (or blame) for the final outcome.
As stated in the literature
The problem of attributing scalar return to specific actions or decisions in a sequential process, especially difficult when reward is sparse or arrives only at the end.
Also called: credit-assignment
Why it matters: Solving credit assignment well is what lets reinforcement learning work over long horizons and sparse rewards, instead of just memorizing short tactical patterns.
For example, an agent wins a long game and we need to figure out whether the clever opening move or a routine endgame play deserves the reward signal.
Heard on the show
“But this is where I have to put the brakes on — because the architecture is convincing, and the credit assignment inside it is not nearly as solid as the headline numbers make it feel.”Episode 191 — How One Researcher Beat GPT-5.2 and Gemini 3 by Judging Their Answers, Not Improving Them