Definition
Counterfactual replay is an evaluation technique that rewinds a recorded execution to a precise point, changes a single decision or edit, and replays only the downstream suffix while holding everything before the change fixed. By comparing the replayed outcome against the original run, it isolates the causal effect of that one edit instead of confounding it with all the other things that differ between two independent runs.