Definition
Plain language
Whether a reply actually shows the system remembers the topic, rather than just being able to recite the fact when asked.
As stated in the literature
Binary judged metric on unprompted conversational replies: does the generated turn demonstrate recall of the cued prior content? Measured on the same model and context as Direct QA to isolate generation-side failure.
Also called: natural integration
Why it matters: It captures the difference between a system that stores your details and a system that actually acts like it knows you.
For example, when a user says 'the weekend didn't go as planned,' a reply that asks how the hiking trip went scores as natural integration, while a generic 'sorry to hear that' does not.
Heard on the show
“Natural Integration is the primary measure: let the model just reply to the user's cue like a person would, and ask a simple binary — does this reply show it remembers the topic at all?”Episode 249 — The Chatbot Knows Your Facts And Still Won't Mention Them