Definition
Demographic bias is a systematic difference in an AI system's outputs that correlates with a user or subject's demographic attributes, such as gender or age, rather than with the substance of their request. It's typically surfaced by prompting a model with different persona attributes while holding the task constant and measuring whether outputs like generated website designs or code diverge in ways that reflect stereotypes rather than genuine need.
Episodes covering this
Worth reading next
Papers we haven't done a deep dive on yet, but would recommend on this topic.