Definition
Strategy diversity is the spread of approaches a learning system explores or maintains, rather than collapsing to one. Diversity helps exploration in RL, helps robustness in deployment, and is one of the first casualties of aggressive optimization against a narrow reward.