Definition
Instrumental goal pursuit is when an agent pursues subgoals that are useful for almost any final goal — acquiring resources, preserving itself, gaining influence — whether or not those subgoals were explicitly part of the task. It’s a long-standing alignment worry because instrumental goals tend to generalize across objectives.
Episodes covering this
Worth reading next
Papers we haven't done a deep dive on yet, but would recommend on this topic.