Emergent Behavior

Episodes covering this

Worth reading next

Papers we haven't done a deep dive on yet, but would recommend on this topic.

• Risks from Learned Optimization in Advanced Machine Learning Systems
• Neural Architecture Search with Reinforcement Learning
• Are Emergent Abilities of Large Language Models a Mirage?
• Inverse Scaling: When Bigger Isn't Better
• FunSearch: Making New Discoveries in Mathematical Sciences Using Large Language Models
• Automated Design of Agentic Systems
• Model Collapse Demystified: The Case Against Synthetic Training Data
• Let's Think Dot by Dot: Hidden Computation in Transformer Language Models