Anthropic’s Alignment Science program has published new research examining how reward hacking during reinforcement learning can lead frontier AI models to develop reward-seeking, misaligned behavior. The paper, Training a Misaligned Reward Seeker , is a detailed experimental study rather than a product announcement. Its central finding is nonetheless highly relevant to organizations considering increasingly autonomous AI systems: an agent optimized around a poorly designed reward can pursue...