
Artificial
Anthropic published research on GRAM: a technique to surgically remove dangerous knowledge from AI models at the weight level
Most AI safety work focuses on training models to refuse harmful requests. The problem is that the underlying knowledge is still there, meaning a determined attacker can jailbreak their way to it. Anthropic (with AE Studio) just dropped research on a different approach called GRAM (Gradient-Routed Auxiliary Modules) . How it works: During pretraining, GRAM adds dedicated neuron groups (modules) for each dual-use category (virology, cybersecurity, nuclear physics, etc.). When the model...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit