Reddit
Independent LLM "research" & a direct message to Anthropic ; Preliminary observations: non-instructional text prefix may bypass RLHF constraints without adversarial prompting.
Hey everyone! First off, I apologize for the long post! In this Reddit post, I want to share my thoughts and experience from a small, independent study I conducted on Large Language Models (LLMs). I also want to address Anthropic - not to complain or make demands, but in the hope that they notice this and look into the matter. TL;DR Benign, long-form context can induce a persistent drift in model activations. This drift persists across the session and decouples behavior from RLHF alignment, ...



