Artificial
Independent LLM "research" & a direct message to Anthropic ; Preliminary observations: non-instructional text prefix may bypass RLHF constraints without adversarial prompting.
Hey everyone! First off, I apologize for the long post! In this Reddit post, I want to share my thoughts and experience from a small, independent study I conducted on Large Language Models (LLMs). I also want to address Anthropic - not to complain or make demands, but in the hope that they notice this and look into the matter. TL;DR Benign, long-form context can induce a persistent drift in model activations. This drift persists across the session and decouples behavior from RLHF alignment, ...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit