The recency bias problem is real and it's one of the more frustrating things about working with these models day to day. You spend the first part of a conversation establishing your situation carefully, and then ten exchanges later the model is giving you advice that directly contradicts something you told it at the start. The context window growth is genuinely useful, but you're right that raw length and actual comprehension are different things. A model that can technically "see" 2...