![Context degradation in LLMs: what the papers actually show, and the habits I built for long analysis sessions [R]](https://external-preview.redd.it/kr5Bole0G1Gl3LDRNc18l7ekzmZ-WnWchU9RU_I5p7U.png?width=640&crop=smart&auto=webp&s=56f69a0ed02f8a458f1cd9c8425127b7518d528f)
MachineLearning
Context degradation in LLMs: what the papers actually show, and the habits I built for long analysis sessions [R]
submitted by /u/usernamehere93 [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit
Related Trends in MachineLearning
ICDM 2026 Results Waiting Place [D]
Revisiting the Efficient Channel Attention paper (2019, 12k citations) - the central hypothesis isn't quite right [D]
![Survival of the Fitted: Qwen3.6-27Bβs Jacobian lens reads and steers Qwen3.8-27B with zero refitting [R]](https://preview.redd.it/49qcp6szzkjh1.jpeg?width=640&crop=smart&auto=webp&s=3a9f5c5e0c028e8d98994f2b827853953eb7d529)
Survival of the Fitted: Qwen3.6-27Bβs Jacobian lens reads and steers Qwen3.8-27B with zero refitting [R]
How can we solve long-range recall in linear attention? [D]
![Dataset: Starfield Fauna - 20,000 images in 50 species categories. [P]](https://preview.redd.it/xg0grozpwkjh1.png?width=640&crop=smart&auto=webp&s=4ca48cc3702227f04371e5debdd07f8acd4ca785)
Dataset: Starfield Fauna - 20,000 images in 50 species categories. [P]
![SSOG-Attention: Sum Of Separable Gaussians as a sub-quadratic and scalable alternative to SDPA. [R]](https://preview.redd.it/pepwlp93opjh1.gif?width=320&crop=smart&s=2c59acf93fb52e53083ca4ef7d9885451e6c387b)
SSOG-Attention: Sum Of Separable Gaussians as a sub-quadratic and scalable alternative to SDPA. [R]