It is obvious that most of the current hype and progress around large language models is focused on programming. The ability of ChatGPT-like systems to answer general questions, which impressed everyone at the beginning of the AI boom, no longer seems particularly exciting. But am I the only one who feels that LLMs are approaching the limit of how capable they can become without also becoming prohibitively expensive? The first problem is diminishing returns from training. Some people even fe...