Artificial
A 4b model is now beating 30b ones at web research and the reason is not size
A small thing from this month's model releases stuck with me more than the usual flagship leaderboard race, because it points at where the interesting progress actually is. A 4 billion parameter open model reportedly beat every open source model in the 30 billion class on a couple of hard web research benchmarks. Not matched, beat. A model you could run on a laptop outperforming ones roughly eight times its size on the specific task of going out, reading sources, and answering a multi step quest...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit