
Tech
DeepSeek V4.1 Flash 1017 benchmark: same task, two builds, 0.24 and 0.66
DeepSeek V4.1 Flash 1017 benchmark: same task, two builds, 0.24 and 0.66
Key takeaways
DeepSeek V4.1 Flash 1017, a day old on OpenRouter, scored 0.6957 on our Gauntlet 7.2 against 0.591 for the September release, and a Forge 2.0 median of 0.4520 against 0.3342. The Forge pairs sit in different comparison groups on our board because our setup changed between the runs, so part of that gap may be ours.
Its two Forge 2.0 builds, same task and same seeds, scored 0.2422 and 0.6618...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to