LocalLLaMA
Worse quality with MTP - Qwen 3.6, Gemma 4
Hi. I am self-hosting Qwen 3.6 27B Q8_K_XL with Llama.cpp on 4x5070ti. (All 4 cards are on single x16 slot bifurcated to 4x4 with risers). I've been testing it on several work repos with Opencode CLI and in like 8/10 situations the output of non-MTP model is far superior to the MTP ones. The prompt is simple `Do a code review of this branch.`. The non MTP produces more findings, with more detailed descriptions, with fix suggestion snippets, everything is better. Usually takes fewer token...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit