LocalLLaMA
MTP and QTA - what is the relation?
I'm an old guy and I hate when things change so fast surrounded by noise and breaking news! MTP, I know what the acronym means and where it excels. Gemma4 31b dense is my target. Unsloth, Google, GUFF, tensors... too many overlapped informations. I hate when I see no clear path. Please help me... FACT 1 = MTP has been merged in llama.cpp FACT 2 = old GGUFs are not compatible FACT 3 = I need a second file to load with the GGUF Is fact checking ok? Which GGUF is ok? Why Unsloth add...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit