LocalLLaMA
Unsloth Gemma 4 QAT MTP assistant models now available
They're both available as q8_0 models named mtp-gemma-4-*.gguf on the root of the directory and in both q8_0 and larger quants within an MTP folder. https://huggingface.co/unsloth/gemma-4-12B-it-qat-GGUF/tree/main https://huggingface.co/unsloth/gemma-4-26B-A4B-it-qat-GGUF/tree/main https://huggingface.co/unsloth/gemma-4-31B-it-qat-GGUF/tree/main https://huggingface.co/unsloth/gemma-4-E2B-it-qat-GGUF/tree/main https://huggingface.co/unsloth/gemma-4-E2B-it-qat-mobile-GGUF/...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit