LocalLLaMA
Gemma 4 12B is my new main squeeze
The Unsloth Q5_K_XL is officially my main squeeze for local coding. I started out with the Q4_K_XL, but found myself fixing syntax errors a little too often. It wasn't terrible, but I had one file where I had to make 23 edits just for syntax. With the Q4 I was pulling around 61 t/s, and moving to the Q5 dropped me down to 50 t/s, but now most things get one-shotted (not zero-shot, I still had to tell this baby what to build *wink*, looking at you grammar/tech Nazis). The model file sits righ...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit