LocalLLaMA
Benchmark & Reality Check on Gemma 4 12B: Great model, but your local settings are probably breaking it (Fix inside)
I completed a Python bug hunting benchmark with Gemma 4 12B. I used the Unsloth Dynamic Q5 GGUF model. The model has good capabilities. Default settings in LM Studio disable the reasoning. Fix the LM Studio reasoning configuration. LM Studio looks for Qwen tokens. Gemma 4 uses different tokens. Change your settings with these steps. • Open your inference settings. • Add this text to the first line of your Jinja template: {%- set enable_thinking = true %} • Set the start token to <|ch...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit