LocalLLaMA
If you would have told me half a year ago that a local model running in my office would be able to one-shot a Super Mario clone, I would have called you nuts. Qwen3.8-27B is a different beast.
Running the Q8 GGUF on my Framework Desktop is not fast, but it's extremely smart for overnight batches and background jobs. Can't wait to play around with MTP and other quants. Have any of you found ways to improve speed while keeping accuracy? https://mikeveerman.github.io/qwen38-27b-mario submitted by /u/MikeNonect [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit
Related Trends in LocalLLaMA
Building an open-source control plane for self-hosted vLLM, what would you want in it?
5090: Windows or Linux for Qwen3.8.27b
RTX Pro 4500 vs. A100 (x4) - purchase being made today
Best llm at understaning middle eastern languages? Arabic/Persian etc
Qwen3.8-27B abliterated FP8: refusal 64–99% → 0–6%, and MMLU/GSM8K move less than 1.3 points
llama.cpp Windows Manager