LocalLLaMA
Strange numbers of pp and tg rx7900xtx on ROCm and Vulcan with Qwen3.6-27b nonMTP and MTP
So I'm getting very unsatisfactory results of running this model locally. Item Current OS Ubuntu 24.04.4 LTS Linux kernel 6.8.0-124-generic GPU RX 7900 XTX / gfx1100 llama.cpp b9630 / 8ed274ef4 ROCm 7.2.4 AMD driver 6.16.13 Vulkan API 1.4.330 , Mesa 26.0.0-devel Raw Backend Benchmarks, No Speculative MTP Backend Model file Prompt test Prompt tok/s Decode test Decode tok/s ROCm ...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit
Related Trends in LocalLLaMA
Building an open-source control plane for self-hosted vLLM, what would you want in it?
5090: Windows or Linux for Qwen3.8.27b
RTX Pro 4500 vs. A100 (x4) - purchase being made today
Best llm at understaning middle eastern languages? Arabic/Persian etc
Qwen3.8-27B abliterated FP8: refusal 64β99% β 0β6%, and MMLU/GSM8K move less than 1.3 points
llama.cpp Windows Manager