LocalLLaMA
Döner Bench DeepSeek-V4-Flash IQ2_XS running on a single RTX 3090
https://preview.redd.it/3zcvpbds14hh1.png?width=1911&format=png&auto=webp&s=a79aafb71eeca97638da93d2591902631e897fd5 I tried a test similar to the recent model-quant comparisons, but this time I focused only on: DeepSeek-V4-Flash-0731-IQ2_XS-Experts-Q8_0 model link bullerwins/DeepSeek-V4-Flash-0731-GGUF · Hugging Face Hardware RTX 3090 24 GB 128 GB DDR4 RAM Windows llama.cpp / llama-server Prompt Write a single HTML file with a full-page canvas and no ...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit
Related Trends in LocalLLaMA
Building an open-source control plane for self-hosted vLLM, what would you want in it?
5090: Windows or Linux for Qwen3.8.27b
RTX Pro 4500 vs. A100 (x4) - purchase being made today
Best llm at understaning middle eastern languages? Arabic/Persian etc
Qwen3.8-27B abliterated FP8: refusal 64–99% → 0–6%, and MMLU/GSM8K move less than 1.3 points
llama.cpp Windows Manager