Tech
Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP
Article URL: https://piszczek.pl/blog/qwen38-27b-256k-50-tps-24gb-gpu
Comments URL: https://news.ycombinator.com/item?id=49331607
Points: 20
# Comments: 9
Read the full discussion on HackerNews
This article was aggregated from HackerNews. Click to join the conversation.
View on HackerNews
Related Trends in Tech
What Fact-Checking My Own Claude Code Guide Taught Me About Verifiable AI
SealedBench: A Protocol for Freezing AI Benchmarks Before the Questions Are Known
A Practitioner's Field Guide to Marketing Engineering
Debugging Missing Results in a Multistage Search Pipeline
348 Blog Posts To Learn About Psychology
He Ran on Fighting Data Centers. Now, He’s Going to Congress