LocalLLaMA
Xiaomi just claimed 1,000+ tps on a 1T model using a standard 8-GPU server
Just saw Xiaomi MiMo announce MiMo-V2.5-Pro UltraSpeed , claiming they broke the 1,000 tokens/sec output barrier on a 1 trillion parameter MoE model . According to them, they’re doing it on a single standard 8-GPU node , not custom wafer-scale hardware like Cerebras and not SRAM-heavy hardware like Groq. Crazy if true. submitted by /u/No-Selection2972 [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit