Tech
[问与答] 如果 2 - 3 万人民币设备,部署本地 dsv4flash , token 基本够用,你是会选择本地部署还是接云 api?
The current q2 results use ds4-bench with the standard Promessi sposi
input, 2048-token context steps, and 128 greedy generation tokens at every
frontier. Each prefill number is for the next 2048-token chunk. The complete
sweeps are in m5_max.csv and
gb10.csv .
Machine
Backend
Context
Prefill
Generation
MacBook Pro M5 Max, 128 GB
Metal
2048
790.18 t/s
39.35 t/s
MacBook Pro M5 Max, 128 GB
Metal
16384
572.53 t/s
36.14 t/s
MacBook Pro M5 ...
Read the full discussion on V2EX
This article was aggregated from V2EX. Click to join the conversation.
View on V2EX