LocalLLaMA
It felt good to return my Asus Spark
It's an incredible little package but too expensive of a price to pay for the performance and I simply didn't want to be part of the great "Superchip lie" - it could be super, but its super ruined by its limited memory bandwidth even though it *could* be 2x throughput - it isn't. (The c2c is 600gb/sec but the memory isn't) I wanted better experience for larger models and these fail miserably at 27b and do ok at MoE's which actually shine on much cheaper hardware, and I don't have the...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit