LocalLLaMA
Running GLM5.2 on budget hardware < $2500.
Too many times I hear people whine about not being ble to run SOTA models or claim it would require $50k, or $100k. https://www.ebay.com/itm/398079051468 Epcy Motherboard & CPU - $460 https://www.ebay.com/itm/206374955959 P40 24gb - $230 get 2 - $460 https://www.ebay.com/itm/318489798853 512gb dd4 $1000 Total = $1920. You need PSU, Storage, Fan for P40. You can source those for $350 easily. But let's go ahead and budget $580 to put the total for everything at $2500. You ca...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit