LocalLLaMA
Suggestion - this sub should have post flairs that mention the amount of vram/unified ram
The amount of fast ram is the single most important factor for llm use. There are lots of people that run setups with massive amounts of ram. Reading a post about how model X performs, it'd really help to know the kind of setup being used, otherwise its not relevant for a lot of people. It will also allow easy filtering of posts relevant to the hardware you have, right now thats very hard to do. submitted by /u/ECrispy [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit