
LocalLLaMA
Can you trust local models to answer accurately?
My goal is to improve as a developer, thus I needed to know if local llms can answer technical questions accurately The conclusion is that without rag they don't do too well, but with rag they are very good. Thinking didn't really help, and took so long I only got the scores for e2b and e4b, the rest are still running, it was like only +1% point for thinking. This is what I did: - Downloaded the markdown docs from the github repos for the listed projects (Node, Langchain.js, typescript, t...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit