SaaS
How are you managing LLM costs?
Our LLM costs started getting harder to reason about once usage picked up. It's not just the model price either. Long context, retries, agent loops and unnecessary calls add up pretty quickly. We've been experimenting with sending simpler requests to cheaper models instead of having one model handle everything. What are other teams doing here? submitted by /u/entelligenceai17 [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit