
Artificial
Attributing LLM inference costs across teams in production
Seeing this come up more as LLM usage moves from 1 or 2 product features into internal tools, agents, support workflows, evals etc Provider dashboards show token usage but attribution gets messy when finance wants to know which team or project caused the spend. Infra most of the time can see the raw usage but finance only sees the invoice and the middle layer feels kinda underdeveloped. I think the answer is some mix of app level tagging and internal reporting but want to know how many tea...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit