An AI product can become expensive without doing anything obviously wrong. The prompts work. The model answers correctly. Users are getting value. Then usage grows and the inference bill grows much faster than expected. One common reason is architectural: every task is being sent through roughly the same model path. A document extraction step uses the same model as a difficult reasoning task. A simple classification gets the same reasoning effort as a complex investigation. ...