Tech
A /models list with no modality field, and five entries that can't chat
If you build a model picker by reading GET /models and dropping every id into a chat completion, you will ship a picker where a third of the options are broken.
I tried it against Groq. The endpoint advertises 14 models. Sending each one the same minimal chat request:
answered a minimal request : 9/14
failed outright : 5/14
The five failures are not outages. They are models that were never chat models:
whisper-large-v3 400
whisper-large-v3-t...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to