AI
How are you operating AI infrastructure in production?
There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem. For those running open-source AI infrastructure in production: - What are you running, for what workload, and would you recommend? - Do you operate yourself versus consume as a managed service? - Have you replaced or abandoned any tools because they were too difficult...
Read the full discussion on HackerNews
This article was aggregated from HackerNews. Click to join the conversation.
View on HackerNews