Series links Part 1: Everything You Know About Scaling Web Apps Breaks When You Serve an LLM Part 2: The Request Is the Wrong Unit of Scale for LLMs on Kubernetes Part 3: How Do You Fit a Trillion-Parameter Model Into a Kubernetes Cluster? Part 4: Before the Pod Starts: GPU Node Setup for LLMs on Kubernetes Part 5: OpenAI Already Told Us the Kubernetes Scaling Story, Most People Just Did Not Read It Closely So far in this series, we have covered the mental model, t...