Latest in Containers & Kubernetes

252 words

Serving Moonshot AI's Kimi K3.1 Pro with llm-d across TPUs and GPUs

These recipes run here on Google Cloud (GKE), but llm-d's routing, scheduling, and disaggregation layer is accelerator- and cloud-independent. The same configuration pattern applies on other accelerators and clouds; only the device-allocation and KV-transfer connectors change. To sustain high concurrency…

docs.mistral.ai
256 words

Local sandboxes

Three sandboxes run the agent's commands on the machine that runs the agent, with no cloud_user role: LocalDockerSandbox in a Docker container, BashkitSandbox in an in-process Bash interpreter, and DangerousLocalSandbox directly on the host. Use them to develop and test; deploy…

Containers & Kubernetes

Docker, images, Helm, autoscaling, and cost controls.

  • 8 Tracked terms
  • Last 30 days Feed window

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.