Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Makefile 1.9k 189

2. llm-d/llm-d-kv-cache-manager llm-d/llm-d-kv-cache-manager Public

   Distributed KV cache coordinator

   Go 76 48

3. llm-d/llm-d-inference-scheduler llm-d/llm-d-inference-scheduler Public

   Inference scheduler for llm-d

   Go 98 81

4. kubestellar/kubestellar kubestellar/kubestellar Public

   KubeStellar - a flexible solution for multi-cluster configuration management for edge, multi-cloud, and hybrid cloud

   Go 531 197