OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
k8s oracle-cloud model-serving model-as-a-service multi-node-kubernetes llm llm-inference sglang sgl-router
-
Updated
Jul 10, 2025 - Go