Pinned Loading

1. bentoml/BentoML bentoml/BentoML Public

   The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

   Python 8.1k 875

2. bentoml/OpenLLM bentoml/OpenLLM Public

   Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

   Python 11.8k 780

3. bentoml/comfy-pack bentoml/comfy-pack Public

   A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.

   Python 183 26