Popular repositories Loading

1. seastar seastar Public

   Forked from scylladb/seastar

   High performance server-side application framework

   C++

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. DistServe DistServe Public

   Forked from LLMServe/DistServe

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook

4. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. MNN MNN Public

   Forked from alibaba/MNN

   MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…

   C++