这是indexloc提供的服务,不要输入任何密码
Skip to content
View happierpig's full-sized avatar

Highlights

  • Pro

Block or report happierpig

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. efeslab/Atom efeslab/Atom Public

    [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

    Cuda 317 27

  2. efeslab/Nanoflow efeslab/Nanoflow Public

    A throughput-oriented high-performance serving framework for LLMs

    Jupyter Notebook 849 40

  3. mit-han-lab/Quest mit-han-lab/Quest Public

    [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

    Cuda 306 35

  4. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

    FlashInfer: Kernel Library for LLM Serving

    Cuda 3.4k 400