Search results

关于导出vllm的问题

Status: Open.

#387 In ModelTC/llmc;

· djm012 opened on Jun 4, 2025

get_float_qparams 忽略量化粒度？

Status: Open.

#384 In ModelTC/llmc;

· guanchenl opened on May 25, 2025

SpinQuant merge

Status: Open.

#368 In ModelTC/llmc;

· Marouan-git opened on Apr 23, 2025

[W416 15:12:21.131066630 socket.cpp:933] [c10d] The server socket on [::ffff:36.xxx.xxx.13]:38405 has timed out, will retry.

Status: Open.

#365 In ModelTC/llmc;

· dzy1128 opened on Apr 16, 2025

自定义校准数据集文档与代码对不上

Status: Open.

#364 In ModelTC/llmc;

· xinyubai1209 opened on Apr 14, 2025

Static Activation Quantization and Mixed-Precision Quantization Incompatibility

Status: Open.

#363 In ModelTC/llmc;

· aptsunny opened on Apr 11, 2025

Does llmc support Qwen2.5-VL quantization?

Status: Open.

#356 In ModelTC/llmc;

· lookinmyeyestellmewhy opened on Apr 9, 2025

Maybe a bug in "allow_padding"

Status: Open.

#354 In ModelTC/llmc;

· pengyao96 opened on Apr 8, 2025

How to get the calibration dataset for Multimodal-LLMs

Status: Open.

#353 In ModelTC/llmc;

· shixu312349410 opened on Apr 5, 2025

Two Issues / Bugs with NaiveQuantKVCache Implementation

Status: Open.

#350 In ModelTC/llmc;

· sasha-hailo opened on Mar 31, 2025

Saving/Loading Fake Quant weights

Status: Open.

#349 In ModelTC/llmc;

· allzero-kwon opened on Mar 31, 2025

OOM Error when Running AWQ + OmniQuant Combination (Step 2: OmniQuant) Despite Using Multiple GPUs

Status: Open.

#347 In ModelTC/llmc;

· Barryshen1 opened on Mar 28, 2025