这是indexloc提供的服务,不要输入任何密码
Skip to content

Tags: hholtmann/vllm

Tags

v0.7.1

Toggle v0.7.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Disable chunked prefill and/or prefix caching when MLA is enabled (vl…

…lm-project#12642)

From @mgoin in vllm-project#12638

I cannot push to that branch, therefore a new PR to unblock release.

---------

Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

v0.7.0

Toggle v0.7.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Bugfix] Fix Granite 3.0 MoE model loading (vllm-project#12446)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

v0.6.6

Toggle v0.6.6's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Deepseek v3 (vllm-project#11502)

Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: robertgshaw2-neuralmagic <rshaw@neuralmagic.com>

v0.6.6.post1

Toggle v0.6.6.post1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[BugFix] Fix quantization for all other methods (vllm-project#11547)

v0.6.5

Toggle v0.6.5's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Bugfix] Fix request cancellation without polling (vllm-project#11190)

v0.6.4

Toggle v0.6.4's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Build] skip renaming files for release wheels pipeline (vllm-project…

…#9671)

Signed-off-by: simon-mo <simon.mo@hey.com>

v0.6.4.post1

Toggle v0.6.4.post1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Misc] bump mistral common version (vllm-project#10367)

Signed-off-by: simon-mo <simon.mo@hey.com>

v0.6.3.post1

Toggle v0.6.3.post1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[CI/Build] remove .github from .dockerignore, add dirty repo check (v…

…llm-project#9375)

v0.6.3

Toggle v0.6.3's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Docs] Remove PDF build from Readtehdocs (vllm-project#9347)

v0.6.2

Toggle v0.6.2's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Misc] Support quantization of MllamaForCausalLM (vllm-project#8822)