Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 5, 2024

• [Attn] Fix attention kernel for head dim not divisble by 32 (#1889)

  Show description for 8a8c529
  MasterJH5574

  authored
  8a8c529

  Copy full SHA for 8a8c529

• [Serving] Add Phi-2 conv template to mlc serve (#1890)

  Show description for e7b6cbc
  Kartik14

  authored
  e7b6cbc

  Copy full SHA for e7b6cbc

• [KVCache] Migrate bigcode arch to PagedKVCache (#1891)

  Show description for aeb55f1
  davidpissarra

  authored
  aeb55f1

  Copy full SHA for aeb55f1

Commits on Mar 4, 2024

• [Serving] Estimate KV cache memory usage with metadata (#1888)

  Show description for 25877f9
  MasterJH5574

  authored
  25877f9

  Copy full SHA for 25877f9

• [KVCache] Qwen 1.0 Model PagedKV Support (#1887)

  Show description for ef2db85
  DiegoCao

  authored
  ef2db85

  Copy full SHA for ef2db85

• [SLM] Update StableLM model and migrate it to paged KV Cache (#1882)

  tlopex

  authored
  ffef890

  Copy full SHA for ffef890

• [Serving] Make RequestState as a standalone object class (#1878)

  Show description for 65ec85d
  MasterJH5574

  authored
  65ec85d

  Copy full SHA for 65ec85d

• [Serving][Grammar] Support termination state in GrammarStateMatcher (#1884)

  Ubospica

  authored
  d2cfb1e

  Copy full SHA for d2cfb1e

Commits on Mar 3, 2024

• Fix MLC-LLM website link weight convert not accessible (#1877)

  Show description for 837869a
  DiegoCao

  authored
  837869a

  Copy full SHA for 837869a

• [Docs] Update Android APK download link (#1876)

  Show description for 07af0f9
  MasterJH5574

  authored
  07af0f9

  Copy full SHA for 07af0f9

• [Fix] Add the missing BundleModelParams pass (#1875)

  Show description for c0606ec
  MasterJH5574

  authored
  c0606ec

  Copy full SHA for c0606ec

• [Fix] Fix the use of "call_inplace_packed" and "call_pure_packed" (#1874)

  Show description for e4341b3
  MasterJH5574

  authored
  e4341b3

  Copy full SHA for e4341b3

• [SLM] Migrate Phi-2 to paged KV Cache #1871 (#1872)

  Show description for 731616e
  

  Kartik14

  and

  shreygupta2809

  authored
  731616e

  Copy full SHA for 731616e

• [Utils] Allow ReorderTransformFunc to be used without param manager (#1857)

  Show description for 91008ae
  Lunderberg

  authored
  91008ae

  Copy full SHA for 91008ae

Commits on Mar 2, 2024

• [Attn] Use float32 accumulation in attention kernel (#1870)

  Show description for e8b5b0b
  MasterJH5574

  authored
  e8b5b0b

  Copy full SHA for e8b5b0b

• [CI] Add retry to scm checkout (#1869)

  Show description for 63c338b
  tqchen

  authored
  63c338b

  Copy full SHA for 63c338b

• [Serving] Support "n" for parallel generation (#1868)

  Show description for 7806dee
  MasterJH5574

  authored
  7806dee

  Copy full SHA for 7806dee

• [Serving][Grammar] Integrate JSON grammar into the generation pipeline (#1867)

  Show description for 5f2a06e
  Ubospica

  authored
  5f2a06e

  Copy full SHA for 5f2a06e

Commits on Mar 1, 2024

• [Build] Update transform_params_for_each_rank to IRModule pass (#1856)

  Show description for eb66452
  Lunderberg

  authored
  eb66452

  Copy full SHA for eb66452

• [Utils][Transform] Added SetEntryFuncs transform (#1855)

  Show description for 5bbe204
  Lunderberg

  authored
  5bbe204

  Copy full SHA for 5bbe204

Commits on Feb 29, 2024

• [Serving] Register the ChatML conversation template (#1862)

  Show description for eb465ec
  tlopex

  authored
  eb465ec

  Copy full SHA for eb465ec

• [SLM] RWKV5 World Support (#1787)

  Show description for 1f70d71
  

  Siyuan Feng

  and

  BBuf

  authored
  1f70d71

  Copy full SHA for 1f70d71

• [Python] Lazy import of transformers for tiktoken conversion (#1860)

  Show description for ac57c03
  MasterJH5574

  authored
  ac57c03

  Copy full SHA for ac57c03

Commits on Feb 28, 2024

• [KVCache] Migrate Baichuan model to PagedKVCache (#1854)

  tlopex

  authored
  52d002f

  Copy full SHA for 52d002f

• [KVCache] Add max num threads awareness to KVCache kernels (#1822)

  Show description for 7456314
  

  CharlieFRuan

  and

  echuraev

  authored
  7456314

  Copy full SHA for 7456314

• [Bugfix] Handle model names with multiple path components (#1851)

  Show description for 1497744
  Lunderberg

  authored
  1497744

  Copy full SHA for 1497744

• [SLM] Add support for InternLM architecture (#1835)

  Show description for 6ce1759
  tlopex

  authored
  6ce1759

  Copy full SHA for 6ce1759

• [Build] Replace mod_transform_before_build with IRModule pass (#1852)

  Show description for 89f3e41
  Lunderberg

  authored
  89f3e41

  Copy full SHA for 89f3e41

• [Fix] Add phi lm head name to is_final_fc, add q4f16_ft to CI (#1849)

  Show description for 31e0571
  CharlieFRuan

  authored
  31e0571

  Copy full SHA for 31e0571

Commits on Feb 27, 2024

• Auto updated submodule references

  

  Git bot

  committed
  c4d1b69

  Copy full SHA for c4d1b69

• [Fix] Fix `u_char` for Windows build (#1848)

  Show description for 607dc5a
  MasterJH5574

  authored
  607dc5a

  Copy full SHA for 607dc5a

Commits on Feb 26, 2024

• [Serving] Support Mixtral in MLC Serve (#1840)

  Show description for 1cbd67b
  MasterJH5574

  authored
  1cbd67b

  Copy full SHA for 1cbd67b

Commits on Feb 24, 2024

• [Serving] LogProbs support (#1832)

  Show description for ce42880
  MasterJH5574

  authored
  ce42880

  Copy full SHA for ce42880

• [Serving][Grammar] BNF grammar simplifier and matcher (#1801)

  Ubospica

  authored
  bcb9b6a

  Copy full SHA for bcb9b6a

Commits on Feb 23, 2024

• [Serving][Refactor] Logit processor and logit bias support (#1828)

  Show description for e30a457
  MasterJH5574

  authored
  e30a457

  Copy full SHA for e30a457

Pagination

Previous

Next