Commits

Branch selector

 main

User selector

CharlieFRuan

Datepicker

All time

Commit History

Commits on Feb 28, 2024

• [KVCache] Add max num threads awareness to KVCache kernels (#1822)

  Show description for 7456314
  

  CharlieFRuan

  and

  echuraev

  authored
  7456314

  Copy full SHA for 7456314

• [Fix] Add phi lm head name to is_final_fc, add q4f16_ft to CI (#1849)

  Show description for 31e0571
  CharlieFRuan

  authored
  31e0571

  Copy full SHA for 31e0571

Commits on Feb 17, 2024

• [FT] Fallback to GroupQuantize for lm head in FasterTransformer (#1774)

  Show description for 62af7c1
  CharlieFRuan

  authored
  62af7c1

  Copy full SHA for 62af7c1

Commits on Feb 15, 2024

• [Fix] Add PopN to single sequence for PagedKVCache (#1763)

  Show description for a6d0936
  CharlieFRuan

  authored
  a6d0936

  Copy full SHA for a6d0936

Commits on Feb 13, 2024

• [Make] Add USE FLASHINFER into doc and gen cmake config (#1743)

  Show description for 9f67f37
  CharlieFRuan

  authored
  9f67f37

  Copy full SHA for 9f67f37

Commits on Feb 9, 2024

• [Pass] FuseAddRMSNorm max_num_threads awareness (#1735)

  Show description for 24dc1ef
  CharlieFRuan

  authored
  24dc1ef

  Copy full SHA for 24dc1ef

• [Fix] Skip lm_head quantization for q4f16_ft (#1731)

  Show description for 3feed05
  CharlieFRuan

  authored
  3feed05

  Copy full SHA for 3feed05

Commits on Feb 4, 2024

• [Fix] Paged KVCache forward shape (#1710)

  Show description for 71a8000
  CharlieFRuan

  authored
  71a8000

  Copy full SHA for 71a8000

Commits on Feb 3, 2024

• [Setup] Add tiktoken as dependency as needed in gen_config (#1708)

  CharlieFRuan

  authored
  6a6eddf

  Copy full SHA for 6a6eddf

Commits on Feb 1, 2024

• [Fix] Fix frequency penalty when sampling (#1693)

  CharlieFRuan

  authored
  5536ec5

  Copy full SHA for 5536ec5

Commits on Jan 24, 2024

• [VRAM] Report memory usage in mlc_chat compile (#1655)

  Show description for 2d4221a
  CharlieFRuan

  authored
  2d4221a

  Copy full SHA for 2d4221a

Commits on Jan 21, 2024

• [Attention] Add out dtype for QK matmul (#1638)

  Show description for 18e11f0
  CharlieFRuan

  authored
  18e11f0

  Copy full SHA for 18e11f0

• [Debug] Update instrument debugging script (#1637)

  Show description for 6b53558
  CharlieFRuan

  authored
  6b53558

  Copy full SHA for 6b53558

Commits on Jan 17, 2024

• [SLIM] Allow dynamic shape parameters (#1417)

  Show description for 871b605
  CharlieFRuan

  authored
  871b605

  Copy full SHA for 871b605

Commits on Dec 29, 2023

• [Doc] Update define new models page (#1511)

  CharlieFRuan

  authored
  7398c87

  Copy full SHA for 7398c87

• [Fix][Delivery] Use sys executable in delivery (#1510)

  Show description for 1ec441f
  CharlieFRuan

  authored
  1ec441f

  Copy full SHA for 1ec441f

Commits on Dec 28, 2023

• [Docs] Add phi1_5 and phi2 prebuilt doc, also gpt2 (#1506)

  Show description for fc3a6ac
  CharlieFRuan

  authored
  fc3a6ac

  Copy full SHA for fc3a6ac

Commits on Dec 26, 2023

• [Docs][SLM] Update runtime tutorials (#1491)

  CharlieFRuan

  authored
  7684c07

  Copy full SHA for 7684c07

Commits on Dec 25, 2023

• [Docs][Prebuilt] Add new prebuilt page (#1490)

  CharlieFRuan

  authored
  af4cb7a

  Copy full SHA for af4cb7a

Commits on Dec 24, 2023

• [Docs][Fix] Change webllm model lib link (#1484)

  CharlieFRuan

  authored
  95b17ee

  Copy full SHA for 95b17ee

Commits on Dec 23, 2023

• [Docs][SLM] Change folder struct in doc, update webllm (#1479)

  Show description for f79189b
  CharlieFRuan

  authored
  f79189b

  Copy full SHA for f79189b

Commits on Dec 22, 2023

• [Docs][SLM] Add end-to-end tutorial for webLLM in SLM (#1476)

  CharlieFRuan

  authored
  f5ba93c

  Copy full SHA for f5ba93c

• [Sink] Add sink size to metadata (#1459)

  Show description for 1075d68
  CharlieFRuan

  authored
  1075d68

  Copy full SHA for 1075d68

Commits on Dec 20, 2023

• [Docs][SLM] Split compile models into convert weight and compile model library (#1464)

  Show description for 36c0d61
  

  CharlieFRuan

  and

  Charlie Ruan

  authored
  36c0d61

  Copy full SHA for 36c0d61

Commits on Dec 19, 2023

• [Smallfix] Fix wizard math template (#1463)

  Show description for 00f948d
  CharlieFRuan

  authored
  00f948d

  Copy full SHA for 00f948d

Commits on Dec 17, 2023

• [Delivery] Update delivery script (#1451)

  Show description for aefefc4
  CharlieFRuan

  authored
  aefefc4

  Copy full SHA for aefefc4

Commits on Dec 13, 2023

• [Doc][SLM] Update documentation to rollout SLM (#1421)

  Show description for f66103a
  CharlieFRuan

  authored
  f66103a

  Copy full SHA for f66103a

Commits on Dec 11, 2023

• [SLIM][Fix] Quick fix on sharding config for non supported models (#1414)

  Show description for bc5cb4b
  CharlieFRuan

  authored
  bc5cb4b

  Copy full SHA for bc5cb4b

• [SLIM] Support out dtype for quantizeLinear (#1412)

  Show description for 73c4762
  CharlieFRuan

  authored
  73c4762

  Copy full SHA for 73c4762

Commits on Dec 8, 2023

• [Model Support] Add Neural Hermes conversation template (#1402)

  Show description for 6e820f5
  CharlieFRuan

  authored
  6e820f5

  Copy full SHA for 6e820f5

Commits on Dec 2, 2023

• [SLIM] Add info to metadata in SLIM and make compatible with llm_chat.cc (#1366)

  Show description for ee34b65
  CharlieFRuan

  authored
  ee34b65

  Copy full SHA for ee34b65

Commits on Nov 30, 2023

• [Tokenizer] Prioritize huggingface tokenizer.json, generate one if not included (#1352)

  Show description for 5315d18
  CharlieFRuan

  authored
  5315d18

  Copy full SHA for 5315d18

• [OpenHermes] Add conversation template for OpenHermes Mistral (#1354)

  Show description for 02a41e1
  

  CharlieFRuan

  and

  davidpissarra

  authored
  02a41e1

  Copy full SHA for 02a41e1

Commits on Nov 22, 2023

• [SLIM] Skip None param when loading rather than failing (#1308)

  CharlieFRuan

  authored
  95f9abe

  Copy full SHA for 95f9abe

Commits on Nov 8, 2023

• [Bugfix] Remove dependency on openai_api in chat module (#1222)

  Show description for beca2ab
  CharlieFRuan

  authored
  beca2ab

  Copy full SHA for beca2ab

Pagination

Previous

Next