Commits

Branch selector

 main

User selector

jinhongyii

Datepicker

All time

Commit History

Commits on Jan 14, 2025

• [Python] Add Microserving code example (#3089)

  Show description for 8845ae8
  jinhongyii

  authored
  8845ae8

  Copy full SHA for 8845ae8

Commits on Dec 16, 2024

• [Serve] MicroServing Implementation (#3064)

  Show description for 5c9ebcb
  

  4 peopleauthored
  5c9ebcb

  Copy full SHA for 5c9ebcb

Commits on Dec 15, 2024

• Add prefix-cache dataset in mlc bench (#3065)

  Show description for e5f3880
  jinhongyii

  authored
  e5f3880

  Copy full SHA for e5f3880

Commits on Mar 8, 2024

• [Pass] Low batch GEMM using GEMV-like schedule (#1769)

  Show description for 3f05a1f
  jinhongyii

  authored
  3f05a1f

  Copy full SHA for 3f05a1f

Commits on Feb 7, 2024

• [Serve] Single-sequence specialization for MLC serve (#1724)

  Show description for 46b606c
  jinhongyii

  authored
  46b606c

  Copy full SHA for 46b606c

Commits on Feb 2, 2024

• Improve TIR batch_decode attn kernel (#1698)

  Show description for de666d2
  jinhongyii

  authored
  de666d2

  Copy full SHA for de666d2

Commits on Jan 25, 2024

• [SLM] Fuse Add and RMSNorm (#1627)

  Show description for b01b06c
  

  jinhongyii

  and

  junrushao

  authored
  b01b06c

  Copy full SHA for b01b06c

Commits on Jan 20, 2024

• Topk func has static thread group size (#1635)

  Show description for 2939ad6
  jinhongyii

  authored
  2939ad6

  Copy full SHA for 2939ad6

Commits on Jan 16, 2024

• [Serving] Remove dynamic allocation in FunctionTable (#1611)

  Show description for 4d9ef0e
  jinhongyii

  authored
  4d9ef0e

  Copy full SHA for 4d9ef0e

Commits on Jan 12, 2024

• [Serving] Disco Support (#1287)

  Show description for 7857c59
  

  jinhongyii

  authored and

  tqchen

  committed
  7857c59

  Copy full SHA for 7857c59

Commits on Jan 8, 2024

• Mixtral support (#1529)

  Show description for e32c6c9
  

  jinhongyii

  and

  junrushao

  authored
  e32c6c9

  Copy full SHA for e32c6c9

Commits on Jan 2, 2024

• Refactor tensor parallel (#1509)

  Show description for cc94447
  jinhongyii

  authored
  cc94447

  Copy full SHA for cc94447

Commits on Dec 29, 2023

• [SLM] cublas dispatch (#1380)

  Show description for cb7bd10
  jinhongyii

  authored
  cb7bd10

  Copy full SHA for cb7bd10

Commits on Dec 3, 2023

• [SLM] Support fuse split rotary in SLM flow (#1365)

  Show description for 65506f3
  jinhongyii

  authored
  65506f3

  Copy full SHA for 65506f3

Commits on Nov 30, 2023

• Fix gen_mlc_chat_config for mistral (#1353)

  Show description for 2ab39c9
  

  jinhongyii

  and

  CharlieFRuan

  authored
  2ab39c9

  Copy full SHA for 2ab39c9

Commits on Oct 5, 2023

• [Bugfix] Fix Disco break (#1022)

  Show description for b6d7958
  jinhongyii

  authored
  b6d7958

  Copy full SHA for b6d7958

Commits on Oct 4, 2023

• [Fix] Fix the max window length fetching in local mode (#1016)

  Show description for 1384f23
  jinhongyii

  authored
  1384f23

  Copy full SHA for 1384f23

Commits on Oct 2, 2023

• [BugFix][Python] Fix custom chat config parsing (#1002)

  Show description for 195337b
  jinhongyii

  authored
  195337b

  Copy full SHA for 195337b

Commits on Sep 26, 2023

• Reorder allreduce and residual add to enable better fusion (#941)

  jinhongyii

  authored
  5902cc6

  Copy full SHA for 5902cc6

Commits on Sep 22, 2023

• Fix prefill stats (#963)

  Show description for 95ba50b
  jinhongyii

  authored
  95ba50b

  Copy full SHA for 95ba50b

Commits on Sep 19, 2023

• [Optim] Fuse split rotary for Group Query Attention (#940)

  jinhongyii

  authored
  8c87e09

  Copy full SHA for 8c87e09

• [ChatModule] Pre-allocate fixed-sized NDArray to reduce overhead (#942)

  jinhongyii

  authored
  7bfcd1a

  Copy full SHA for 7bfcd1a

Commits on Jun 29, 2023

• Add document on how to define new model architecture (#483)

  jinhongyii

  authored
  ad8efb0

  Copy full SHA for ad8efb0

Commits on May 22, 2023

• Accelerating quantization computation by weight compression (#45)

  Show description for 68be032
  jinhongyii

  authored
  68be032

  Copy full SHA for 68be032

• Update tir dispatch for vicuna fp32 (#208)

  Show description for 952367d
  jinhongyii

  authored
  952367d

  Copy full SHA for 952367d

Commits on May 14, 2023

• add system lib for webgpu (#145)

  jinhongyii

  authored
  9e29ff0

  Copy full SHA for 9e29ff0

Commits on May 9, 2023

• update pointer (#107)

  jinhongyii

  authored
  cfaa5ee

  Copy full SHA for cfaa5ee