Commits

Branch selector

 main

User selector

cyx-6

Datepicker

All time

Commit History

Commits on Sep 27, 2024

• [Fix] Deepcopy reqeust when sampling dataset (#2945)

  Show description for 268d52a
  cyx-6

  authored
  268d52a

  Copy full SHA for 268d52a

Commits on Sep 23, 2024

• [Fix] Fix json dataset (#2934)

  Show description for 980589f
  cyx-6

  authored
  980589f

  Copy full SHA for 980589f

Commits on Sep 13, 2024

• [Bench] Support multi round conversation (#2898)

  Show description for 9918c4b
  cyx-6

  authored
  9918c4b

  Copy full SHA for 9918c4b

Commits on Aug 28, 2024

• [Fix] Update seq len info after prefix cache operation (#2860)

  Show description for ab096ce
  cyx-6

  authored
  ab096ce

  Copy full SHA for ab096ce

Commits on Aug 27, 2024

• [Fix] Improve prefill policy for prefix cache reuse (#2859)

  Show description for 66730dc
  cyx-6

  authored
  66730dc

  Copy full SHA for 66730dc

Commits on Aug 13, 2024

• [Fix] Fix prefix cache (#2798)

  Show description for c7951ab
  cyx-6

  authored
  c7951ab

  Copy full SHA for c7951ab

Commits on Aug 9, 2024

• [Bench] Rename json schema dataset (#2781)

  Show description for 2b770e5
  cyx-6

  authored
  2b770e5

  Copy full SHA for 2b770e5

Commits on Aug 8, 2024

• [Bench] Json schema dataset (#2775)

  Show description for 36055f0
  cyx-6

  authored
  36055f0

  Copy full SHA for 36055f0

Commits on Aug 6, 2024

• [Fix] Commit prefix cache update (#2761)

  Show description for 72f2d50
  

  cyx-6

  and

  MasterJH5574

  authored
  72f2d50

  Copy full SHA for 72f2d50

Commits on Aug 2, 2024

• [Bench] Enable cuda profile (#2725)

  Show description for 08206d1
  cyx-6

  authored
  08206d1

  Copy full SHA for 08206d1

Commits on Aug 1, 2024

• [Bench] LLMPerf dataset (#2713)

  Show description for b0f2731
  cyx-6

  authored
  b0f2731

  Copy full SHA for b0f2731

Commits on Jul 30, 2024

• [Fix] Fix hybrid prefill index error (#2707)

  Show description for 551f3fe
  

  cyx-6

  and

  MasterJH5574

  authored
  551f3fe

  Copy full SHA for 551f3fe

Commits on Jul 29, 2024

• [Fix] Fix hybrid prefill disabled (#2705)

  Show description for da06a06
  cyx-6

  authored
  da06a06

  Copy full SHA for da06a06

Commits on Jul 28, 2024

• [Serve] Expose prefill mode option (#2701)

  Show description for 6156dc3
  cyx-6

  authored
  6156dc3

  Copy full SHA for 6156dc3

Commits on Jul 16, 2024

• [Fix] Fix prefix cache reuse with eagle mode (#2664)

  Show description for 8290a97
  cyx-6

  authored
  8290a97

  Copy full SHA for 8290a97

Commits on Jul 2, 2024

• [Fix] Prefix cache only enables sliding window on leaf sequence (#2615)

  Show description for 0fb5609
  cyx-6

  authored
  0fb5609

  Copy full SHA for 0fb5609

Commits on Jun 25, 2024

• [Serving] Hybrid prefill (#2604)

  Show description for 6a48a02
  cyx-6

  authored
  6a48a02

  Copy full SHA for 6a48a02

Commits on Jun 12, 2024

• [Bench] Json mode bench (#2552)

  Show description for 07c92b0
  cyx-6

  authored
  07c92b0

  Copy full SHA for 07c92b0

Commits on May 24, 2024

• [Fix] Fix no prefix cache (#2397)

  Show description for 641b64b
  cyx-6

  authored
  641b64b

  Copy full SHA for 641b64b

Commits on May 23, 2024

• [Fix] Update missing change in engine ffi func name (#2396)

  Show description for eb546ee
  cyx-6

  authored
  eb546ee

  Copy full SHA for eb546ee

Commits on May 22, 2024

• [Fix] Update prefix cache config (#2382)

  Show description for 600a3e5
  cyx-6

  authored
  600a3e5

  Copy full SHA for 600a3e5

• [Fix] Fix prefix cache reset and forking logic (#2374)

  Show description for 20c198f
  cyx-6

  authored
  20c198f

  Copy full SHA for 20c198f

Commits on May 21, 2024

• [Serving] Prefix Cache (#2295)

  Show description for 5444fd5
  cyx-6

  authored
  5444fd5

  Copy full SHA for 5444fd5

Commits on Apr 23, 2024

• [Serving] Paged Radix Tree for Prefix Caching (#2183)

  Show description for 12647d5
  cyx-6

  authored
  12647d5

  Copy full SHA for 12647d5

Commits on Mar 19, 2024

• [Fix] Fix `MLC_MULTI_ARCH` with arch `sm_90a` (#1984)

  Show description for 5485782
  cyx-6

  authored
  5485782

  Copy full SHA for 5485782

Commits on Feb 2, 2024

• Support paged kv cache for single batch chat module (#1651)

  Show description for 370dcbf
  

  cyx-6

  and

  MasterJH5574

  authored
  370dcbf

  Copy full SHA for 370dcbf

Commits on Jan 7, 2024

• [SLM] Fuse FasterTransformer dequantize matmul epilogue (#1544)

  Show description for 78f283c
  cyx-6

  authored
  78f283c

  Copy full SHA for 78f283c

Commits on Jan 2, 2024

• [SLM] Enable FasterTransformer quantization (#1480)

  Show description for 791b09a
  cyx-6

  authored
  791b09a

  Copy full SHA for 791b09a

Commits on Dec 27, 2023

• [SLM] Store fp32 weight as fp16 on disk (#1496)

  Show description for b1dd17a
  cyx-6

  authored
  b1dd17a

  Copy full SHA for b1dd17a

Commits on Dec 16, 2023

• Integrate FlashInfer into llama model (#1415)

  Show description for d406c17
  

  cyx-6

  and

  junrushao

  authored
  d406c17

  Copy full SHA for d406c17

Commits on Nov 16, 2023

• Fix group quantization shape infer (#1273)

  Show description for fde2e85
  cyx-6

  authored
  fde2e85

  Copy full SHA for fde2e85

Commits on Nov 10, 2023

• [SLM] Support `q0f16` and `q0f32` (#1228)

  Show description for d08b009
  cyx-6

  authored
  d08b009

  Copy full SHA for d08b009

Commits on Nov 8, 2023

• [SLM] Support `q3f16_1` and `q4f32_1` (#1215)

  Show description for 1015aae
  cyx-6

  authored
  1015aae

  Copy full SHA for 1015aae

Commits on Nov 1, 2023

• [SLM] Fix group quantization (#1172)

  Show description for 1757777
  cyx-6

  authored
  1757777

  Copy full SHA for 1757777

Commits on Oct 31, 2023

• Enable group quant transform with nn.Module (#1154)

  Show description for b5bfa5b
  

  cyx-6

  and

  junrushao

  authored
  b5bfa5b

  Copy full SHA for b5bfa5b

Pagination

Previous

Next