Commit Graph
20 Commits
Author SHA1 Message Date
Xingkai Yu 44a51afc8a Merge pull request #207 from DestineG/fix-prefill-index-out-of-range
fix(scheduler): recalculate num_tokens after allocate to prevent IndexError at model_runner:155
2026-04-25 18:12:43 +08:00
Xingkai Yu 5df84934f3 Merge pull request #213 from Anai-Guo/fix/prepare-prefill-seqlen-k-chunked-prefill
fix(model_runner): correct seqlen_k to chunk boundary in prepare_prefill
2026-04-25 17:43:24 +08:00
Xingkai Yu 812eb1c1e4 Merge pull request #204 from GeeeekExplorer/chunked-prefill
Chunked Prefill
2026-04-14 03:06:27 +08:00
Xingkai Yu 02a95fdc66 Merge pull request #203 from Anai-Guo/fix-row-parallel-bias-crash
fix RowParallelLinear weight_loader crash when bias is enabled
2026-04-13 21:26:07 +08:00
Xingkai Yu a4f94cb38b Merge pull request #200 from KinglittleQ/fix-scheduler-typing
Fix scheduler.postprocess return type
2026-04-13 21:13:37 +08:00
Xingkai Yu 00eea73176 Merge pull request #172 from IceCreamMilkyTea/main
enable 'slots=True' for dataclasses
2026-04-13 20:45:50 +08:00
Xingkai Yu 52d2215911 Merge pull request #148 from guodongxiaren/main
remove hard code for block_size
2026-04-13 20:36:32 +08:00
Xingkai Yu 7f967ed6ff Merge pull request #145 from LiaoMengqi/fix/tp
bug for tensor parallelism # issue 144
2026-04-13 20:34:49 +08:00
Xingkai Yu 6a6d217de7 Merge pull request #67 from PeterDing/fix/decoding-positions
fix(model_runner): correct position indexing to be 0-based
2025-08-31 18:05:45 +08:00
Xingkai Yu 2de882a395 Merge pull request #60 from GeeeekExplorer/warmup 2025-06-27 22:52:11 +08:00
Xingkai Yu 6802cb2f42 Merge pull request #54 from TonyLianLong/patch-1 2025-06-27 22:44:38 +08:00
Xingkai Yu 37eb91f890 Merge pull request #39 from xiaohajiayou/main 2025-06-24 22:51:58 +08:00
Xingkai Yu 8162578b60 star history 2025-06-22 15:13:04 +08:00
Xingkai Yu ad4e95fbdc update .gitignore 2025-06-21 07:28:40 +08:00
Xingkai Yu fa0078174e Merge pull request #24 from jinghuan-Chen/fix/Release-CUDA-Graphs-resource-before-exit 2025-06-18 17:15:28 +08:00
Xingkai Yu 4fc764f175 Merge pull request #22 from cheunglei/use_spawn 2025-06-17 23:53:59 +08:00
Xingkai Yu 326b121fad Merge pull request #10 from MARD1NO/refine_return_hint_in_schedule 2025-06-15 10:39:51 +08:00
Xingkai Yu ba96387043 Merge pull request #11 from GeeeekExplorer/tp_dev 2025-06-15 10:37:21 +08:00
Xingkai Yu c1fd4ea3c2 Merge pull request #9 from cheunglei/tp_dev 2025-06-15 10:22:18 +08:00
Xingkai Yu 9b59dae751 Merge pull request #4 from cheunglei/main
require xxhash
2025-06-13 23:46:18 +08:00