Xingkai Yu 44a51afc8a Merge pull request #207 from DestineG/fix-prefill-index-out-of-range ...

fix(scheduler): recalculate num_tokens after allocate to prevent IndexError at model_runner:155

2026-04-25 18:12:43 +08:00

..

engine

Merge pull request #207 from DestineG/fix-prefill-index-out-of-range

2026-04-25 18:12:43 +08:00

layers

support chunked prefill and fix minor bug

2026-04-14 03:05:35 +08:00

models

support chunked prefill and fix minor bug

2026-04-14 03:05:35 +08:00

utils

enable slots=True for dataclasses

2026-02-08 23:46:01 -05:00

__init__.py

better

2025-06-15 10:36:45 +08:00

config.py

support chunked prefill and fix minor bug

2026-04-14 03:05:35 +08:00

llm.py

support tensor parallel

2025-06-15 01:31:24 +08:00

sampling_params.py

enable slots=True for dataclasses

2026-02-08 23:46:01 -05:00