Xingkai Yu 52d2215911 Merge pull request #148 from guodongxiaren/main ...

remove hard code for block_size

2026-04-13 20:36:32 +08:00

..

engine

Merge pull request #148 from guodongxiaren/main

2026-04-13 20:36:32 +08:00

layers

compile random sampling

2025-08-31 22:55:34 +08:00

models

support qwen2

2025-11-04 01:44:42 +08:00

utils

simplify

2025-06-21 17:19:15 +08:00

__init__.py

better

2025-06-15 10:36:45 +08:00

config.py

warmup and allocate

2025-06-27 01:51:57 +08:00

llm.py

support tensor parallel

2025-06-15 01:31:24 +08:00

sampling_params.py

compile random sampling

2025-08-31 22:55:34 +08:00