karylab_agents/vllm

Fork 0

forked from Karylab-cklius/vllm

Files

T

History

4d51588e23 [Feat] DeepSeek V4 Rebased (#40860 )

Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: qizixi <zixi@inferact.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Zhewen Li <jerven.vllm@gmail.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: qizixi <zixi@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

2026-04-26 18:31:08 -07:00

correctness_e2e

[torch.compile]: Disable Sequence Parallelism (SP) for piecewise compilation (#38373 )

2026-04-26 17:44:42 +00:00

fullgraph

full cudagraph for flex-attn (#36298 )

2026-04-02 21:15:01 -07:00

fusions_e2e

[Feat] DeepSeek V4 Rebased (#40860 )

2026-04-26 18:31:08 -07:00

h100

[Bugfix] Include inductor and functorch configs in compilation cache key (#40627 )

2026-04-23 09:52:59 -04:00

passes

[torch.compile]: Disable Sequence Parallelism (SP) for piecewise compilation (#38373 )

2026-04-26 17:44:42 +00:00

__init__.py

[torch.compile] register allreduce operations as custom ops (#8526 )

2024-09-16 22:57:57 -07:00

backend.py

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825 )

2026-03-31 22:15:05 -04:00

conftest.py

[torch.compile] Sequence Parallelism threshold compile ranges (#28672 )

2026-02-26 05:00:12 +00:00

README.md

[CI] Reorganize compile tests so new tests are automatically included in CI (#28625 )

2025-11-19 06:13:50 -08:00

silly_attention.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908 )

2025-10-18 09:48:22 -07:00

test_aot_compile.py

[BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015 )

2026-03-24 19:08:26 +00:00

test_compile_ranges.py

[torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093 )

2026-03-11 16:07:09 +00:00

test_config.py

[torch.compile]: Disable Sequence Parallelism (SP) for piecewise compilation (#38373 )

2026-04-26 17:44:42 +00:00

test_decorator.py

[Bugfix][CI] fix typos (#34934 )

2026-03-05 17:05:46 +00:00

test_dynamic_shapes_compilation.py

Fix test_startup.py for torch 2.12 (#40636 )

2026-04-22 19:31:41 +00:00

test_graph_partition.py

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901 )

2026-04-15 11:02:35 +08:00

test_rotary_embedding_compile.py

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901 )

2026-04-15 11:02:35 +08:00

test_sequence_parallelism_threshold.py

[torch.compile] Sequence Parallelism threshold compile ranges (#28672 )

2026-02-26 05:00:12 +00:00

test_structured_logging.py

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901 )

2026-04-15 11:02:35 +08:00

test_wrapper.py

[Bugfix][CI] fix typos (#34934 )

2026-03-05 17:05:46 +00:00

README.md

compile test folder structure

compile/test_*.py : various unit tests meant for testing particular code path/features. Future tests are most likely added here. New test files added here will be included in CI automatically
compile/fullgraph/ : full model tests, including all tests previously in compile/piecewise. These tests do not target particular features. New test files added here will be included in CI automatically
compile/distributed/ : tests that require multiple GPUs. New test files added here will NOT be included in CI automatically as these tests generally need to be manually configured to run in runners with particular number/type of GPUs.