vllm/tests at 166a8e954b6e2d90fa34ac5d167aaacef720dd80 - vllm - Gitea: Git with a cup of macha paffe

karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

166a8e954b [Model] Add Inkling multi-depth MTP support [5/N]

Extend the merged Inkling MTP=1 implementation to multiple checkpoint depths with multi-step speculative decoding and KV-cache plumbing.

Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

2026-07-16 21:17:29 +00:00

..

basic_correctness

[CI][AMD] Configure MI300 tests for native execution without DinD (#48387 )

2026-07-15 02:14:16 +00:00

[Bugfix] Re-enable benchmarking of librispeech dataset. (#47033 )

2026-07-08 16:19:26 +00:00

[Compilation] Skip x.size(dim) in _decompose_size_nodes (#42543 )

2026-07-15 17:59:14 -07:00

[Model] Add Inkling multi-depth MTP support [5/N]

2026-07-16 21:17:29 +00:00

Fix NVML capability lookup for visible devices (#47892 )

2026-07-08 09:07:44 -04:00

[CI/Build] Remove use of skip_v1 (#34699 )

2026-02-18 12:19:11 +08:00

[Perf][MoE] Write FlashInfer combine into final output (#47156 )

2026-07-16 17:21:03 +03:00

[Misc][Docs] Add human-readable integer support for more cli-args (#47608 )

2026-07-08 09:43:34 +00:00

[Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699 )

2026-07-16 14:00:20 +00:00

[Quant] Enable humming w[2-7]a[4,8] inference with compressed-tensors (#46390 )

2026-07-14 20:22:31 -06:00

Add the QuantizedActivation linear-kernel contract (#44260 )

2026-06-12 13:48:15 -07:00

[Perf] Set IR Op Priority Once at Worker Init (#42631 )

2026-05-15 15:56:13 +00:00

[Refactor] Move fla to third party (#48500 )

2026-07-16 19:22:36 +01:00

fix(lora): validate LoRA rank is positive in PEFTHelper (#48437 )

2026-07-16 05:22:52 +00:00

[Bugfix] Preserve unloaded non-persistent buffers during layerwise reload (#44371 )

2026-07-14 17:46:29 -07:00

[Model] Add Inkling MTP=1 support [3/N] (#48869 )

2026-07-16 13:27:21 -07:00

Add TorchCodec as a video decoding backend (#46609 )

2026-07-06 19:58:51 -07:00

[Model] Add Inkling model support [1/N] (#48799 )

2026-07-15 23:40:07 -07:00

[bugfix] bge-m3-sparse-plugin mismatch requests (#48112 )

2026-07-10 10:03:00 +08:00

[Frontend] Add endpoint plugins framework (#47454 )

2026-07-08 10:00:41 +08:00

[BugFix] Fix input positions for long context with sliding window (#2088 )

2023-12-13 12:28:13 -08:00

[Bug][Quantization] Fix humming is_layer_skipped for compressed-tensors "re:" ignore entries (#48507 )

2026-07-16 07:47:42 -07:00

[Frontend] [Parser] Port DeepSeek V4 to streaming parser engine framework (#45877 )

2026-07-03 20:55:23 -04:00

[Model] Add Inkling model support [1/N] (#48799 )

2026-07-15 23:40:07 -07:00

[ROCm] Fix AITER FP8 quantization schema tests (#46414 )

2026-06-24 22:29:19 +08:00

[Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126 )

2026-07-01 07:07:06 +00:00

[Feature] Support custom callable proposer backend for speculative decoding (#39487 )

2026-05-13 16:53:01 +00:00

standalone_tests

[CI][AMD] Configure MI300 tests for native execution without DinD (#48387 )

2026-07-15 02:14:16 +00:00

system_messages

[V1] Implement Cascade Attention (#11635 )

2025-01-01 21:56:46 +09:00

Bump Transformers version to 5.10.4 (#41359 )

2026-07-07 05:13:28 -07:00

[Bugfix] Skip minimax_m3 tool parser tests when Rust extension is absent (#48523 )

2026-07-14 04:43:22 +00:00

[Bugfix] Fix parallel_tool_calls=null crash in Responses API from_request() (#48098 )

2026-07-15 18:01:17 +08:00

[ROCm][CI] Adding metadata (#47477 )

2026-07-02 17:45:23 -07:00

[CI][Tracing] Fix race condition by adding server readiness check (#34364 )

2026-02-16 12:57:39 +00:00

transformers_utils

[CI] Don't try and download files that we already know don't exist (#46854 )

2026-06-26 23:56:39 +00:00

[Bugfix][Core] Close underlying iterator in merge_async_iterators single-iterator fast path (#44726 )

2026-07-07 05:13:41 -07:00

[Bugfix][KV-transfer] MoRIIO: retry RDMA send-queue-full backpressure instead of failing the read (#47495 )

2026-07-16 20:02:27 +00:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288 )

2026-05-15 08:25:52 +08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528 )

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817 )

2025-10-13 16:44:50 +08:00

conftest.py

[ROCm][CI] fix test_common.py (#48676 )

2026-07-15 06:42:06 +00:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011 )

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916 )

2026-01-09 13:10:24 -08:00

test_config.py

[Model] Add Inkling model support [1/N] (#48799 )

2026-07-15 23:40:07 -07:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_envs.py

[KVOffload][P2P] Well-known default host/port env vars and per-DP-rank control port (#47636 )

2026-07-15 15:22:56 +03:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425 )

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205 )

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485 )

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

Bump flashinfer version to 0.6.14 (#47669 )

2026-07-15 21:00:40 -07:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479 )

2026-06-04 06:49:31 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914 )

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Bugfix] Reject matryoshka embedding dimensions above hidden size (#46313 )

2026-06-22 10:16:35 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836 )

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806 )

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176 )

2026-05-09 19:47:09 -07:00

test_sampling_params.py

[Bugfix] Reject sampling params unsupported by diffusion models (#45418 )

2026-07-07 11:25:36 +00:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970 )

2026-03-15 23:35:35 +00:00

utils.py

[ROCm][AITER] Directly Implement AITER Custom All-reduce in CudaCommunicator (#46065 )

2026-07-06 12:16:32 +00:00