3 people 64e3d67ac0 Enable Cross layers KV cache layout at NIXL Connector (#30207) ...

Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>

2026-01-22 10:12:58 +00:00

..

attention

[FlashMLA] Update FlashMLA to expose new arguments (#32810)

2026-01-21 22:02:39 -07:00

core

[EC Connector] Optimize remote cache check in scheduler (#32585)

2026-01-22 03:30:59 +00:00

cudagraph

[Misc] Remove pad_for_cudagraphs from config (#30143)

2026-01-20 15:05:48 -05:00

determinism

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

distributed

[ROCm][CI] Add ROCm attention backend support for EAGLE DP tests (#32363)

2026-01-19 09:57:54 +00:00

e2e

[ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731)

2026-01-22 05:47:33 +00:00

ec_connector

[EC Connector] Optimize remote cache check in scheduler (#32585)

2026-01-22 03:30:59 +00:00

engine

[2/N] Move cache factories to MM registry (#32382)

2026-01-15 01:02:30 -08:00

entrypoints

[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)

2026-01-15 04:53:43 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

Enable Cross layers KV cache layout at NIXL Connector (#30207)

2026-01-22 10:12:58 +00:00

kv_offload

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

sample

Bump Flashinfer to v0.6.1 (#30993)

2026-01-21 08:49:50 -08:00

shutdown

[CI/Build][Hardware][AMD] Fix v1/shutdown (#31997)

2026-01-15 04:01:42 +00:00

spec_decode

[ROCm][CI][Docs] Add comment explaining TRITON_ATTN fallback for ROCm (#32835)

2026-01-21 22:11:09 -08:00

structured_output

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00