6 people 51878e5b6e [2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

2026-07-11 11:11:16 -04:00

..

attention

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

core

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

cpu

[HARDWARE][POWER] optimize math functions of VSX power (#47321)

2026-07-07 09:35:47 +00:00

cutlass_extensions

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

libtorch_stable

[2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455)

2026-07-11 11:11:16 -04:00

moe

[CPU][BugFix] Multiple fixes to w4a8_int8 CPU MoE path (#46739)

2026-07-06 05:39:20 +00:00

quantization

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

quickreduce

[ROCM] [Communication] Add INT3 quantization method for quickreduce (#45666)

2026-06-25 15:14:15 +00:00

rocm

[ROCm][Perf] Tune wvSplitK on gfx1151 (#40784)

2026-06-25 14:17:46 +08:00

cache.h

Use CU_MEMCPY_SRC_ACCESS_ORDER_ANY for batch KV cache swaps (#39306)

2026-05-10 05:57:09 +03:00

cuda_compat.h

[Bugfix][ROCm] Fix for warp_size uses on host (#21205)

2025-07-24 00:37:19 -07:00

cuda_utils.h

[Attention] MLA with chunked prefill (#12639)

2025-02-21 15:30:12 -08:00

cumem_allocator_compat.h

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

cumem_allocator.cpp

[Bugfix][ROCm] Fix cumem sleep and teardown (#46203)

2026-06-24 02:45:31 +08:00

custom_all_reduce.cuh

[Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111)

2025-09-11 09:45:31 -07:00

custom_quickreduce.cu

[ROCM] [Communication] Add INT3 quantization method for quickreduce (#45666)

2026-06-25 15:14:15 +00:00

dispatch_utils.h

[Performance] Fused blockwise quant RMS norm (#27883)

2025-12-07 16:38:04 +00:00

fs_io.cpp

[FS-Offloading] Batch Lookup in C (#46713)

2026-06-29 09:28:32 -07:00

ops.h

[CPU][BugFix] Multiple fixes to w4a8_int8 CPU MoE path (#46739)

2026-07-06 05:39:20 +00:00

qutlass_registration.cpp

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

spinloop.cpp

Add VLLM_USE_SPINLOOP_EXT to use more efficient busy polling (#36517)

2026-05-11 16:11:49 -07:00

torch_bindings.cpp

[ROCm] [PyTorch] Move to stable abi since ROCm upgraded to torch 2.11 (#47128)

2026-07-02 18:34:07 +08:00

torch_utils.h

[6/n] Migrate activation kernels, gptq, gguf, non cutlass w8a8 to libtorch stable ABI (continued) (#42663)

2026-05-20 00:18:12 -07:00