6 people ebfbcfe46a Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026) ...

Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: kourosh hakhamaneshi <kouroshHakha@users.noreply.github.com>

2026-06-20 13:38:10 -07:00

..

__init__.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

attention.py

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

cache.py

[Metrics] Add group-aware KV cache capacity to vllm:cache_config_info (#42206)

2026-06-12 11:49:44 +00:00

compilation.py

[EP] Enable DBO with NIXL EP (#45275)

2026-06-15 23:37:22 +00:00

device.py

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

2026-05-12 12:39:17 -07:00

diffusion.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[ROCm][Perf] Enable W4A16 FlyDSL MoE (#44400)

2026-06-14 00:14:39 -07:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Connector] Remove P2pNcclConnector (#44854)

2026-06-08 18:58:29 +08:00

load.py

[Bugfix][Model] Validate DefaultModelLoader / LoadConfig and fail with clear errors (#45196)

2026-06-17 21:46:33 +00:00

lora.py

[LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242)

2026-05-18 15:22:26 +08:00

mamba.py

[Mamba] Flashinfer selective_state_update (#36162)

2026-04-14 15:10:58 -04:00

model_arch.py

[Misc] use model arch converter for bidi models identification (#40701)

2026-04-23 13:42:52 +00:00

model.py

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

multimodal.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

observability.py

Add Triton recompile detection (#45631)

2026-06-16 18:25:28 +08:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

pooler.py

[Misc] Replaced asserts with proper exceptions to improve UX for pooling (#44593)

2026-06-06 05:57:26 +00:00

profiler.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

quantization.py

[Quantization] add online fp8 ptpc (#44132)

2026-06-08 22:42:11 +08:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Core] Add prefill step cadence for better non-PD DP balancing (#44558)

2026-06-16 13:17:18 -07:00

speculative.py

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

fix: AOT compile cache collision for dataclass-based HF configs (#45059)

2026-06-10 08:05:29 -07:00

vllm.py

[Model Runner V2] Migration to support quantized model by default [5/N] (#44446)

2026-06-18 12:20:44 -07:00

weight_transfer.py

Restore Literal for WeightTransferConfig.backend (#43183)

2026-05-28 09:39:41 +00:00