Files
vllm/docker
Lucas Wilkinsonandkhluu e4c0211529 [Build] Download nvcc from NVIDIA if system CUDA < 12.9
- Add nvcc toolchain override in setup.py to download nvcc 12.9.86
  from NVIDIA's redistribution server when system CUDA < 12.9
- FlashMLA requires nvcc >= 12.9 for compilation
- Use CUDA 12.8.1 base image to match PyTorch cu128 wheels
- Update pre-commit and test.txt to use cu128 torch backend
- Cache downloaded nvcc in .deps/nvcc/ for reuse
- Set VLLM_SKIP_NVCC_OVERRIDE=1 to disable

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
(cherry picked from commit d7276b81542f4086f31ad64f6483962fcd246507)
2026-02-18 15:46:29 -08:00
..