forked from Karylab-cklius/vllm
Tyler Michael SmithandClaude Opus 4.6
c7b1080a64
Use CUDA 12.9.86 compiler toolchain (nvcc, ptxas, cicc) for better GPU code generation while keeping CUDA 12.8 headers/libs for runtime compatibility with PyTorch cu128 wheels. nvcc is replaced (not just ptxas/cicc) so that setup.py's get_nvcc_cuda_version() reports 12.9, which is required for FlashMLA registration. PyTorch's CMake nvcc-vs-header version check is patched to a warning in base (for extensions-build), csrc-build, and build stages (re-applied after torch pip reinstall overwrites cmake files). Controlled by ARG MIN_NVCC_TOOLCHAIN_VERSION (default 12.9.86): - Skipped if system nvcc is already >= the specified version - Set to empty string to disable entirely - Archive integrity verified via SHA256 checksums from NVIDIA's redistrib manifest Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>