vllm/csrc/moe at optimize-prefix-caching-scheduling - vllm - Gitea: Git with a cup of macha paffe

karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

Divakar VermaandGitHub a66cf40b20 [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927 )

This PR enables the fused topk_softmax kernel used in moe layer for HIP

2024-06-02 14:13:26 -07:00

..

moe_ops.cpp

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722 )

2024-05-22 07:18:41 +00:00

moe_ops.h

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722 )

2024-05-22 07:18:41 +00:00

topk_softmax_kernels.cu

[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927 )

2024-06-02 14:13:26 -07:00