Karylab-cklius/vllm
1
0
Fork 1
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
Files
fa6a6be51978bd4b49ba0da17039e60f96dc5b13
vllm/docs/deployment/frameworks/triton.md
T

422 B
Raw Blame History

NVIDIA Triton

The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.

Reference in New Issue View Git Blame Copy Permalink