Harry MellorandGitHub
a1fe24d961
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
462 B
462 B
title
| title |
|---|
| NVIDIA Triton |
The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.