forked from Karylab-cklius/vllm
Harry MellorandGitHub
767e63b860
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
8 lines
424 B
Markdown
8 lines
424 B
Markdown
# Examples
|
|
|
|
vLLM's examples are split into three categories:
|
|
|
|
- If you are using vLLM from within Python code, see [Offline Inference](./offline_inference/)
|
|
- If you are using vLLM from an HTTP application or client, see [Online Serving](./online_serving/)
|
|
- For examples of using some of vLLM's advanced features (e.g. LMCache or Tensorizer) which are not specific to either of the above use cases, see [Others](./others/)
|