4 people bf480c5302 Add more Prometheus metrics (#2764) ...

Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

2024-04-28 15:59:33 -07:00

..

output_processor

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Kernel] Full Tensor Parallelism for LoRA Layers (#3524)

2024-04-27 00:03:48 -07:00

async_llm_engine.py

[Bugfix][Core] Fix get decoding config from ray (#4335)

2024-04-27 11:30:08 +00:00

llm_engine.py

Add more Prometheus metrics (#2764)

2024-04-28 15:59:33 -07:00

metrics.py

Add more Prometheus metrics (#2764)

2024-04-28 15:59:33 -07:00