Woosuk KwonandGitHub 2863befce3 [Optimization] Use Shared CachedRequestData Instance Across All Requests (#20232) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-06-30 09:07:50 -07:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_gpu_input_batch.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

test_gpu_model_runner.py

[Optimization] Use Shared CachedRequestData Instance Across All Requests (#20232)

2025-06-30 09:07:50 -07:00