Nick HillandGitHub a657bfc48a [Core] Add multiproc_worker_utils for multiprocessing-based workers (#4357)

2024-05-01 18:41:59 +00:00

..

output_processor

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

test_computed_prefix_blocks.py

Fix auto prefix bug (#3239)

2024-03-07 16:37:28 -08:00

test_detokenization.py

[Core] [Frontend] Make detokenization optional (#3749)

2024-04-03 21:52:18 -07:00

test_multiproc_workers.py

[Core] Add multiproc_worker_utils for multiprocessing-based workers (#4357)

2024-05-01 18:41:59 +00:00

test_skip_tokenizer_init.py

Make initialization of tokenizer and detokenizer optional (#3748)

2024-04-21 22:06:46 +00:00

test_stop_reason.py

[BugFix] Fix handling of stop strings and stop token ids (#3672)

2024-04-11 15:34:12 -07:00

test_stop_strings.py

[BugFix] Fix handling of stop strings and stop token ids (#3672)

2024-04-11 15:34:12 -07:00