WEI CHENG CHIUandGitHub 5b2943f5a6 [Bugfix] Return the tokenizer from maybe_make_thread_pool so it survives pickling (#45460) ...

Signed-off-by: Wayne Chiu <waynehacking8@gmail.com>

2026-06-13 06:01:35 +00:00

..

fixtures/deepseek_v4

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

__init__.py

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

test_basic.py

Deprecated 1st generation Qwen and QwenVL models (#45131)

2026-06-10 14:55:33 +00:00

test_deepseek_v4.py

feat: Enable prompt_embeds Content Part Support in vLLM Chat Completions API (#40720)

2026-05-01 10:05:55 +08:00

test_detokenize.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

test_hf.py

[Bugfix] Return the tokenizer from maybe_make_thread_pool so it survives pickling (#45460)

2026-06-13 06:01:35 +00:00

test_mistral.py

[Bugfix] Update mistral tokenizer test for continue_final_message fix (#44622)

2026-06-05 16:13:26 +08:00

test_registry.py

[Refactor] TokenizerRegistry only uses lazy imports (#30609)

2025-12-13 23:16:22 +08:00