Keyun TongandGitHub 3ee696a63d [RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518) ...

Signed-off-by: Keyun Tong <tongkeyun@gmail.com>

2025-02-12 12:25:58 +08:00

..

__init__.py

Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

test_cached_tokenizer.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_detokenize.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_get_eos.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_mistral_tokenizer.py

[Bugfix] Support missing tool parameters in mistral tokenizer (#12884)

2025-02-11 03:33:33 +00:00

test_tokenizer_group.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

test_tokenizer_registry.py

[RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518)

2025-02-12 12:25:58 +08:00

test_tokenizer.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00