Antoni BaumandGitHub fb96c1e98c Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

..

api_server_async_engine.py

Migrate linter from pylint to ruff (#1665)

2023-11-20 11:58:01 -08:00

test_api_server.py

Asynchronous tokenization (#2879)

2024-03-15 23:37:01 +00:00

test_async_llm_engine.py

[BugFix] Fix get tokenizer when using ray (#3301)

2024-03-10 19:17:16 -07:00

test_chat_template.py

Re-enable the 80 char line width limit (#3305)

2024-03-10 19:49:14 -07:00

test_request_tracker.py

Add health check, make async Engine more robust (#3015)

2024-03-04 22:01:40 +00:00