Zhuohan LiandGitHub fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

..

adding_model.rst

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

engine_args.rst

[Docs] Update documentation for gpu-memory-utilization option (#2162)

2023-12-17 10:51:57 -08:00

supported_models.rst

[Docs] Fix broken links (#2222)

2023-12-20 12:43:42 -08:00