Cody YuandGitHub b5af8c223c [Model] Pipeline parallel support for Mixtral (#6516)

2024-07-17 19:26:04 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_distributed_correctness.py

[ci][distributed] fix device count call

2024-06-30 08:06:13 +00:00

test_chunked_prefill_distributed.py

[ci][distributed] fix device count call

2024-06-30 08:06:13 +00:00

test_comm_ops.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

test_custom_all_reduce.py

[Distributed] Add send and recv helpers (#5719)

2024-06-23 14:42:28 -07:00

test_multimodal_broadcast.py

[vlm] Remove vision language config. (#6089)

2024-07-03 22:14:16 +00:00

test_parallel_state.py

[Distributed] Make it clear that % should not be in tensor dict keys. (#5927)

2024-06-28 15:20:22 +00:00

test_pipeline_parallel.py

[Model] Pipeline parallel support for Mixtral (#6516)

2024-07-17 19:26:04 -07:00

test_pynccl.py

[Distributed] Add send and recv helpers (#5719)

2024-06-23 14:42:28 -07:00

test_same_node.py

[ci] try to add multi-node tests (#6280)

2024-07-12 21:51:48 -07:00

test_shm_broadcast.py

[core][distributed] zmq fallback for broadcasting large objects (#6183)

2024-07-09 18:49:11 -07:00

test_utils.py

[ROCm][AMD] unify CUDA_VISIBLE_DEVICES usage in cuda/rocm (#6352)

2024-07-11 21:30:46 -07:00