AIACC-Training: Optimizing Distributed Deep Learning Training through Multi-streamed and Concurrent Gradient Communications

Lixiang Lin, Shenghao Qiu, Ziqi Yu, Liang You, Long Xin, Dr. Xiaoyang Sun, Jie Xu, Zheng Wang
November 4040
PDF Code
Type
Conference paper
Publication
42nd IEEE International Conference on Distributed Computing Systems (ICDCS)
Shenghao Qiu
Shenghao Qiu
PhD Student

PhD student under the supervision of Zheng Wang.

Dr. Xiaoyang Sun
Dr. Xiaoyang Sun
Research Fellow
Zheng Wang
Zheng Wang
Professor of Intelligent Software Technology