ByteScheduler

2019년 도입 · 논문 1편에서 사용

ByteScheduler is a generic communication scheduler for distributed DNN training acceleration. It is based on analysis that partitioning and rearranging the tensor transmissions can result in optimal results in theory and good performance in real-world even with scheduling overhead.