Local SGD

2000년 도입 · 논문 69편에서 사용

Local SGD is a distributed training technique that runs SGD independently in parallel on different workers and averages the sequences only once in a while.

출처: Local SGD Converges Fast and Communicates Little

소개 논문: Local SGD Converges Fast and Communicates Little