SLAMB
Sparse Layer-wise Adaptive Moments optimizer for large Batch training
2000년 도입 · 논문 1편에서 사용
Please enter a description about the method here
출처: SLAMB: Accelerated Large Batch Training with Sparse Communication
소개 논문: SLAMB: Accelerated Large Batch Training with Sparse Communication
Large Batch Optimization · General