ATMO

2000년 도입 · 논문 1편에서 사용

This method combines multiple optimization techniques like ADAM and SGD or PADAM. This method can be applied to any couple of optimizers. Image credit: Combining Optimization Methods Using an Adaptive Meta Optimizer

출처: Combining Optimization Methods Using an Adaptive Meta Optimizer

소개 논문: Combining Optimization Methods Using an Adaptive Meta Optimizer