AdaFisher
Adaptive Second Order Optimization via Fisher Information
2000년 도입 · 논문 2편에서 사용
AdaFisher – an adaptive second-order optimizer that leverages a block-diagonal approximation to the Fisher information matrix for adaptive gradient preconditioning.
출처: AdaFisher: Adaptive Second Order Optimization via Fisher Information
소개 논문: AdaFisher: Adaptive Second Order Optimization via Fisher Information
Stochastic Optimization · General