1cycle
1cycle learning rate scheduling policy
2000년 도입
· 논문 13편에서 사용
출처: A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
소개 논문: A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
Learning Rate Schedules · General