Slanted Triangular Learning Rates

2000년 도입 · 논문 40편에서 사용

Slanted Triangular Learning Rates (STLR) is a learning rate schedule which first linearly increases the learning rate and then linearly decays it, which can be seen in Figure to the right. It is a modification of Triangular Learning Rates, with a short increase and a long decay period.

출처: Universal Language Model Fine-tuning for Text Classification

소개 논문: Universal Language Model Fine-tuning for Text Classification