CosLU

2000년 도입 · 논문 1편에서 사용

The Cosine Linear Unit, or CosLU, is a type of activation function that has trainable parameters and uses the cosine function. $$CosLU(x) = (x + \alpha \cos(\beta x))\sigma(x)$$

출처: Trainable Activations for Image Classification

소개 논문: Trainable Activations for Image Classification