ScaledSoftSign
2000년 도입 · 논문 1편에서 사용
The ScaledSoftSign is a modification of SoftSign activation function that has trainable parameters. $$ScaledSoftSign(x) = \frac{\alpha x}{\beta + |x|}$$
출처: Trainable Activations for Image Classification
소개 논문: Trainable Activations for Image Classification
Activation Functions · General