DELU

2000년 도입 · 논문 2편에서 사용

The DELU is a type of activation function that has trainable parameters, uses the complex linear and exponential functions in the positive dimension and uses the SiLU in the negative dimension. $$DELU(x) = SiLU(x), x \leqslant 0$$ $$DELU(x) = (n + 0.5)x + |e^{-x} - 1|, x > 0$$

출처: Trainable Activations for Image Classification

소개 논문: Trainable Activations for Image Classification