Softsign Activation

2000년 도입 · 논문 12편에서 사용

Softsign is an activation function for neural networks: $$ f\left(x\right) = \left(\frac{x}{|x|+1}\right)$$ Image Source: Sefik Ilkin Serengil