GCLU

2000년 도입 · 논문 1편에서 사용

Assuming the input is $x$, and $x\sim \mathcal{N}(0,1)$. The final response value is $f(x)$, the formulaic expression is: $$ f(x)= x * (2- \Phi(x)), x > 0 $$ $$ f(x)= x * \Phi(x), x \le 0 $$

출처: Deep Feature Response Discriminative Calibration

소개 논문: Deep Feature Response Discriminative Calibration