Hard Swish

2000년 도입 · 논문 90편에서 사용

Hard Swish is a type of activation function based on Swish, but replaces the computationally expensive sigmoid with a piecewise linear analogue: $$\text{h-swish}\left(x\right) = x\frac{\text{ReLU6}\left(x+3\right)}{6} $$

출처: Searching for MobileNetV3

소개 논문: Searching for MobileNetV3