NAIL OR

2000년 도입 · 논문 1편에서 사용

NAIL OR is a two-dimensional activation function which takes two logits as input and produces a single output. It is a piece-wise linear approximation of the probabilistic OR operator in logit-space. $$\begin{equation} \text{OR_{AIL}}(x, y) := \begin{cases} x + y, & x > 0, \, y > 0 \\ \max(x, y), & \text{otherwise} \end{cases} \end{equation} $$

출처: Logical Activation Functions: Logit-space equivalents of Probabilistic Boolean Operators

소개 논문: Logical Activation Functions: Logit-space equivalents of Probabilistic Boolean Operators