Margin ReLU
Margin Rectified Linear Unit
2000년 도입 · 논문 2편에서 사용
Margin Rectified Linear Unit, or Margin ReLU, is a type of activation function based on a ReLU, but it has a negative threshold for negative values instead of a zero threshhold.
출처: A Comprehensive Overhaul of Feature Distillation
소개 논문: A Comprehensive Overhaul of Feature Distillation
Activation Functions · General