AHAF
Adaptive Hybrid Activation Function
2000년 도입 · 논문 2편에서 사용
Trainable activation function as a sigmoid-based generalization of ReLU, Swish and SiLU.
출처: Adaptive hybrid activation function for deep neural networks
소개 논문: Adaptive hybrid activation function for deep neural networks
Adaptive Activation Functions · GeneralActivation Functions · General