paper-with-me

PGM

Probability Guided Maxout

2000년 도입 · 논문 63편에서 사용

A regularization criterion that, differently from dropout and its variants, is deterministic rather than random. It grounds on the empirical evidence that feature descriptors with larger L2-norm and highly-active nodes are strongly correlated to confident class predictions. Thus, the criterion guides towards dropping a percentage of the most active nodes of the descriptors, proportionally to the estimated class probability

Regularization · General