Gated Convolution Network

2000년 도입 · 논문 3편에서 사용

A Gated Convolutional Network is a type of language model that combines convolutional networks with a gating mechanism. Zero padding is used to ensure future context can not be seen. Gated convolutional layers can be stacked on top of other hierarchically. Model predictions are then obtained with an adaptive softmax layer.

출처: Language Modeling with Gated Convolutional Networks

소개 논문: Language Modeling with Gated Convolutional Networks