Convolutional Neural Networks with Recurrent Neural Filters

2018-08-28 · EMNLP 2018 10 · Yi Yang

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear function, which fails to account for language compositionality. As a result, it limits the use of high-order filters that are often warranted for natural language processing tasks. In this work, we model convolution filters with RNNs that naturally capture compositionality and long-term dependencies in language. We show that simple CNN architectures equipped with recurrent neural filters (RNFs) achieve results that are on par with the best published ones on the Stanford Sentiment Treebank and two answer sentence selection datasets.

📄 PDF Abstract BibTeX arXiv:1808.09315

Code (2)

bloomberg/cnn-rnf 공식 구현 tf

davide97l/Sentiment-analysis pytorch

Tasks

SentenceSentiment Analysis

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Kernel-Based Approaches for Sequence Modeling: Connections to Neural Methods

2019-10-09 · NeurIPS 2019 12 · Kevin J Liang, Guoyin Wang, Yitong Li, Ricardo Henao 외

We investigate time-dependent data analysis from the perspective of recurrent kernel machines, from which models with hidden units and gated memory cells arise naturally. By considering dynamic gating of the memory cell,…

Sound Event Detection in Domestic Environments using Dense Recurrent Neural Network

2020-11-04 · Tianchu Yao, Chuang Shi, Huiyong Li

In this paper, we introduce our sound events detection system using a mean-teacher model with convolutional recurrent neural network (CRNN) for DCASE 2020 Task4, which include residual convolutional block and dense recu…

Data Augmentation Event Detection Sound Event Detection

ECG Classification with a Convolutional Recurrent Neural Network

2020-09-28 · Halla Sigurthorsdottir, Jérôme Van Zaen, Ricard Delgado-Gonzalo, Mathieu Lemay

We developed a convolutional recurrent neural network to classify 12-lead ECG signals for the challenge of PhysioNet/ Computing in Cardiology 2020 as team Pink Irish Hat. The model combines convolutional and recurrent la…

Classification ECG Classification General Classification

SRH-Net: Stacked Recurrent Hourglass Network for Stereo Matching

2021-05-25 · Hongzhi Du, Yanyan Li, Yanbiao Sun, Jigui Zhu 외

The cost aggregation strategy shows a crucial role in learning-based stereo matching tasks, where 3D convolutional filters obtain state of the art but require intensive computation resources, while 2D operations need les…

GPU Stereo Matching

Differentiable Mask for Pruning Convolutional and Recurrent Networks

2019-09-10 · Ramchalam Kinattinkara Ramakrishnan, Eyyüb Sari, Vahid Partovi Nia

Pruning is one of the most effective model reduction techniques. Deep networks require massive computation and such models need to be compressed to bring them on edge devices. Most existing pruning techniques are focused…

Model Compression Multi-Task Learning Neural Architecture Search