paper-with-me

Papers

Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNN

2016-04-15 · Shengxian Wan, Yanyan Lan, Jun Xu, Jiafeng Guo, Liang Pang, Xue-Qi Cheng

Semantic matching, which aims to determine the matching degree between two texts, is a fundamental problem for many NLP applications. Recently, deep learning approach has been applied to this problem and significant improvements have been achieved. In this paper, we propose to view the generation of the global interaction between two texts as a recursive process: i.e. the interaction of two texts at each position is a composition of the interactions between their prefixes as well as the word level interaction at the current position. Based on this idea, we propose a novel deep architecture, namely Match-SRNN, to model the recursive matching structure. Firstly, a tensor is constructed to capture the word level interactions. Then a spatial RNN is applied to integrate the local interactions recursively, with importance determined by four types of gates. Finally, the matching score is calculated based on the global interaction. We show that, after degenerated to the exact matching scenario, Match-SRNN can approximate the dynamic programming process of longest common subsequence. Thus, there exists a clear interpretation for Match-SRNN. Our experiments on two semantic matching tasks showed the effectiveness of Match-SRNN, and its ability of visualizing the learned matching structure.

📄 PDF Abstract BibTeX arXiv:1604.04378

Code (1)

T-Almeida/tensorflow-keras-multidimensional-rnn tf

Tasks

Position

Similar Papers 제목 키워드 기반

Learning to Adaptively Scale Recurrent Neural Networks

2019-02-15 · Hao Hu, Liqiang Wang, Guo-Jun Qi

Recent advancements in recurrent neural network (RNN) research have demonstrated the superiority of utilizing multiscale structures in learning temporal representations of time series. Currently, most of multiscale RNNs …

Time SeriesTime Series Analysis

Initialization matters: Orthogonal Predictive State Recurrent Neural Networks

2018-01-01 · ICLR 2018 1 · Krzysztof Choromanski, Carlton Downey, Byron Boots

Learning to predict complex time-series data is a fundamental challenge in a range of disciplines including Machine Learning, Robotics, and Natural Language Processing. Predictive State Recurrent Neural Networks (PSRNNs)…

regressionTime SeriesTime Series Analysis

SRNN: Spatiotemporal Relational Neural Network for Intuitive Physics Understanding

2025-11-10 · Fei Yang arxiv

Human prowess in intuitive physics remains unmatched by machines. To bridge this gap, we argue for a fundamental shift towards brain-inspired computational principles. This paper introduces the Spatiotemporal Relational …

Predictive State Recurrent Neural Networks

2017-05-25 · NeurIPS 2017 12 · Carlton Downey, Ahmed Hefny, Boyue Li, Byron Boots 외

We present a new model, Predictive State Recurrent Neural Networks (PSRNNs), for filtering and prediction in dynamical systems. PSRNNs draw on insights from both Recurrent Neural Networks (RNNs) and Predictive State Repr…

Tensor Decomposition

Understanding Recurrent Neural Networks Using Nonequilibrium Response Theory

2020-06-19 · Soon Hoe Lim

Recurrent neural networks (RNNs) are brain-inspired models widely used in machine learning for analyzing sequential data. The present work is a contribution towards a deeper understanding of how RNNs process input signal…