A Neural Turing~Machine for Conditional Transition Graph Modeling

2019-07-15 · Mehdi Ben Lazreg, Morten Goodwin, Ole-Christoffer Granmo

Graphs are an essential part of many machine learning problems such as analysis of parse trees, social networks, knowledge graphs, transportation systems, and molecular structures. Applying machine learning in these areas typically involves learning the graph structure and the relationship between the nodes of the graph. However, learning the graph structure is often complex, particularly when the graph is cyclic, and the transitions from one node to another are conditioned such as graphs used to represent a finite state machine. To solve this problem, we propose to extend the memory based Neural Turing Machine (NTM) with two novel additions. We allow for transitions between nodes to be influenced by information received from external environments, and we let the NTM learn the context of those transitions. We refer to this extension as the Conditional Neural Turing Machine (CNTM). We show that the CNTM can infer conditional transition graphs by empirically verifiying the model on two data sets: a large set of randomly generated graphs, and a graph modeling the information retrieval process during certain crisis situations. The results show that the CNTM is able to reproduce the paths inside the graph with accuracy ranging from 82,12% for 10 nodes graphs to 65,25% for 100 nodes graphs.

📄 PDF Abstract BibTeX arXiv:1907.06432

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning Information Retrieval Knowledge Graphs Retrieval

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Neural Turing Machine A Neural Turing Machine is a working memory neural network model. It couples a neural network architecture with external memory resources. The whole architecture is…

Location-based Attention 설명 없음

Content-based Attention Content-based attention is an attention mechanism based on cosine similarity: $$f_{att}\left(\textbf{h}_{i}, \textbf{s}\_{j}\right) =…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Sparse Nested Markov models with Log-linear Parameters

2013-09-26 · Ilya Shpitser, Robin J. Evans, Thomas S. Richardson, James M. Robins

Hidden variables are ubiquitous in practical data analysis, and therefore modeling marginal densities and doing inference with the resulting models is an important problem in statistics, machine learning, and causal infe…

Causal Inference

Transitional Conditional Independence

2021-04-23 · Patrick Forré

We develope the framework of transitional conditional independence. For this we introduce transition probability spaces and transitional random variables. These constructions will generalize, strengthen and unify previou…

Leveraging Two Types of Global Graph for Sequential Fashion Recommendation

2021-05-17 · Yujuan Ding, Yunshan Ma, Wai Keung Wong, Tat-Seng Chua

Sequential fashion recommendation is of great significance in online fashion shopping, which accounts for an increasing portion of either fashion retailing or online e-commerce. The key to building an effective sequentia…

Vocal Bursts Valence Prediction

Delta-Diffusion: Modeling Longitudinal Brain Amyloid-PET Trajectories via Conditional Poisson Diffusion Bridge

2026-06-20 · Yongheng Sun, Minhui Yu, Mengqi Wu, Maureen Kohi 외 arxiv

While longitudinal brain PET imaging is the gold standard for quantifying the spatiotemporal accumulation of Beta-amyloid, its widespread clinical utility is constrained by high operational costs and cumulative radiation…

Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendation

2020-12-12 · Xin Xia, Hongzhi Yin, Junliang Yu, Qinyong Wang 외

Session-based recommendation (SBR) focuses on next-item prediction at a certain time point. As user profiles are generally not available in this scenario, capturing the user intent lying in the item transitions plays a p…

Self-Supervised Learning Session-Based Recommendations