paper-with-me

홈 › Papers

The Role of Isomorphism Classes in Multi-Relational Datasets

2020-09-30 · Vijja Wichitwechkarn, Ben Day, Cristian Bodnar, Matthew Wales, Pietro Liò

Multi-interaction systems abound in nature, from colloidal suspensions to gene regulatory circuits. These systems can produce complex dynamics and graph neural networks have been proposed as a method to extract underlying interactions and predict how systems will evolve. The current training and evaluation procedures for these models through the use of synthetic multi-relational datasets however are agnostic to interaction network isomorphism classes, which produce identical dynamics up to initial conditions. We extensively analyse how isomorphism class awareness affects these models, focusing on neural relational inference (NRI) models, which are unique in explicitly inferring interactions to predict dynamics in the unsupervised setting. Specifically, we demonstrate that isomorphism leakage overestimates performance in multi-relational inference and that sampling biases present in the multi-interaction network generation process can impair generalisation. To remedy this, we propose isomorphism-aware synthetic benchmarks for model evaluation. We use these benchmarks to test generalisation abilities and demonstrate the existence of a threshold sampling frequency of isomorphism classes for successful learning. In addition, we demonstrate that isomorphism classes can be utilised through a simple prioritisation scheme to improve model performance, stability during training and reduce training time.

📄 PDF Abstract BibTeX arXiv:2009.14593

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Classifying Financial Markets up to Isomorphism

2020-07-24

Two markets should be considered isomorphic if they are financially indistinguishable. We define a notion of isomorphism for financial markets in both discrete and continuous time. We then seek to identify the distinct i…

Topology-Informed Graph Transformer

2024-02-03 · Yun Young Choi, Sun Woo Park, Minho Lee, Youngho Woo

Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengt…

Graph ClassificationGraph RegressionInductive BiasNode Classification

Borel Isomorphic Dimensionality Reduction of Data and Supervised Learning

2013-07-29 · Stan Hatko

In this project we further investigate the idea of reducing the dimensionality of datasets using a Borel isomorphism with the purpose of subsequently applying supervised learning algorithms, as originally suggested by my…

Dimensionality Reduction

Multi-Relational Graph based Heterogeneous Multi-Task Learning in Community Question Answering

2021-09-04 · Zizheng Lin, Haowen Ke, Ngo-Yin Wong, Jiaxin Bai 외

Various data mining tasks have been proposed to study Community Question Answering (CQA) platforms like Stack Overflow. The relatedness between some of these tasks provides useful learning signals to each other via Multi…

Community Question AnsweringMulti-Task LearningQuestion Answering

Dimension Reduction via Colour Refinement

2013-07-22 · Martin Grohe, Kristian Kersting, Martin Mladenov, Erkal Selman

Colour refinement is a basic algorithmic routine for graph isomorphism testing, appearing as a subroutine in almost all practical isomorphism solvers. It partitions the vertices of a graph into "colour classes" in such a…

Dimensionality ReductionIsomorphism TestingMath