paper-with-me

Papers

Relational Deep Learning: Graph Representation Learning on Relational Databases

2023-12-07 · Matthias Fey, Weihua Hu, Kexin Huang, Jan Eric Lenssen, Rishabh Ranjan, Joshua Robinson, Rex Ying, Jiaxuan You, Jure Leskovec

Much of the world's most valued data is stored in relational databases and data warehouses, where the data is organized into many tables connected by primary-foreign key relations. However, building machine learning models using this data is both challenging and time consuming. The core problem is that no machine learning method is capable of learning on multiple tables interconnected by primary-foreign key relations. Current methods can only learn from a single table, so the data must first be manually joined and aggregated into a single training table, the process known as feature engineering. Feature engineering is slow, error prone and leads to suboptimal models. Here we introduce an end-to-end deep representation learning approach to directly learn on data laid out across multiple tables. We name our approach Relational Deep Learning (RDL). The core idea is to view relational databases as a temporal, heterogeneous graph, with a node for each row in each table, and edges specified by primary-foreign key links. Message Passing Graph Neural Networks can then automatically learn across the graph to extract representations that leverage all input data, without any manual feature engineering. Relational Deep Learning leads to more accurate models that can be built much faster. To facilitate research in this area, we develop RelBench, a set of benchmark datasets and an implementation of Relational Deep Learning. The data covers a wide spectrum, from discussions on Stack Exchange to book reviews on the Amazon Product Catalog. Overall, we define a new research area that generalizes graph machine learning and broadens its applicability to a wide set of AI use cases.

📄 PDF Abstract BibTeX arXiv:2312.04615

Code (1)

snap-stanford/relgnn pytorch

Tasks

Deep LearningFeature EngineeringGraph Representation LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

GFS: Graph-based Feature Synthesis for Prediction over Relational Databases

2023-12-04 · Han Zhang, Quan Gan, David Wipf, Weinan Zhang

Relational databases are extensively utilized in a variety of modern information system applications, and they always carry valuable data patterns. There are a huge number of data mining or machine learning tasks conduct…

Feature EngineeringInductive Bias

Relational Deep Learning: Challenges, Foundations and Next-Generation Architectures

2025-06-19 · Vijay Prakash Dwivedi, Charilaos Kanatsoulis, Shenyang Huang, Jure Leskovec

Graph machine learning has led to a significant increase in the capabilities of models that learn on arbitrary graph-structured data and has been applied to molecules, social networks, recommendation systems, and transpo…

Deep LearningFeature EngineeringRecommendation Systems

Neuro-Relational Programs: Unifying Queries and Neural Computation over Structured Data

2026-06-10 · Arie Soeteman, Balder ten Cate, Maurice Funk, Benny Kimelfeld 외 arxiv

The conventional approach to deep learning over relational databases applies neural models, such as Graph Neural Networks (GNNs), to a graph representation of the database. Recent approaches instead operate on databases …

Relational Reasoning

Towards Foundation Models for Relational Databases with Language Models and Graph Neural Networks

2026-05-15 · Jingcheng Wu, Ratan Bahadur Thapa, Mojtaba Nayyeri, Lucas Etteldorf 외 arxiv

Relational databases store much of the world's structured information, and they are essential for driving complex predictive applications. However, deep learning progress on relational data remains limited, as convention…

Feature Engineering

BERT Meets Relational DB: Contextual Representations of Relational Databases

2021-04-30 · Siddhant Arora, Vinayak Gupta, Garima Gaur, Srikanta Bedathur

In this paper, we address the problem of learning low dimension representation of entities on relational databases consisting of multiple tables. Embeddings help to capture semantics encoded in the database and can be us…

Missing ValuesRepresentation Learning