paper-with-me

홈 › Papers

Graph Triple Attention Network: A Decoupled Perspective

2024-08-14 · Xiaotang Wang, Yun Zhu, Haizhou Shi, Yongchao Liu, Chuntao Hong

Graph Transformers (GTs) have recently achieved significant success in the graph domain by effectively capturing both long-range dependencies and graph inductive biases. However, these methods face two primary challenges: (1) multi-view chaos, which results from coupling multi-view information (positional, structural, attribute), thereby impeding flexible usage and the interpretability of the propagation process. (2) local-global chaos, which arises from coupling local message passing with global attention, leading to issues of overfitting and over-globalizing. To address these challenges, we propose a high-level decoupled perspective of GTs, breaking them down into three components and two interaction levels: positional attention, structural attention, and attribute attention, alongside local and global interaction. Based on this decoupled perspective, we design a decoupled graph triple attention network named DeGTA, which separately computes multi-view attentions and adaptively integrates multi-view local and global information. This approach offers three key advantages: enhanced interpretability, flexible design, and adaptive integration of local and global information. Through extensive experiments, DeGTA achieves state-of-the-art performance across various datasets and tasks, including node classification and graph classification. Comprehensive ablation studies demonstrate that decoupling is essential for improving performance and enhancing interpretability. Our code is available at: https://github.com/wangxiaotang0906/DeGTA

📄 PDF Abstract BibTeX arXiv:2408.07654

Code (1)

wangxiaotang0906/degta 공식 구현 pytorch

Tasks

AttributeGraph ClassificationNode Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

DDS: Decoupled Dynamic Scene-Graph Generation Network

2023-01-18 · A S M Iftekhar, Raphael Ruschel, Satish Kumar, Suya You 외

Scene-graph generation involves creating a structural representation of the relationships between objects in a scene by predicting subject-object-relation triplets from input data. Existing methods show poor performance …

Graph GenerationObjectScene Graph Generation

Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspective

2024-02-13 · Kai Guo, Hongzhi Wen, Wei Jin, Yaming Guo 외

Graph neural networks (GNNs) have exhibited remarkable performance under the assumption that test data comes from the same distribution of training data. However, in real-world scenarios, this assumption may not always b…

Out-of-Distribution Generalization

Decouple Before Interact: Multi-Modal Prompt Learning for Continual Visual Question Answering

2023-01-01 · ICCV 2023 1 · Zi Qian, Xin Wang, Xuguang Duan, Pengda Qin 외

In the real world, a desirable Visual Question Answering model is expected to provide correct answers to new questions and images in a continual setting (recognized as CL-VQA). However, existing works formulate CLVQA…

Continual LearningLanguage ModellingPrompt LearningQuestion Answering+3

UniQ: Unified Decoder with Task-specific Queries for Efficient Scene Graph Generation

2025-01-10 · Xinyao Liao, Wei Wei, Dangyang Chen, Yuanyuan Fu

Scene Graph Generation(SGG) is a scene understanding task that aims at identifying object entities and reasoning their relationships within a given image. In contrast to prevailing two-stage methods based on a large obje…

DecoderGraph GenerationObjectScene Graph Generation+2

SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classification

2026-01-19 · Xu Xiaodan, Hu Xiaolin arxiv

Knowledge Graphs~(KGs) often suffer from unreliable knowledge, which restricts their utility. Triple Classification~(TC) aims to determine the validity of triples from KGs. Recently, text-based methods learn entity and r…

Representation LearningBinary ClassificationTriple ClassificationContrastive Learning