paper-with-me

Papers

ClassContrast: Bridging the Spatial and Contextual Gaps for Node Representations

2024-10-03 · Md Joshem Uddin, Astrit Tola, Varin Sikand, Cuneyt Gurcan Akcora, Baris Coskunuzer

Graph Neural Networks (GNNs) have revolutionized the domain of graph representation learning by utilizing neighborhood aggregation schemes in many popular architectures, such as message passing graph neural networks (MPGNNs). This scheme involves iteratively calculating a node's representation vector by aggregating and transforming the representation vectors of its adjacent nodes. Despite their effectiveness, MPGNNs face significant issues, such as oversquashing, oversmoothing, and underreaching, which hamper their effectiveness. Additionally, the reliance of MPGNNs on the homophily assumption, where edges typically connect nodes with similar labels and features, limits their performance in heterophilic contexts, where connected nodes often have significant differences. This necessitates the development of models that can operate effectively in both homophilic and heterophilic settings. In this paper, we propose a novel approach, ClassContrast, grounded in Energy Landscape Theory from Chemical Physics, to overcome these limitations. ClassContrast combines spatial and contextual information, leveraging a physics-inspired energy landscape to model node embeddings that are both discriminative and robust across homophilic and heterophilic settings. Our approach introduces contrast-based homophily matrices to enhance the understanding of class interactions and tendencies. Through extensive experiments, we demonstrate that ClassContrast outperforms traditional GNNs in node classification and link prediction tasks, proving its effectiveness and versatility in diverse real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2410.02158

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningLink PredictionNode ClassificationRepresentation Learning

Similar Papers 제목 키워드 기반

Cultural Re-contextualization of Fairness Research in Language Technologies in India

2022-11-21 · Shaily Bhatt, Sunipa Dev, Partha Talukdar, Shachi Dave 외

Recent research has revealed undesirable biases in NLP data and models. However, these efforts largely focus on social disparities in the West, and are not directly portable to other geo-cultural contexts. In this positi…

FairnessPosition

Self-Supervised Learning of Contextual Embeddings for Link Prediction in Heterogeneous Networks

2020-07-22 · Ping Wang, Khushbu Agarwal, Colby Ham, Sutanay Choudhury 외

Representation learning methods for heterogeneous networks produce a low-dimensional vector embedding for each node that is typically fixed for all tasks involving the node. Many of the existing methods focus on obtainin…

Link PredictionRepresentation LearningSelf-Supervised Learning

Bridging the Gap: Transforming Natural Language Questions into SQL Queries via Abstract Query Pattern and Contextual Schema Markup

2025-02-20 · Yonghui Kong, Hongbing Hu, Dan Zhang, Siyuan Chai 외

Large language models have demonstrated excellent performance in many tasks, including Text-to-SQL, due to their powerful in-context learning capabilities. They are becoming the mainstream approach for Text-to-SQL. Howev…

In-Context LearningText to SQLText-To-SQL

Stochastic Graph Bandit Learning with Side-Observations

2023-08-29 · Xueping Gong, Jiheng Zhang

In this paper, we investigate the stochastic contextual bandit with general function space and graph feedback. We propose an algorithm that addresses this problem by adapting to both the underlying graph structures and r…

Computational EfficiencyMulti-Armed Bandits

Rewrite Caption Semantics: Bridging Semantic Gaps for Language-Supervised Semantic Segmentation

2023-09-24 · NeurIPS 2023 11 · Yun Xing, Jian Kang, Aoran Xiao, Jiahao Nie 외

Vision-Language Pre-training has demonstrated its remarkable zero-shot recognition ability and potential to learn generalizable visual representations from language supervision. Taking a step ahead, language-supervised s…

SegmentationSemantic SegmentationZero-Shot Learning