paper-with-me

Papers

SaVe-TAG: Semantic-aware Vicinal Risk Minimization for Long-Tailed Text-Attributed Graphs

2024-10-22 · Leyao Wang, Yu Wang, Bo Ni, Yuying Zhao, Hanyu Wang, Yao Ma, Tyler Derr

Real-world graph data often follows long-tailed distributions, making it difficult for Graph Neural Networks (GNNs) to generalize well across both head and tail classes. Recent advances in Vicinal Risk Minimization (VRM) have shown promise in mitigating class imbalance with numeric interpolation; however, existing approaches largely rely on embedding-space arithmetic, which fails to capture the rich semantics inherent in text-attributed graphs. In this work, we propose our method, SaVe-TAG (Semantic-aware Vicinal Risk Minimization for Long-Tailed Text-Attributed Graphs), a novel VRM framework that leverages Large Language Models (LLMs) to perform text-level interpolation, generating on-manifold, boundary-enriching synthetic samples for minority classes. To mitigate the risk of noisy generation, we introduce a confidence-based edge assignment mechanism that uses graph topology as a natural filter to ensure structural consistency. We provide theoretical justification for our method and conduct extensive experiments on benchmark datasets, showing that our approach consistently outperforms both numeric interpolation and prior long-tailed node classification baselines. Our results highlight the importance of integrating semantic and structural signals for balanced and effective learning on text-attributed graphs.

📄 PDF Abstract BibTeX arXiv:2410.16882

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationData AugmentationLanguage ModelingLanguage ModellingLarge Language ModelNode ClassificationTAG

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Generalization Bounds for Vicinal Risk Minimization Principle

2018-11-11 · Chao Zhang, Min-Hsiu Hsieh, DaCheng Tao

The vicinal risk minimization (VRM) principle, first proposed by \citet{vapnik1999nature}, is an empirical risk minimization (ERM) variant that replaces Dirac masses with vicinal functions. Although there is strong numer…

Generalization Bounds

Exploring Vicinal Risk Minimization for Lightweight Out-of-Distribution Detection

2020-12-15 · Deepak Ravikumar, Sangamesh Kodge, Isha Garg, Kaushik Roy

Deep neural networks have found widespread adoption in solving complex tasks ranging from image recognition to natural language processing. However, these networks make confident mispredictions when presented with data t…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

On the benefits of defining vicinal distributions in latent space

2020-03-14 · Puneet Mangla, Vedant Singh, Shreyas Jayant Havaldar, Vineeth N. Balasubramanian

The vicinal risk minimization (VRM) principle is an empirical risk minimization (ERM) variant that replaces Dirac masses with vicinal functions. There is strong numerical and theoretical evidence showing that VRM outperf…

Enhancing Generalization in Evolutionary Feature Construction for Symbolic Regression through Vicinal Jensen Gap Minimization

2026-02-02 · Hengzhe Zhang, Qi Chen, Bing Xue, Wolfgang Banzhaf 외 arxiv

Genetic programming-based feature construction has achieved significant success in recent years as an automated machine learning technique to enhance learning performance. However, overfitting remains a challenge that li…

Intrusion DetectionData AugmentationNoise Estimation

Invariance Principle Meets Vicinal Risk Minimization

2024-07-08 · Yaoyao Zhu, Xiuding Cai, Yingkai Wang, Dong Miao 외

Deep learning models excel in computer vision tasks but often fail to generalize to out-of-distribution (OOD) domains. Invariant Risk Minimization (IRM) aims to address OOD generalization by learning domain-invariant fea…

Data AugmentationDiversityDomain Generalization