paper-with-me

Papers

RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification

2023-08-04 · Zhengyang Mao, Wei Ju, Yifang Qin, Xiao Luo, Ming Zhang

Graph classification is a crucial task in many real-world multimedia applications, where graphs can represent various multimedia data types such as images, videos, and social networks. Previous efforts have applied graph neural networks (GNNs) in balanced situations where the class distribution is balanced. However, real-world data typically exhibit long-tailed class distributions, resulting in a bias towards the head classes when using GNNs and limited generalization ability over the tail classes. Recent approaches mainly focus on re-balancing different classes during model training, which fails to explicitly introduce new knowledge and sacrifices the performance of the head classes. To address these drawbacks, we propose a novel framework called Retrieval Augmented Hybrid Network (RAHNet) to jointly learn a robust feature extractor and an unbiased classifier in a decoupled manner. In the feature extractor training stage, we develop a graph retrieval module to search for relevant graphs that directly enrich the intra-class diversity for the tail classes. Moreover, we innovatively optimize a category-centered supervised contrastive loss to obtain discriminative representations, which is more suitable for long-tailed scenarios. In the classifier fine-tuning stage, we balance the classifier weights with two weight regularization techniques, i.e., Max-norm and weight decay. Experiments on various popular benchmarks verify the superiority of the proposed method against state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2308.02335

Code (0)

등록된 구현이 없습니다.

Tasks

Graph ClassificationRetrieval

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Supervised Contrastive Loss 설명 없음

Similar Papers 제목 키워드 기반

From Retrieval to Generation: Comparing Different Approaches

2025-02-27 · Abdelrahman Abdallah, Jamshid Mozafari, Bhawna Piryani, Mohammed Ali 외

Knowledge-intensive tasks, particularly open-domain question answering (ODQA), document reranking, and retrieval-augmented language modeling, require a balance between retrieval accuracy and generative flexibility. Tradi…

Language ModelingLanguage ModellingOpen-Domain Question AnsweringPassage Retrieval+4

Agri-Query: A Case Study on RAG vs. Long-Context LLMs for Cross-Lingual Technical Question Answering

2025-08-25 · Julius Gun, Timo Oksanen arxiv

We present a case study evaluating large language models (LLMs) with 128K-token context windows on a technical question answering (QA) task. Our benchmark is built on a user manual for an agricultural machine, available …

Information RetrievalQuestion Answering

Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization

2025-04-17 · Adithya Pratapa, Teruko Mitamura

Recent advances in long-context reasoning abilities of language models led to interesting applications in large-scale multi-document summarization. However, prior work has shown that these long-context models are not eff…

Document SummarizationMulti-Document SummarizationRAGRetrieval

EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation

2026-01-29 · Lang Cao, Qingyu Chen, Yue Guo arxiv

Electronic Health Records (EHRs) provide rich longitudinal clinical evidence that is central to medical decision-making, motivating the use of retrieval-augmented generation (RAG) to ground large language model (LLM) pre…

LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searchers

2025-02-25 · Zhuocheng Zhang, Yang Feng, Min Zhang

Retrieval-Augmented Generation (RAG) is a crucial method for mitigating hallucinations in Large Language Models (LLMs) and integrating external knowledge into their responses. Existing RAG methods typically employ query …

Multi-hop Question AnsweringQuestion AnsweringRAGRetrieval+1