paper-with-me

Papers

Retrieval-Augmented Classification with Decoupled Representation

2023-03-23 · Xinnian Liang, Shuangzhi Wu, Hui Huang, Jiaqi Bai, Chao Bian, Zhoujun Li

Retrieval augmented methods have shown promising results in various classification tasks. However, existing methods focus on retrieving extra context to enrich the input, which is noise sensitive and non-expandable. In this paper, following this line, we propose a $k$-nearest-neighbor (KNN) -based method for retrieval augmented classifications, which interpolates the predicted label distribution with retrieved instances' label distributions. Different from the standard KNN process, we propose a decoupling mechanism as we find that shared representation for classification and retrieval hurts performance and leads to training instability. We evaluate our method on a wide range of classification datasets. Experimental results demonstrate the effectiveness and robustness of our proposed method. We also conduct extra experiments to analyze the contributions of different components in our model.\footnote{\url{https://github.com/xnliang98/knn-cls-w-decoupling}}

📄 PDF Abstract BibTeX arXiv:2303.13065

Code (1)

xnliang98/migbert 공식 구현

Tasks

ClassificationRetrieval

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Weight Decay 설명 없음
Adam 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

HeteRAG: A Heterogeneous Retrieval-augmented Generation Framework with Decoupled Knowledge Representations

2025-04-12 · Peiru Yang, Xintian Li, Zhiyang Hu, Jiapeng Wang 외

Retrieval-augmented generation (RAG) methods can enhance the performance of LLMs by incorporating retrieved knowledge chunks into the generation process. In general, the retrieval and generation steps usually have differ…

RAGRetrievalRetrieval-augmented Generation

RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classification

2023-08-04 · Zhengyang Mao, Wei Ju, Yifang Qin, Xiao Luo 외

Graph classification is a crucial task in many real-world multimedia applications, where graphs can represent various multimedia data types such as images, videos, and social networks. Previous efforts have applied graph…

Graph ClassificationRetrieval

RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction

2025-08-14 · Weilin Ruan, Xilin Dang, Ziyu Zhou, Sisuo Lyu 외 arxiv

Traffic prediction is a cornerstone of modern intelligent transportation systems and a critical task in spatio-temporal forecasting. Although advanced Spatio-temporal Graph Neural Networks (STGNNs) and pre-trained models…

Computational EfficiencyTraffic Prediction

Decoupled Context Processing for Context Augmented Language Modeling

2022-10-11 · Zonglin Li, Ruiqi Guo, Sanjiv Kumar

Language models can be augmented with a context retriever to incorporate knowledge from large external databases. By leveraging retrieved context, the neural network does not have to memorize the massive amount of world …

DecoderLanguage ModelingLanguage ModellingOpen-Domain Question Answering+3

Identity-Decoupled Anonymization for Visual Evidence in Multi-modal Retrieval-Augmented Generation

2026-04-26 · Zehua Cheng, Wei Dai, Jiahao Sun arxiv

Multi-modal retrieval-augmented generation (MRAG) systems retrieve visual evidence from large image corpora to ground the responses of large multi-modal models, yet the retrieved images frequently contain human faces who…

Face Recognition