paper-with-me

Papers

Optimizing example selection for retrieval-augmented machine translation with translation memories

2024-05-23 · Maxime Bouthors, Josep Crego, François Yvon

Retrieval-augmented machine translation leverages examples from a translation memory by retrieving similar instances. These examples are used to condition the predictions of a neural decoder. We aim to improve the upstream retrieval step and consider a fixed downstream edit-based model: the multi-Levenshtein Transformer. The task consists of finding a set of examples that maximizes the overall coverage of the source sentence. To this end, we rely on the theory of submodular functions and explore new algorithms to optimize this coverage. We evaluate the resulting performance gains for the machine translation task.

📄 PDF Abstract BibTeX arXiv:2405.15070

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMachine TranslationRetrievalSentenceTranslation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Optimizing Knowledge Integration in Retrieval-Augmented Generation with Self-Selection

2025-02-10 · Yan Weng, Fengbin Zhu, Tong Ye, Haoyan Liu 외

Retrieval-Augmented Generation (RAG), which integrates external knowledge into Large Language Models (LLMs), has proven effective in enabling LLMs to produce more accurate and reliable responses. However, it remains a si…

Natural QuestionsRAGRetrievalRetrieval-augmented Generation

Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparison

2024-04-03 · Maxime Bouthors, Josep Crego, Francois Yvon

Retrieval-Augmented Neural Machine Translation (RAMT) architectures retrieve examples from memory to guide the generation process. While most works in this trend explore new ways to exploit the retrieved examples, the up…

DiversityIn-Context LearningLanguage ModelingLanguage Modelling+4

Retrieval-Augmented Few-Shot Prompting Versus Fine-Tuning for Code Vulnerability Detection

2025-11-28 · Fouad Trad, Ali Chehab arxiv

Few-shot prompting has emerged as a practical alternative to fine-tuning for leveraging the capabilities of large language models (LLMs) in specialized tasks. However, its effectiveness depends heavily on the selection a…

Vulnerability Detection

Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models

2024-04-30 · Alireza Salemi, Hamed Zamani

This paper introduces uRAG--a framework with a unified retrieval engine that serves multiple downstream retrieval-augmented generation (RAG) systems. Each RAG system consumes the retrieval results for a unique purpose, s…

Entity LinkingFact VerificationOpen-Domain Question AnsweringQuestion Answering+4

Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization

2026-01-17 · Linfeng Du, Ye Yuan, Zichen Zhao, Fuyuan Lyu 외 arxiv

Large language models (LLMs) excel at general-purpose tasks, yet adapting their responses to individual users remains challenging. Retrieval augmentation provides a lightweight alternative to fine-tuning by conditioning …