Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing
A common recent approach to semantic parsing augments sequence-to-sequence models by retrieving and appending a set of training samples, called exemplars. The effectiveness of this recipe is limited by the ability to retrieve informative exemplars that help produce the correct parse, which is especially challenging in low-resource settings. Existing retrieval is commonly based on similarity of query and exemplar inputs. We propose GandR, a retrieval procedure that retrieves exemplars for which outputs are also similar. GandRfirst generates a preliminary prediction with input-based retrieval. Then, it retrieves exemplars with outputs similar to the preliminary prediction which are used to generate a final prediction. GandR sets the state of the art on multiple low-resource semantic parsing tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionRetrievalSemantic ParsingSimilar Papers 제목 키워드 기반
You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM
Retrieval-enhanced language models (LMs), which condition their predictions on text retrieved from large external datastores, have recently shown significant perplexity improvements compared to standard LMs. One such app…
Language ModelingLanguage ModellingRetrievalSemantic Similarity+1You Only Use Reactive Attention Slice For Long Context Retrieval
Supporting longer context for Large Language Models (LLM) is a promising direction to advance LLMs. As training a model for a longer context window is computationally expensive, many alternative solutions, such as Retrie…
RAGRetrievalRetrieval-augmented GenerationSentenceJina CLIP: Your CLIP Model Is Also Your Text Retriever
Contrastive Language-Image Pretraining (CLIP) is widely used to train models to align images and texts in a common embedding space by mapping them to fixed-sized vectors. These models are key to multimodal information re…
Information RetrievalRetrievalText RetrievalLVLM-Aware Multimodal Retrieval for RAG-Based Medical Diagnosis with General-Purpose Models
Retrieving visual and textual information from medical literature and hospital records can enhance diagnostic accuracy for clinical image interpretation. However, multimodal retrieval-augmented diagnosis is highly challe…
Medical DiagnosisEmpirical evaluation of Uncertainty Quantification in Retrieval-Augmented Language Models for Science
Large language models (LLMs) have shown remarkable achievements in natural language processing tasks, producing high-quality outputs. However, LLMs still exhibit limitations, including the generation of factually incorre…
RetrievalUncertainty Quantification