paper-with-me

Papers

Optimal Partial Transport Based Sentence Selection for Long-form Document Matching

2022-10-01 · COLING 2022 10 · Weijie Yu, Liang Pang, Jun Xu, Bing Su, Zhenhua Dong, Ji-Rong Wen

One typical approach to long-form document matching is first conducting alignment between cross-document sentence pairs, and then aggregating all of the sentence-level matching signals. However, this approach could be problematic because the alignment between documents is partial — despite two documents as a whole are well-matched, most of the sentences could still be dissimilar. Those dissimilar sentences lead to spurious sentence-level matching signals which may overwhelm the real ones, increasing the difficulties of learning the matching function. Therefore, accurately selecting the key sentences for document matching is becoming a challenging issue. To address the issue, we propose a novel matching approach that equips existing document matching models with an Optimal Partial Transport (OPT) based component, namely OPT-Match, which selects the sentences that play a major role in matching. Enjoying the partial transport properties of OPT, the selected key sentences can not only effectively enhance the matching accuracy, but also be explained as the rationales for the matching results. Extensive experiments on four publicly available datasets demonstrated that existing methods equipped with OPT-Match consistently outperformed the corresponding underlying methods. Evaluations also showed that the key sentences selected by OPT-Match were consistent with human-provided rationales.

📄 PDF Abstract BibTeX

Code (1)

ruc-wjyu/opt-match 공식 구현 pytorch

Tasks

FormSentence

Methods 이 논문이 사용한 방법론

OPT OPT is a suite of decoder-only pre-trained transformers ranging from 125M to 175B parameters. The model uses an AdamW optimizer and weight decay of 0.1. It follows a linear…

Similar Papers 제목 키워드 기반

Semantic Matching for Sequence-to-Sequence Learning

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Ruiyi Zhang, Changyou Chen, Xinyuan Zhang, Ke Bai 외

In sequence-to-sequence models, classical optimal transport (OT) can be applied to semantically match generated sentences with target sentences. However, in non-parallel settings, target sentences are usually unavailable…

Online Learning to Transport via the Minimal Selection Principle

2022-02-09 · Wenxuan Guo, YoonHaeng Hur, Tengyuan Liang, Christopher Ryan

Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional objec…

Holistic Optimal Label Selection for Robust Prompt Learning under Partial Labels

2026-04-08 · Yaqi Zhao, Haoliang Sun, Yating Wang, Yongshun Gong 외 arxiv

Prompt learning has gained significant attention as a parameter-efficient approach for adapting large pre-trained vision-language models to downstream tasks. However, when only partial labels are available, its performan…

Improving Sequence-to-Sequence Learning via Optimal Transport

2019-01-18 · ICLR 2019 5 · Liqun Chen, Yizhe Zhang, Ruiyi Zhang, Chenyang Tao 외

Sequence-to-sequence models are commonly trained via maximum likelihood estimation (MLE). However, standard MLE training considers a word-level objective, predicting the next word given the previous ground-truth partial …

Abstractive Text SummarizationImage CaptioningMachine TranslationSentence+2

Unbalanced Optimal Transport for Unbalanced Word Alignment

2023-06-07 · Yuki Arase, Han Bao, Sho Yokoi

Monolingual word alignment is crucial to model semantic interactions between sentences. In particular, null alignment, a phenomenon in which words have no corresponding counterparts, is pervasive and critical in handling…

Semantic SimilaritySemantic Textual SimilarityWord Alignment