Parallel Sentence Mining by Constrained Decoding
We present a novel method to extract parallel sentences from two monolingual corpora, using neural machine translation. Our method relies on translating sentences in one corpus, but constraining the decoding by a prefix tree built on the other corpus. We argue that a neural machine translation system by itself can be a sentence similarity scorer and it efficiently approximates pairwise comparison with a modified beam search. When benchmarked on the BUCC shared task, our method achieves results comparable to other submissions.
Code (1)
Tasks
Cross-Lingual Bitext MiningMachine TranslationParallel Corpus MiningSentenceSentence SimilaritySimilar Papers 제목 키워드 기반
Unsupervised Parallel Sentence Extraction with Parallel Segment Detection Helps Machine Translation
Mining parallel sentences from comparable corpora is important. Most previous work relies on supervised systems, which are trained on parallel data, thus their applicability is problematic in low-resource scenarios. Rece…
Machine TranslationSentenceTranslationWord EmbeddingsA Japanese-Chinese Parallel Corpus Using Crowdsourcing for Web Mining
Using crowdsourcing, we collected more than 10,000 URL pairs (parallel top page pairs) of bilingual websites that contain parallel documents and created a Japanese-Chinese parallel corpus of 4.6M sentence pairs from thes…
SentenceTranslationWord TranslationEnd-to-End Argument Mining for Discussion Threads Based on Parallel Constrained Pointer Architecture
Argument Mining (AM) is a relatively recent discipline, which concentrates on extracting claims or premises from discourses, and inferring their structures. However, many existing works do not consider micro-level AM stu…
Argument MiningSentenceEdit-Constrained Decoding for Sentence Simplification
We propose edit operation based lexically constrained decoding for sentence simplification. In sentence simplification, lexical paraphrasing is one of the primary procedures for rewriting complex sentences into simpler c…
SentenceParallel Refinements for Lexically Constrained Text Generation with BART
Lexically constrained text generation aims to control the generated text by incorporating some pre-specified keywords into the output. Previous work injects lexical constraints into the output by controlling the decoding…
DecoderDiversitySentenceText Generation