Simultaneous Sentence Boundary Detection and Alignment with Pivot-based Machine Translation Generated Lexicons
Sentence alignment is a task that consists in aligning the parallel sentences in a translated article pair. This paper describes a method to perform sentence boundary detection and alignment simultaneously, which significantly improves the alignment accuracy on languages like Chinese with uncertain sentence boundaries. It relies on the definition of hard (certain) and soft (uncertain) punctuation delimiters, the latter being possibly ignored to optimize the alignment result. The alignment method is used in combination with lexicons automatically generated from the input article pairs using pivot-based MT, achieving better coverage of the input words with fewer entries than pre-existing dictionaries. Pivot-based MT makes it possible to build dictionaries for language pairs that have scarce parallel data. The alignment method is implemented in a tool that will be freely available in the near future.
Code (0)
등록된 구현이 없습니다.
Tasks
Boundary DetectionMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
Dynamic Sentence Boundary Detection for Simultaneous Translation
Simultaneous Translation is a great challenge in which translation starts before the source sentence finished. Most studies take transcription as input and focus on balancing translation quality and latency for each sent…
Boundary DetectionMulti-class ClassificationSentenceTranslationBilingual Sentence Alignment of a Parallel Corpus by Using English as a Pivot Language
Sentence Boundary Detection on Line Breaks in Japanese
For NLP, sentence boundary detection (SBD) is an essential task to decompose a text into sentences. Most of the previous studies have used a simple rule that uses only typical characters as sentence boundaries. However, …
Boundary DetectionSentenceBuilding a Better Bitext for Structurally Different Languages through Self-training
We propose a novel method to bootstrap the construction of parallel corpora for new pairs of structurally different languages. We do so by combining the use of a pivot language and self-training. A pivot language enables…
Information RetrievalMachine TranslationSentenceTranslationBAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos
Temporal sentence grounding aims to localize moments relevant to a language description. Recently, DETR-like approaches achieved notable progress by predicting the center and length of a target moment. However, they suff…
Moment RetrievalNatural Language Moment RetrievalSentenceTemporal Sentence Grounding