A Sentence Meaning Based Alignment Method for Parallel Text Corpora Preparation
Text alignment is crucial to the accuracy of Machine Translation (MT) systems, some NLP tools or any other text processing tasks requiring bilingual data. This research proposes a language independent sentence alignment approach based on Polish (not position-sensitive language) to English experiments. This alignment approach was developed on the TED Talks corpus, but can be used for any text domain or language pair. The proposed approach implements various heuristics for sentence recognition. Some of them value synonyms and semantic text structure analysis as a part of additional information. Minimization of data loss was ensured. The solution is compared to other sentence alignment implementations. Also an improvement in MT system score with text processed with described tool is shown.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationPositionSentenceTranslationSimilar Papers 제목 키워드 기반
TS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora
We introduce TS-ANNO, an open-source web application for manual creation and for evaluation of parallel corpora for text simplification. TS-ANNO can be used for i) sentence–wise alignment, ii) rating alignment pairs (e.g…
SentenceText SimplificationGraph Neural Networks for Multiparallel Word Alignment
After a period of decrease, interest in word alignments is increasing again for their usefulness in domains such as typological research, cross-lingual annotation projection, and machine translation. Generally, alignment…
Community DetectionMachine TranslationTranslationWord AlignmentGraph Neural Networks for Multiparallel Word Alignment
After a period of decrease, interest in word alignments is increasing again for their usefulness in domains such as typological research, cross-lingual annotation projection and machine translation. Generally, alignment …
Community DetectionMachine TranslationWord AlignmentParallel Sentence Retrieval From Comparable Corpora for Biomedical Text Simplification
Parallel sentences provide semantically similar information which can vary on a given dimension, such as language or register. Parallel sentences with register variation (like expert and non-expert documents) can be expl…
Binary ClassificationRetrievalSentenceSentence Retrieval+1Vicinity-Driven Paragraph and Sentence Alignment for Comparable Corpora
Parallel corpora have driven great progress in the field of Text Simplification. However, most sentence alignment algorithms either offer a limited range of alignment types supported, or simply ignore valuable clues pres…
SentenceText Simplification