TAMS: Translation-Assisted Morphological Segmentation
Canonical morphological segmentation is the process of analyzing words into the standard (aka underlying) forms of their constituent morphemes. This is a core task in language documentation, and NLP systems have the potential to dramatically speed up this process. But in typical language documentation settings, training data for canonical morpheme segmentation is scarce, making it difficult to train high quality models. However, translation data is often much more abundant, and, in this work, we present a method that attempts to leverage this data in the canonical segmentation task. We propose a character-level sequence-to-sequence model that incorporates representations of translations obtained from pretrained high-resource monolingual language models as an additional signal. Our model outperforms the baseline in a super-low resource setting but yields mixed results on training splits with more data. While further work is needed to make translations useful in higher-resource settings, our model shows promise in severely resource-constrained settings.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Efficient Track Anything
Segment Anything Model 2 (SAM 2) has emerged as a powerful tool for video object segmentation and tracking anything. Key components of SAM 2 that drive the impressive video object segmentation performance include a large…
ObjectSegmentationSemantic SegmentationVideo Object Segmentation+2BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages
Morphologically-rich polysynthetic languages present a challenge for NLP systems due to data sparsity, and a common strategy to handle this issue is to apply subword segmentation. We investigate a wide variety of supervi…
Machine TranslationSegmentationTranslationThe Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translation
This paper evaluates the performance of several modern subword segmentation methods in a low-resource neural machine translation setting. We compare segmentations produced by applying BPE at the token or sentence level w…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationSegmentation+2Knowledge extraction from aeronautical messages (NOTAMs) with self-supervised language models for aircraft pilots
During their pre-flight briefings, aircraft pilots must analyse a long list of NoTAMs (NOtice To AirMen) indicating potential hazards along the flight route, sometimes up to pages for long-haul flights. NOTAM free-text f…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Improving the Performance of Neural Machine Translation Involving Morphologically Rich Languages
The advent of the attention mechanism in neural machine translation models has improved the performance of machine translation systems by enabling selective lookup into the source sentence. In this paper, the efficiencie…
DecoderMachine TranslationSentenceTranslation