Weakly Supervised Word Segmentation for Computational Language Documentation
Word and morpheme segmentation are fundamental steps of language documentation as they allow to discover lexical units in a language for which the lexicon is unknown. However, in most language documentation scenarios, linguists do not start from a blank page: they may already have a pre-existing dictionary or have initiated manual segmentation of a small part of their data. This paper studies how such a weak supervision can be taken advantage of in Bayesian non-parametric models of segmentation. Our experiments on two very low resource languages (Mboshi and Japhug), whose documentation is still in progress, show that weak supervision can be beneficial to the segmentation quality. In addition, we investigate an incremental learning scenario where manual segmentations are provided in a sequential manner. This work opens the way for interactive annotation tools for documentary linguists.
Code (1)
Tasks
Incremental LearningSegmentationSimilar Papers 제목 키워드 기반
Associating Inter-Image Salient Instances for Weakly Supervised Semantic Segmentation
Effectively bridging between image level keyword annotations and corresponding image pixels is one of the main challenges in weakly supervised semantic segmentation. In this paper, we use an instance-level salient object…
Clusteringgraph partitioningImage-level Supervised Instance SegmentationInstance Segmentation+6Language Segmentation
Language segmentation consists in finding the boundaries where one language ends and another language begins in a text written in more than one language. This is important for all natural language processing tasks. The p…
ClusteringLanguage ModelingLanguage ModellingSegmentation+1Word Embedding Dimension Reduction via Weakly-Supervised Feature Selection
As a fundamental task in natural language processing, word embedding converts each word into a representation in a vector space. A challenge with word embedding is that as the vocabulary grows, the vector space's dimensi…
Dimensionality Reductionfeature selectionMulti-class ClassificationSentence+1Weakly Supervised Referring Image Segmentation with Intra-Chunk and Inter-Chunk Consistency
Referring image segmentation (RIS) aims to localize the object in an image referred by a natural language expression. Most previous studies learn RIS with a large-scale dataset containing segmentation labels, but the…
Image SegmentationImage-text matchingObjectSemantic Segmentation+2DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon
Finding word boundaries in continuous speech is challenging as there is little or no equivalent of a 'space' delimiter between words. Popular Bayesian non-parametric models for text segmentation use a Dirichlet process t…
Language ModelingLanguage ModellingSegmentationText Segmentation