Unsupervised Term Discovery for Continuous Sign Language
Most of the sign language recognition (SLR) systems rely on supervision for training and available annotated sign language resources are scarce due to the difficulties of manual labeling. Unsupervised discovery of lexical units would facilitate the annotation process and thus lead to better SLR systems. Inspired by the unsupervised spoken term discovery in speech processing field, we investigate whether a similar approach can be applied in sign language to discover repeating lexical units. We adapt an algorithm that is designed for spoken term discovery by using hand shape and pose features instead of speech features. The experiments are run on a large scale continuous sign corpus and the performance is evaluated using gloss level annotations. This work introduces a new task for sign language processing that has not been addressed before.
Code (0)
등록된 구현이 없습니다.
Tasks
Sign Language RecognitionSimilar Papers 제목 키워드 기반
Unsupervised Discovery of Sign Terms by K-Nearest Neighbours Approach
In order to utilize the large amount of unlabeled sign language resources, unsupervised learning methods are needed. Motivated by the successful results of unsupervised term discovery (UTD) in spoken languages, here w…
Bridging the gap between speech technology and natural language processing: an evaluation toolbox for term discovery systems
The unsupervised discovery of linguistic terms from either continuous phoneme transcriptions or from raw speech has seen an increasing interest in the past years both from a theoretical and a practical standpoint. Yet, t…
Language AcquisitionUnsupervised Story Discovery from Continuous News Streams via Scalable Thematic Embedding
Unsupervised discovery of stories with correlated news articles in real-time helps people digest massive news streams without expensive human annotations. A common approach of the existing studies for unsupervised online…
ArticlesSentenceUnsupervised Discovery of Continuous Skills on a Sphere
Recently, methods for learning diverse skills to generate various behaviors without external rewards have been actively studied as a form of unsupervised reinforcement learning. However, most of the existing methods lear…
MuJoCoUnsupervised Reinforcement LearningUnsupervised Lexicon Discovery from Acoustic Input
We present a model of unsupervised phonological lexicon discovery{---}the problem of simultaneously learning phoneme-like and word-like units from acoustic input. Our model builds on earlier models of unsupervised phone-…
Language AcquisitionSpeech Recognition