Sign Segmentation with Changepoint-Modulated Pseudo-Labelling
The objective of this work is to find temporal boundaries between signs in continuous sign language. Motivated by the paucity of annotation available for this task, we propose a simple yet effective algorithm to improve segmentation performance on unlabelled signing footage from a domain of interest. We make the following contributions: (1) We motivate and introduce the task of source-free domain adaptation for sign language segmentation, in which labelled source data is available for an initial training phase, but is not available during adaptation. (2) We propose the Changepoint-Modulated Pseudo-Labelling (CMPL) algorithm to leverage cues from abrupt changes in motion-sensitive feature space to improve pseudo-labelling quality for adaptation. (3) We showcase the effectiveness of our approach for category-agnostic sign segmentation, transferring from the BSLCORPUS to the BSL-1K and RWTH-PHOENIX-Weather 2014 datasets, where we outperform the prior state of the art.
Code (1)
Tasks
Domain AdaptationSegmentationSource-Free Domain AdaptationSimilar Papers 제목 키워드 기반
Expectation Maximization Pseudo Labels
In this paper, we study pseudo-labelling. Pseudo-labelling employs raw inferences on unlabelled data as pseudo-labels for self-training. We elucidate the empirical successes of pseudo-labelling by establishing a link bet…
SegmentationBayesian Pseudo Labels: Expectation Maximization for Robust and Efficient Semi-Supervised Segmentation
This paper concerns pseudo labelling in segmentation. Our contribution is fourfold. Firstly, we present a new formulation of pseudo-labelling as an Expectation-Maximization (EM) algorithm for clear statistical interpreta…
Image SegmentationMedical Image SegmentationPseudo LabelSegmentation+3Domain Adaptive Video Segmentation via Temporal Pseudo Supervision
Video semantic segmentation has achieved great progress under the supervision of large amounts of labelled training data. However, domain adaptive video segmentation, which can mitigate data labelling constraints by adap…
SegmentationSemantic SegmentationVideo SegmentationVideo Semantic SegmentationPseudo Labelling for Enhanced Masked Autoencoders
Masked Image Modeling (MIM)-based models, such as SdAE, CAE, GreenMIM, and MixAE, have explored different strategies to enhance the performance of Masked Autoencoders (MAE) by modifying prediction, loss functions, or inc…
Semantic SegmentationUnsupervised Offline Changepoint Detection Ensembles
Offline changepoint detection (CPD) algorithms are used for signal segmentation in an optimal way. Generally, these algorithms are based on the assumption that signal’s changed statistical properties are known, and the a…
Anomaly DetectionChange Point DetectionModel SelectionOutlier Detection