Long-Tail Temporal Action Segmentation with Group-wise Temporal Logit Adjustment
Procedural activity videos often exhibit a long-tailed action distribution due to varying action frequencies and durations. However, state-of-the-art temporal action segmentation methods overlook the long tail and fail to recognize tail actions. Existing long-tail methods make class-independent assumptions and struggle to identify tail classes when applied to temporal segmentation frameworks. This work proposes a novel group-wise temporal logit adjustment~(G-TLA) framework that combines a group-wise softmax formulation while leveraging activity information and action ordering for logit adjustment. The proposed framework significantly improves in segmenting tail actions without any performance loss on head actions.
Code (1)
Tasks
Action SegmentationSegmentationTemporal Action SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cost-Sensitive Learning for Long-Tailed Temporal Action Segmentation
Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration…
Action SegmentationSegmentationTemporal Action SegmentationLOGO: A Long-Form Video Dataset for Group Action Quality Assessment
Action quality assessment (AQA) has become an emerging topic since it can be extensively applied in numerous scenarios. However, most existing methods and datasets focus on single-person short-sequence scenes, hindering …
Action Quality AssessmentAction SegmentationFormTemporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation
Action segmentation refers to inferring boundaries of semantically consistent visual concepts in videos and is an important requirement for many video understanding tasks. For this and other video understanding tasks, su…
Action SegmentationClusteringSegmentationUnsupervised Action Segmentation+1Learning unbiased group-wise registration (LUGR) and joint segmentation: evaluation on longitudinal diffusion MRI
Analysis of longitudinal changes in imaging studies often involves both segmentation of structures of interest and registration of multiple timeframes. The accuracy of such analysis could benefit from a tailored framewor…
Diffusion MRIHow Much Temporal Long-Term Context is Needed for Action Segmentation?
Modeling long-term context in videos is crucial for many fine-grained tasks including temporal action segmentation. An interesting question that is still open is how much long-term temporal context is needed for optimal …
Action SegmentationSegmentationTemporal Action Segmentation