Efficient Two-Step Networks for Temporal Action Segmentation
Due to boundary ambiguity and over-segmentation issues, identifying all the frames in long untrimmed videos is still challenging. To address these problems, we present the Efficient Two-Step Network (ETSN) with two components. The first step of ETSN is Efficient Temporal Series Pyramid Networks (ETSPNet) that capture both local and global frame-level features and provide accurate predictions of segmentation boundaries. The second step is a novel unsupervised approach called Local Burr Suppression (LBS), which significantly reduces the over-segmentation errors. Our empirical evaluations on the benchmarks including 50Salads, GTEA and Breakfast dataset demonstrate that ETSN outperforms the current state-of-the-art methods by a large margin.
Code (1)
Tasks
Action SegmentationSegmentationTemporal Action SegmentationVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
Streaming Video Temporal Action Segmentation In Real Time
Temporal action segmentation (TAS) is a critical step toward long-term video understanding. Recent studies follow a pattern that builds models based on features instead of raw video picture information. However, we claim…
Action SegmentationLanguage ModellingSegmentationTemporal Action Segmentation+1O-TALC: Steps Towards Combating Oversegmentation within Online Action Segmentation
Online temporal action segmentation shows a strong potential to facilitate many HRI tasks where extended human action sequences must be tracked and understood in real time. Traditional action segmentation approaches, how…
Action RecognitionAction SegmentationSegmentationSpatio-temporal Action Recognition+1Temporal Convolutional Networks: A Unified Approach to Action Segmentation
The dominant paradigm for video-based action segmentation is composed of two steps: first, for each frame, compute low-level features using Dense Trajectories or a Convolutional Neural Network that encode spatiotemporal …
Action SegmentationSegmentationTAEC: Unsupervised Action Segmentation with Temporal-Aware Embedding and Clustering
Temporal action segmentation in untrimmed videos has gained increased attention recently. However, annotating action classes and frame-wise boundaries is extremely time consuming and cost intensive, especially on large-s…
Action SegmentationClusteringSegmentationTemporal Action Segmentation+1Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer
Hand hygiene is a standard six-step hand-washing action proposed by the World Health Organization (WHO). However, there is no good way to supervise medical staff to do hand hygiene, which brings the potential risk of dis…
Action AssessmentSegmentation