Papers Temporal Action Segmentation
“Temporal Action Segmentation” 태그가 달린 논문 62편 · 필터 해제
M2R2: MulitModal Robotic Representation for Temporal Action Segmentation
Temporal action segmentation (TAS) has long been a key area of research in both robotics and computer vision. In robotics, algorithms have primarily focused on leveraging proprioceptive information to determine skill bou…
Action SegmentationTemporal Action SegmentationTowards Generalizing Temporal Action Segmentation to Unseen Views
While there has been substantial progress in temporal action segmentation, the challenge to generalize to unseen views remains unaddressed. Hence, we define a protocol for unseen view action segmentation where camera vie…
Action SegmentationSegmentationTemporal Action SegmentationWhat Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learning
Understanding a procedural activity requires modeling both how action steps transform the scene, and how evolving scene transformations can influence the sequence of action steps, even those that are accidental or errone…
Action SegmentationcounterfactualCounterfactual ReasoningRepresentation Learning+1Cost-Sensitive Learning for Long-Tailed Temporal Action Segmentation
Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration…
Action SegmentationSegmentationTemporal Action SegmentationCondensing Action Segmentation Datasets via Generative Network Inversion
This work presents the first condensation approach for procedural video datasets used in temporal action segmentation. We propose a condensation framework that leverages generative prior learned from the dataset and netw…
Action SegmentationIncremental LearningTemporal Action SegmentationTimeLogic: A Temporal Logic Benchmark for Video QA
Temporal logical understanding, a core facet of human cognition, plays a pivotal role in capturing complex sequential events and their temporal relationships within videos. This capability is particularly crucial in task…
2kAction SegmentationLogical ReasoningQuestion Answering+2Understanding Multi-Task Activities from Single-Task Videos
(MT-TAS), a novel paradigm that addresses the challenges of interleaved actions when performing multiple tasks simultaneously. Traditional action segmentation models, trained on single-task videos, struggle to handle…
Action SegmentationSegmentationTemporal Action SegmentationHierarchical Vector Quantization for Unsupervised Action Segmentation
In this work, we address unsupervised temporal action segmentation, which segments a set of long, untrimmed videos into semantically meaningful segments that are consistent across videos. While recent approaches combine …
Action SegmentationClusteringQuantizationRepresentation Learning+2ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipation
Temporal action segmentation and long-term action anticipation are two popular vision tasks for the temporal analysis of actions in videos. Despite apparent relevance and potential complementarity, these two problems hav…
Action AnticipationAction SegmentationLong Term Action AnticipationSegmentation+1Video LLMs for Temporal Reasoning in Long Videos
This paper introduces TemporalVLM, a video large language model capable of effective temporal reasoning and fine-grained understanding in long videos. At the core, our approach includes a visual encoder for mapping a lon…
Action SegmentationDense Video CaptioningHighlight DetectionLanguage Modelling+4OnlineTAS: An Online Baseline for Temporal Action Segmentation
Temporal context plays a significant role in temporal action segmentation. In an offline setting, the context is typically captured by the segmentation network after observing the entire sequence. However, capturing and …
Action SegmentationSegmentationTemporal Action SegmentationLanguage-Assisted Skeleton Action Understanding for Skeleton-Based Temporal Action Segmentation
Skeleton-based Temporal Action Segmentation (STAS) aims to densely segment and classify human actions in long, untrimmed skeletal motion sequences. Existing STAS methods primarily model spatial dependencies among joints …
Action SegmentationAction UnderstandingContrastive LearningRepresentation Learning+4ProMQA: Question Answering Dataset for Multimodal Procedural Activity Understanding
Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on tradit…
Action RecognitionAction SegmentationQuestion AnsweringTemporal Action SegmentationLanguage-Assisted Human Part Motion Learning for Skeleton-Based Temporal Action Segmentation
Skeleton-based Temporal Action Segmentation involves the dense action classification of variable-length skeleton sequences. Current approaches primarily apply graph-based networks to extract framewise, whole-body-level m…
Action ClassificationAction SegmentationModel OptimizationRepresentation Learning+2ASQuery: A Query-based Model for Action Segmentation
For the task of temporal action segmentation, existing works commonly treat it as a frame-wise classification problem. In this paper, we propose a straight but effective model namely ASQuery by learning central represent…
Action SegmentationDecodermodelSegmentation+1Temporal2Seq: A Unified Framework for Temporal Video Understanding Tasks
With the development of video understanding, there is a proliferation of tasks for clip-level temporal video analysis, including temporal action detection (TAD), temporal action segmentation (TAS), and generic event boun…
Action DetectionAction SegmentationBoundary DetectionGeneric Event Boundary Detection+33D Pose-Based Temporal Action Segmentation for Figure Skating: A Fine-Grained and Jump Procedure-Aware Annotation Approach
Understanding human actions from videos is essential in many domains, including sports. In figure skating, technical judgments are performed by watching skaters' 3D movements, and its part of the judging procedure can be…
Action SegmentationMarkerless Motion CaptureTemporal Action SegmentationLong-Tail Temporal Action Segmentation with Group-wise Temporal Logit Adjustment
Procedural activity videos often exhibit a long-tailed action distribution due to varying action frequencies and durations. However, state-of-the-art temporal action segmentation methods overlook the long tail and fail t…
Action SegmentationSegmentationTemporal Action SegmentationFaster Diffusion Action Segmentation
Temporal Action Segmentation (TAS) is an essential task in video analysis, aiming to segment and classify continuous frames into distinct action segments. However, the ambiguous boundaries between actions pose a signific…
Action SegmentationComputational EfficiencySegmentationTemporal Action SegmentationEfficient Temporal Action Segmentation via Boundary-aware Query Voting
Although the performance of Temporal Action Segmentation (TAS) has improved in recent years, achieving promising results often comes with a high computational cost due to dense inputs, complex model structures, and resou…
Action SegmentationInstance SegmentationSegmentationSemantic Segmentation+1