paper-with-me

홈 › Papers

Focus on What Matters: Constraining Spatial-Temporal Attention via Action-Units for Noise-Resilient AQA

2025-11-06 · Shuaikang Zhu, Yang Yang, Chen Sun arxiv

The core challenge in Action Quality Assessment (AQA) lies in extracting fine-grained motion features from redundant and complex video backgrounds. Existing global feature learning methods are constrained by extremely low "signal-to-noise ratios", making it difficult to distinguish intrinsic actions from background clutter. To address this, we propose a Pose-Guided Intrinsic Motion Distillation Framework that explicitly enforces physical constraints to focus on motion subjects and decouple motion execution from environmental outcomes. First, we design an Action-Unit Parser that constructs dynamic regions of interest (ROIs) using human pose topology as prior knowledge. This functions as a spatial hard-attention filter that physically removes background noise at the input stage, forcing the model to learn appearance and geometric features only from pure body regions. Second, to resolve factor entanglement, we introduce a dual-stream decoupling mechanism: the Motion Parser focuses on capturing purified joint motion details, while the Condition Parser independently processes non-body-related environmental feedback (e.g., splash in diving) to create two orthogonal evaluation dimensions in feature space. Finally, adaptive weight modules integrate these decoupled features to generate final scores. Experimental results on large-scale datasets including FineDiving, FineDiving-HM, and MTL-AQA demonstrate that this method achieves state-of-the-art (SOTA) performance in both action segmentation and scoring accuracy, validating the effectiveness of "noise suppression focusing" and "motion disentanglement" strategies in fine-grained action evaluation.

📄 PDF Abstract BibTeX arXiv:2511.05611

Code (0)

등록된 구현이 없습니다.

Tasks

Action Quality AssessmentAction Segmentation

Similar Papers 제목 키워드 기반

STDepthFormer: Predicting Spatio-temporal Depth from Video with a Self-supervised Transformer Model

2023-03-02 · Houssem Boulahbal, Adrian Voicila, Andrew Comport

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constra…

Depth EstimationDepth Predictionobject-detectionObject Detection

Spatial-Temporal Multi-level Association for Video Object Segmentation

2024-04-09 · Deshui Miao, Xin Li, Zhenyu He, Huchuan Lu 외

Existing semi-supervised video object segmentation methods either focus on temporal feature matching or spatial-temporal feature modeling. However, they do not address the issues of sufficient target interaction and effi…

ObjectSegmentationSemantic SegmentationSemi-Supervised Video Object Segmentation+2

Machine Learning that Matters

2012-06-18 · Kiri Wagstaff

Much of current machine learning (ML) research has lost its connection to problems of import to the larger world of science and society. From this perspective, there exist glaring limitations in the data sets we investig…

BIG-bench Machine Learning

What Matters to You? Towards Visual Representation Alignment for Robot Learning

2023-10-11 · Ran Tian, Chenfeng Xu, Masayoshi Tomizuka, Jitendra Malik 외

When operating in service of people, robots need to optimize rewards aligned with end-user preferences. Since robots will rely on raw perceptual inputs like RGB images, their rewards will inevitably use visual representa…

Zero-shot Generalization

What matters for Representation Alignment: Global Information or Spatial Structure?

2025-12-11 · Jaskirat Singh, Xingjian Leng, Zongze Wu, Liang Zheng 외 arxiv

Representation alignment (REPA) guides generative training by distilling representations from a strong, pretrained vision encoder to intermediate diffusion features. We investigate a fundamental question: what aspect of …