Making a Case for Learning Motion Representations with Phase
This work advocates Eulerian motion representation learning over the current standard Lagrangian optical flow model. Eulerian motion is well captured by using phase, as obtained by decomposing the image through a complex-steerable pyramid. We discuss the gain of Eulerian motion in a set of practical use cases: (i) action recognition, (ii) motion prediction in static images, (iii) motion transfer in static images and, (iv) motion transfer in video. For each task we motivate the phase-based direction and provide a possible approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Recognitionmotion predictionOptical Flow EstimationRepresentation LearningTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Uncovering Latent Phase Structures and Branching Logic in Locomotion Policies: A Case Study on HalfCheetah
In locomotion control tasks, Deep Reinforcement Learning (DRL) has demonstrated high performance; however, the decision-making process of the learned policy remains a black box, making it difficult for humans to understa…
Reinforcement LearningDecision MakingUsing phase instead of optical flow for action recognition
Currently, the most common motion representation for action recognition is optical flow. Optical flow is based on particle tracking which adheres to a Lagrangian perspective on dynamics. In contrast to the Lagrangian per…
Action RecognitionMotion MagnificationOptical Flow EstimationTemporal Action Localization+1PHASE: Learning Emotional Phase-aware Representations for Suicide Ideation Detection on Social Media
Recent psychological studies indicate that individuals exhibiting suicidal ideation increasingly turn to social media rather than mental health practitioners. Contextualizing the build-up of such ideation is critical for…
Enhancing Reset Control Phase with Lead Shaping Filters: Applications to Precision Motion Systems
This study presents a shaped reset feedback control strategy to enhance the performance of precision motion systems. The approach utilizes a phase-lead compensator as a shaping filter to tune the phase of reset instants,…
Fine-Grained Emotion Recognition via In-Context Learning
Fine-grained emotion recognition aims to identify the emotional type in queries through reasoning and decision-making processes, playing a crucial role in various systems. Recent methods use In-Context Learning (ICL), en…
Emotion Recognition