Papers Video Alignment
“Video Alignment” 태그가 달린 논문 120편 · 필터 해제
Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Space
Humans are remarkably flexible in understanding viewpoint changes due to visual cortex supporting the perception of 3D structure. In contrast, most of the computer vision models that learn visual representation from a po…
Action Recognitionimage-classificationImage ClassificationVideo AlignmentFrame-wise Action Representations for Long Videos via Sequence Contrastive Learning
Prior works on action representation learning mainly focus on designing various architectures to extract the global representations for short video clips. In contrast, many practical applications such as video alignment …
Action ClassificationContrastive LearningRepresentation LearningRetrieval+2Learning by Aligning Videos in Time
We present a self-supervised approach for learning video representations using temporal video alignment as a pretext task, while exploiting both frame-level and video-level information. We leverage a novel combination of…
Representation LearningRetrievalVideo AlignmentNormalized Human Pose Features for Human Action Video Alignment
We present a novel approach for extracting human pose features from human action videos. The goal is to let the pose features capture only the poses of the action while being invariant to other factors, including vid…
Action RecognitionMetric LearningPose RetrievalRetrieval+1View-Invariant, Occlusion-Robust Probabilistic Embedding for Human Pose
Recognition of human poses and actions is crucial for autonomous systems to interact smoothly with people. However, cameras generally capture human poses in 2D as images and videos, which can have significant appearance …
3D Pose EstimationAction RecognitionPose EstimationRetrieval+1View-Invariant Probabilistic Embedding for Human Pose
Depictions of similar human body configurations can vary with changing viewpoints. Using only 2D information, we would like to enable vision algorithms to recognize similarity in human body poses across multiple views. T…
Action RecognitionPose RetrievalSkeleton Based Action RecognitionVideo AlignmentAdversarial Skill Networks: Unsupervised Robot Skill Learning from Video
Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approac…
continuous-controlContinuous ControlMetric LearningReinforcement Learning+4Temporal Cycle-Consistency Learning
We introduce a self-supervised representation learning method based on the task of temporal alignment between videos. The method trains a network using temporal cycle consistency (TCC), a differentiable cycle-consistency…
Anomaly DetectionRepresentation LearningSelf-Supervised LearningVideo AlignmentShot-by-Shot Movie Version Comparison
Some movies are released in two or more versions. One of the frequent causes is shrinking the movie for theatrical showcase with subsequent release of both the theatrical (shrunk) cut and the director’s (original, extend…
Video AlignmentTeaching Machines to Understand Baseball Games: Large-Scale Baseball Video Database for Multiple Video Understanding Tasks
A major obstacle in teaching machines to understand videos is the lack of training data, as creating temporal annotations for long videos requires a huge amount of human effort. To this end, we introduce a new large-scal…
Video AlignmentVideo RecognitionVideo UnderstandingDynamic Temporal Alignment of Speech to Lips
Many speech segments in movies are re-recorded in a studio during postproduction, to compensate for poor sound quality as recorded on location. Manual alignment of the newly-recorded speech with the original lip movement…
Constrained Lip-synchronizationVideo AlignmentLearning to Align Images using Weak Geometric Supervision
Image alignment tasks require accurate pixel correspondences, which are usually recovered by matching local feature descriptors. Such descriptors are often derived using supervised learning on existing datasets with grou…
Video AlignmentACCURATE METHOD OF TEMPORAL-SHIFT ESTIMATION FOR 3D VIDEO
Video synchronization is a fundamental computer-vision task that is necessary for a wide range of applications. A 3D video involves two streams, which show the scene from different angles concurrently, but many cases exh…
Video AlignmentVideo SynchronizationLAMV: Learning to Align and Match Videos With Kernelized Temporal Layers
This paper considers a learnable approach for comparing and aligning videos. Our architecture builds upon and revisits temporal match kernels within neural networks: we propose a new temporal layer that finds temporal al…
Copy DetectionRetrievalTripletVideo Alignment+1Learning from Video and Text via Large-Scale Discriminative Clustering
Discriminative clustering has been successfully applied to a number of weakly-supervised learning tasks. Such applications include person and action recognition, text-to-video alignment, object co-segmentation and coloca…
Action RecognitionClusteringTemporal Action LocalizationVideo Alignment+3Time-Contrastive Networks: Self-Supervised Learning from Video
We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imit…
Metric Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2Learning Robust Video Synchronization without Annotations
Aligning video sequences is a fundamental yet still unsolved component for a broad range of applications in computer graphics and vision. Most classical image processing methods cannot be directly applied to related vide…
Video AlignmentVideo SynchronizationShuffle and Learn: Unsupervised Learning using Temporal Order Verification
In this paper, we present an approach for learning a visual representation from the raw spatiotemporal signals in videos. Our representation is learned without supervision from semantic labels. We formulate our method as…
Action RecognitionPose EstimationSelf-Supervised Action RecognitionTemporal Action Localization+1Book2Movie: Aligning Video Scenes With Book Chapters
Film adaptations of novels often visually display in a few shots what is described in many pages of the source novel. In this paper we present a new problem: to align book chapters with video scenes. Such an alignment fa…
Video AlignmentRoad Detection via On--line Label Transfer
Vision-based road detection is an essential functionality for supporting advanced driver assistance systems (ADAS) such as road following and vehicle and pedestrian detection. The major challenges of road detection are d…
Pedestrian DetectionvalidVideo Alignment