Papers Video Alignment
“Video Alignment” 태그가 달린 논문 120편 · 필터 해제
EduVQA: Towards Concept-Aware Assessment of Educational AI-Generated Videos
Existing AI-generated video quality assessment (AIGVQA) methods mainly focus on global perceptual realism and coarse text-video alignment, while overlooking a critical requirement in educational scenarios: concept correc…
Video Quality AssessmentVideo AlignmentStructAlign: Structured Cross-Modal Alignment for Continual Text-to-Video Retrieval
Continual Text-to-Video Retrieval (CTVR) is a challenging multimodal continual learning setting, where models must incrementally learn new semantic categories while maintaining accurate text-video alignment for previousl…
Continual LearningVideo AlignmentVideo RetrievalAchieving Fine-grained Cross-modal Understanding through Brain-inspired Hierarchical Representation Learning
Understanding neural responses to visual stimuli remains challenging due to the inherent complexity of brain representations and the modality gap between neural data and visual inputs. Existing methods, mainly based on r…
Representation LearningCross-Modal RetrievalContrastive LearningVideo AlignmentSVBench: Evaluation of Video Generation Models on Social Reasoning
Recent text-to-video generation models have made remarkable progress in visual realism, motion fidelity, and text-video alignment, yet they still struggle to produce socially coherent behavior. Unlike humans, who readily…
Text-to-Video GenerationVideo AlignmentHarmony: Harmonizing Audio and Video Generation through Cross-Task Synergy
The synthesis of synchronized audio-visual content is a key challenge in generative AI, with open-source models facing challenges in robust audio-video alignment. Our analysis reveals that this issue is rooted in three f…
Audio GenerationVideo GenerationVideo AlignmentQ-Save: Towards Scoring and Attribution for Generated Video Evaluation
Evaluating AI-generated video (AIGV) quality hinges on three crucial dimensions: visual quality, dynamic quality, and text-video alignment. While numerous evaluation datasets and algorithms have been proposed, existing a…
Video AlignmentRethinking Reward Signals in Video GRPO: When Scores Become Targets
Group Relative Policy Optimization (GRPO) enables stable and preference-oriented updates via group-wise comparisons for post-training video generation. However, GRPO directly optimizes reward-induced advantages. Under su…
Video GenerationVideo AlignmentFoleyBench: A Benchmark For Video-to-Audio Models
Video-to-audio generation (V2A) is of increasing importance in domains such as film post-production, AR/VR, and sound design, particularly for the creation of Foley sound effects synchronized with on-screen actions. Fole…
Audio GenerationVideo AlignmentMitigating Semantic Collapse in Partially Relevant Video Retrieval
Partially Relevant Video Retrieval (PRVR) seeks videos where only part of the content matches a text query. Existing methods treat every annotated text-video pair as a positive and all others as negatives, ignoring the r…
Partially Relevant Video RetrievalVideo AlignmentLoCoT2V-Bench: Benchmarking Long-Form and Complex Text-to-Video Generation
Recent advances in text-to-video generation have achieved impressive performance on short clips, yet evaluating long-form generation under complex textual inputs remains a significant challenge. In response to this chall…
Text-to-Video GenerationVideo AlignmentFrame-Difference Guided Dynamic Region Perception for CLIP Adaptation in Text-Video Retrieval
With the rapid growth of video data, text-video retrieval technology has become increasingly important in numerous application scenarios such as recommendation and search. Early text-video retrieval methods suffer from t…
Video AlignmentVideo RetrievalMUG-V 10B: High-efficiency Training Pipeline for Large Video Generation Models
In recent years, large-scale generative models for visual content (\textit{e.g.,} images, videos, and 3D objects/scenes) have made remarkable progress. However, training large-scale video generation models remains partic…
Video GenerationVideo AlignmentBig Data Approaches to Bovine Bioacoustics: A FAIR-Compliant Dataset and Scalable ML Framework for Precision Livestock Welfare
The convergence of IoT sensing, edge computing, and machine learning is transforming precision livestock farming. Yet bioacoustic data streams remain underused because of computational complexity and ecological validity …
Feature EngineeringVideo AlignmentSANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer
We introduce SANA-Video, a small diffusion model that can efficiently generate videos up to 720x1280 resolution and minute-length duration. SANA-Video synthesizes high-resolution, high-quality and long videos with strong…
Video GenerationVideo AlignmentVideoScore2: Think before You Score in Generative Video Evaluation
Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quali…
Video Quality AssessmentText-to-Video GenerationReinforcement LearningVideo AlignmentEnhancing Partially Relevant Video Retrieval with Robust Alignment Learning
Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos partially relevant to a given query. The core challenge lies in learning robust query-video alignment against spurious semantic correlations ari…
Partially Relevant Video RetrievalVideo AlignmentHierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation
Recent advancements in video generation have enabled the creation of high-quality, visually compelling videos. However, generating videos that adhere to the laws of physics remains a critical challenge for applications r…
Video GenerationVideo AlignmentDiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval
The parameter-efficient adaptation of the image-text pretraining model CLIP for video-text retrieval is a prominent area of research. While CLIP is focused on image-level vision-language matching, video-text retrieval de…
Image CaptioningRetrievalText RetrievalVideo Alignment+1Audio-Sync Video Generation with Multi-Stream Temporal Control
Audio is inherently temporal and closely synchronized with the visual world, making it a naturally aligned and expressive control signal for controllable video generation (e.g., movies). Beyond control, directly translat…
Audio-Visual SynchronizationVideo AlignmentVideo GenerationHallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimization and Temporal Motion Modulation
Generating highly dynamic and photorealistic portrait animations driven by audio and skeletal motion remains challenging due to the need for precise lip synchronization, natural facial expressions, and high-fidelity body…
Portrait AnimationVideo Alignment