Papers Video Alignment
“Video Alignment” 태그가 달린 논문 120편 · 필터 해제
VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
Text-driven video editing has recently experienced rapid development. Despite this, evaluating edited videos remains a considerable challenge. Current metrics tend to fail to align with human perceptions, and effective q…
Video AlignmentVideo EditingVideo Quality AssessmentVisual Question Answering (VQA)CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer
We present CogVideoX, a large-scale text-to-video generation model based on diffusion transformer, which can generate 10-second continuous videos aligned with text prompt, with a frame rate of 16 fps and resolution of 76…
Text-to-Video GenerationVideo AlignmentVideo CaptioningVideo GenerationBenchmarking Multi-dimensional AIGC Video Quality Assessment: A Dataset and Unified Model
In recent years, artificial intelligence (AI)-driven video generation has gained significant attention. Consequently, there is a growing need for accurate video quality assessment (VQA) metrics to evaluate the perceptual…
BenchmarkingLarge Language ModelVideo AlignmentVideo Generation+2A Comprehensive Review of Few-shot Action Recognition
Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data in action recognition. It requires accurately classifying human actions in videos using on…
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionFew-Shot Learning+6Semantic GUI Scene Learning and Video Alignment for Detecting Duplicate Video-based Bug Reports
Video-based bug reports are increasingly being used to document bugs for programs centered around a graphical user interface (GUI). However, developing automated techniques to manage video-based reports is challenging as…
Video AlignmentMiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions
Sora's high-motion intensity and long consistent videos have significantly impacted the field of video generation, attracting unprecedented attention. However, existing publicly available datasets are inadequate for gene…
Video AlignmentVideo GenerationAlign and Aggregate: Compositional Reasoning with Video Alignment and Answer Aggregation for Video Question-Answering
Despite the recent progress made in Video Question-Answering (VideoQA), these methods typically function as black-boxes, making it difficult to understand their reasoning processes and perform consistent compositional re…
Contrastive LearningLanguage ModellingLarge Language ModelQuestion Answering+2FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
We study Neural Foley, the automatic generation of high-quality sound effects synchronizing with videos, enabling an immersive audio-visual experience. Despite its wide range of applications, existing approaches encounte…
Audio GenerationVideo AlignmentVideo SynchronizationSafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset
To mitigate the risk of harmful outputs from large vision models (LVMs), we introduce the SafeSora dataset to promote research on aligning text-to-video generation with human values. This dataset encompasses human prefer…
Safety AlignmentText-to-Video GenerationVideo AlignmentVideo GenerationListen Then See: Video Alignment with Speaker Attention
Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and…
cross-modal alignmentQuestion AnsweringVideo AlignmentVideo Question AnsweringAniClipart: Clipart Animation with Text-to-Video Priors
Clipart, a pre-made art form, offers a convenient and efficient way of creating visual content. However, traditional workflows for animating static clipart are laborious and time-consuming, involving steps like rigging, …
Image to Video GenerationText-to-Video GenerationVideo AlignmentVideo GenerationScaling Up Video Summarization Pretraining with Large Language Models
Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in the…
Video AlignmentVideo SummarizationThe Effects of Short Video-Sharing Services on Video Copy Detection
The short video-sharing services that allow users to post 10-30 second videos (e.g., YouTube Shorts and TikTok) have attracted a lot of attention in recent years. However, conventional video copy detection (VCD) methods …
Copy DetectionVideo AlignmentSubjective-Aligned Dataset and Metric for Text-to-Video Quality Assessment
With the rapid development of generative models, Artificial Intelligence-Generated Contents (AIGC) have exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention…
Language ModelingLanguage ModellingLarge Language ModelVideo Alignment+1CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibility
Recent advancements in video generation have been remarkable, yet many existing methods struggle with issues of consistency and poor text-video alignment. Moreover, the field lacks effective techniques for text-guided vi…
Image InpaintingVideo AlignmentVideo GenerationVideo InpaintingFastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
Diffusion models have demonstrated remarkable capabilities in text-to-image and text-to-video generation, opening up possibilities for video editing based on textual input. However, the computational cost associated with…
Image GenerationText-to-Video EditingText-to-Video GenerationVideo Alignment+2Towards A Better Metric for Text-to-Video Generation
Generative models have demonstrated remarkable capability in synthesizing high-quality text, images, and videos. For video generation, contemporary text-to-video models exhibit impressive capabilities, crafting visually …
Mixture-of-ExpertsText-to-Video GenerationVideo AlignmentVideo GenerationAIGCBench: Comprehensive Evaluation of Image-to-Video Content Generated by AI
The burgeoning field of Artificial Intelligence Generated Content (AIGC) is witnessing rapid advancements, particularly in video generation. This paper introduces AIGCBench, a pioneering comprehensive and scalable benchm…
Video AlignmentVideo GenerationLearning to Predict Activity Progress by Self-Supervised Video Alignment
In this paper we tackle the problem of self-supervised video alignment and activity progress prediction using in-the-wild videos. Our proposed self-supervised representation learning method carefully addresses differ…
Representation LearningVideo AlignmentFrequency-aware Event-based Video Deblurring for Real-World Motion Blur
Video deblurring aims to restore sharp frames from blurred video clips. Despite notable progress in video deblurring works it is still a challenging problem because of the loss of motion information during the durati…
DeblurringVideo AlignmentVideo Deblurring