DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement
The remastering of vintage film comprises of a diversity of sub-tasks including super-resolution, noise removal, and contrast enhancement which aim to restore the deteriorated film medium to its original state. Additionally, due to the technical limitations of the time, most vintage film is either recorded in black and white, or has low quality colors, for which colorization becomes necessary. In this work, we propose a single framework to tackle the entire remastering task semi-interactively. Our work is based on temporal convolutional neural networks with attention mechanisms trained on videos with data-driven deterioration simulation. Our proposed source-reference attention allows the model to handle an arbitrary number of reference color images to colorize long videos without the need for segmentation while maintaining temporal consistency. Quantitative analysis shows that our framework outperforms existing approaches, and that, in contrast to existing approaches, the performance of our framework increases with longer videos and more reference color images.
Code (0)
등록된 구현이 없습니다.
Tasks
ColorizationDiversitySuper-ResolutionVideo EnhancementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spatiotemporal-Enhanced Network for Click-Through Rate Prediction in Location-based Services
In Location-Based Services(LBS), user behavior naturally has a strong dependence on the spatiotemporal information, i.e., in different geographical locations and at different times, user click behavior will change signif…
AttributeClick-Through Rate PredictionFragment and Integrate Network (FIN): A Novel Spatial-Temporal Modeling Based on Long Sequential Behavior for Online Food Ordering Click-Through Rate Prediction
Spatial-temporal information has been proven to be of great significance for click-through rate prediction tasks in online Location-Based Services (LBS), especially in mainstream food ordering platforms such as DoorDash,…
Click-Through Rate PredictionRecommendation SystemsConvolutions Need Registers Too: HVS-Inspired Dynamic Attention for Video Quality Assessment
No-reference video quality assessment (NR-VQA) estimates perceptual quality without a reference video, which is often challenging. While recent techniques leverage saliency or transformer attention, they merely address g…
Video Quality AssessmentSaliency PredictionTimeColor: Flexible Reference Colorization via Temporal Concatenation
Most colorization models condition only on a single reference, typically the first frame of the scene. However, this approach ignores other sources of conditional data, such as character sheets, background images, or arb…
Temporal User Profiling with LLMs: Balancing Short-Term and Long-Term Preferences for Recommendations
Accurately modeling user preferences is crucial for improving the performance of content-based recommender systems. Existing approaches often rely on simplistic user profiling methods, such as averaging or concatenating …