Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications
We introduce an industrial Head Blending pipeline for the task of seamlessly integrating an actor's head onto a target body in digital content creation. The key challenge stems from discrepancies in head shape and hair structure, which lead to unnatural boundaries and blending artifacts. Existing methods treat foreground and background as a single task, resulting in suboptimal blending quality. To address this problem, we propose CHANGER, a novel pipeline that decouples background integration from foreground blending. By utilizing chroma keying for artifact-free background generation and introducing Head shape and long Hair augmentation ($H^2$ augmentation) to simulate a wide range of head shapes and hair styles, CHANGER improves generalization on innumerable various real-world cases. Furthermore, our Foreground Predictive Attention Transformer (FPAT) module enhances foreground blending by predicting and focusing on key head and body regions. Quantitative and qualitative evaluations on benchmark datasets demonstrate that our CHANGER outperforms state-of-the-art methods, delivering high-fidelity, industrial-grade results.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GREENSCREEN BACKGROUND REMOVER USING CV SYSTEM PROJECT REPORT.
A green screen is a backdrop against which footage is shot to later be superimposed over a separately-filmed background in a visual effects process called "chroma keying." It is also known as chroma key compositing, colo…
Video EditingMAGICK: A Large-scale Captioned Dataset from Matting Generated Images using Chroma Keying
We introduce MAGICK a large-scale dataset of generated objects with high-quality alpha mattes. While image generation methods have produced segmentations they cannot generate alpha mattes with accurate details in hai…
Image GenerationImage MattingText to Image GenerationText-to-Image GenerationFast Training Data Acquisition for Object Detection and Segmentation using Black Screen Luminance Keying
Deep Neural Networks (DNNs) require large amounts of annotated training data for a good performance. Often this data is generated using manual labeling (error-prone and time-consuming) or rendering (requiring geometry an…
object-detectionObject DetectionPerformance Evaluation of Frequency Domain Equalisation Based Colour Shift Keying Modulation Schemes Over Diffuse Optical Wireless Channels
Multi-colour light-emitting diode (LED) based visible light communication (VLC) benefits from wavelength diversity while providing indoor illumination. Colour shift keying (CSK) is a well-researched IEEE standardised mul…
Instance Segmentation based Semantic Matting for Compositing Applications
Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keyi…
Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation