paper-with-me

Papers

Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications

2024-11-01 · Hah Min Lew, Sahng-Min Yoo, Hyunwoo Kang, Gyeong-Moon Park

We introduce an industrial Head Blending pipeline for the task of seamlessly integrating an actor's head onto a target body in digital content creation. The key challenge stems from discrepancies in head shape and hair structure, which lead to unnatural boundaries and blending artifacts. Existing methods treat foreground and background as a single task, resulting in suboptimal blending quality. To address this problem, we propose CHANGER, a novel pipeline that decouples background integration from foreground blending. By utilizing chroma keying for artifact-free background generation and introducing Head shape and long Hair augmentation ($H^2$ augmentation) to simulate a wide range of head shapes and hair styles, CHANGER improves generalization on innumerable various real-world cases. Furthermore, our Foreground Predictive Attention Transformer (FPAT) module enhances foreground blending by predicting and focusing on key head and body regions. Quantitative and qualitative evaluations on benchmark datasets demonstrate that our CHANGER outperforms state-of-the-art methods, delivering high-fidelity, industrial-grade results.

📄 PDF Abstract BibTeX arXiv:2411.00652

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

GREENSCREEN BACKGROUND REMOVER USING CV SYSTEM PROJECT REPORT.

2022-10-20 · ResearchGate 2022 10 · Kamal Acharya

A green screen is a backdrop against which footage is shot to later be superimposed over a separately-filmed background in a visual effects process called "chroma keying." It is also known as chroma key compositing, colo…

Video Editing

MAGICK: A Large-scale Captioned Dataset from Matting Generated Images using Chroma Keying

2024-01-01 · CVPR 2024 1 · Ryan D. Burgert, Brian L. Price, Jason Kuen, Yijun Li 외

We introduce MAGICK a large-scale dataset of generated objects with high-quality alpha mattes. While image generation methods have produced segmentations they cannot generate alpha mattes with accurate details in hai…

Image GenerationImage MattingText to Image GenerationText-to-Image Generation

Fast Training Data Acquisition for Object Detection and Segmentation using Black Screen Luminance Keying

2024-05-13 · Thomas Pöllabauer, Volker Knauthe, André Boller, Arjan Kuijper 외

Deep Neural Networks (DNNs) require large amounts of annotated training data for a good performance. Often this data is generated using manual labeling (error-prone and time-consuming) or rendering (requiring geometry an…

object-detectionObject Detection

Performance Evaluation of Frequency Domain Equalisation Based Colour Shift Keying Modulation Schemes Over Diffuse Optical Wireless Channels

2019-03-25

Multi-colour light-emitting diode (LED) based visible light communication (VLC) benefits from wavelength diversity while providing indoor illumination. Colour shift keying (CSK) is a well-researched IEEE standardised mul…

Instance Segmentation based Semantic Matting for Compositing Applications

2019-04-10 · Guanqing Hu, James J. Clark

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keyi…

Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation