ARShadowGAN: Shadow Generative Adversarial Network for Augmented Reality in Single Light Scenes
Generating virtual object shadows consistent with the real-world environment shading effects is important but challenging in computer vision and augmented reality applications. To address this problem, we propose an end-to-end Generative Adversarial Network for shadow generation named ARShadowGAN for augmented reality in single light scenes. Our ARShadowGAN makes full use of attention mechanism and is able to directly model the mapping relation between the virtual object shadow and the real-world environment without any explicit estimation of the illumination and 3D geometric information. In addition, we collect an image set which provides rich clues for shadow generation and construct a dataset for training and evaluating our proposed ARShadowGAN. The extensive experimental results show that our proposed ARShadowGAN is capable of directly generating plausible virtual object shadows in single light scenes. Our source code is available at https://github.com/ldq9526/ARShadowGAN.
Code (2)
Tasks
Generative Adversarial NetworkObjectSimilar Papers 제목 키워드 기반
A Real-time Method for Inserting Virtual Objects into Neural Radiance Fields
We present the first real-time method for inserting a rigid virtual object into a neural radiance field, which produces realistic lighting and shadowing effects, as well as allows interactive manipulation of the object. …
Lighting EstimationNeRFObjectOccluded object reconstruction for first responders with augmented reality glasses using conditional generative adversarial networks
Firefighters suffer a variety of life-threatening risks, including line-of-duty deaths, injuries, and exposures to hazardous substances. Support for reducing these risks is important. We built a partially occluded object…
ObjectObject ReconstructionUnsupervised Shadow Removal Using Target Consistency Generative Adversarial Network
Unsupervised shadow removal aims to learn a non-linear function to map the original image from shadow domain to non-shadow domain in the absence of paired shadow and non-shadow data. In this paper, we develop a simple ye…
Generative Adversarial NetworkShadow RemovalARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal
In this paper we propose an attentive recurrent generative adversarial network (ARGAN) to detect and remove shadows in an image. The generator consists of multiple progressive steps. At each step a shadow attention detec…
Generative Adversarial NetworkShadow DetectionShadow Detection And RemovalShadow RemovalHRTF upsampling with a generative adversarial network using a gnomonic equiangular projection
An individualised head-related transfer function (HRTF) is very important for creating realistic virtual reality (VR) and augmented reality (AR) environments. However, acoustically measuring high-quality HRTFs requires e…
Generative Adversarial NetworkSuper-Resolution