paper-with-me

Papers

Supervised Attribute Information Removal and Reconstruction for Image Manipulation

2022-07-13 · Nannan Li, Bryan A. Plummer

The goal of attribute manipulation is to control specified attribute(s) in given images. Prior work approaches this problem by learning disentangled representations for each attribute that enables it to manipulate the encoded source attributes to the target attributes. However, encoded attributes are often correlated with relevant image content. Thus, the source attribute information can often be hidden in the disentangled features, leading to unwanted image editing effects. In this paper, we propose an Attribute Information Removal and Reconstruction (AIRR) network that prevents such information hiding by learning how to remove the attribute information entirely, creating attribute excluded features, and then learns to directly inject the desired attributes in a reconstructed image. We evaluate our approach on four diverse datasets with a variety of attributes including DeepFashion Synthesis, DeepFashion Fine-grained Attribute, CelebA and CelebA-HQ, where our model improves attribute manipulation accuracy and top-k retrieval rate by 10% on average over prior work. A user study also reports that AIRR manipulated images are preferred over prior work in up to 76% of cases.

📄 PDF Abstract BibTeX arXiv:2207.06555

Code (1)

nannanli999/airr 공식 구현 pytorch

Tasks

AttributeImage ManipulationRetrieval

Similar Papers 제목 키워드 기반

Information-Theoretic Bounds on The Removal of Attribute-Specific Bias From Neural Networks

2023-10-08 · Jiazhi Li, Mahyar Khayatkhoei, Jiageng Zhu, Hanchen Xie 외

Ensuring a neural network is not relying on protected attributes (e.g., race, sex, age) for predictions is crucial in advancing fair and trustworthy AI. While several promising methods for removing attribute bias in neur…

Attribute

Learning Discriminative Reconstructions for Unsupervised Outlier Removal

2015-12-01 · ICCV 2015 12 · Yan Xia, Xudong Cao, Fang Wen, Gang Hua 외

We study the problem of automatically removing outliers from noisy data, with application for removing outlier images from an image collection. We address this problem by utilizing the reconstruction errors of an autoenc…

A self-supervised CNN for image watermark removal

2024-03-09 · Chunwei Tian, Menghua Zheng, Tiancai Jiao, WangMeng Zuo 외

Popular convolutional neural networks mainly use paired images in a supervised way for image watermark removal. However, watermarked images do not have reference images in the real world, which results in poor robustness…

Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing

2021-03-29 · ICCV 2021 10 · Abdallah Dib, Cedric Thebault, Junghyun Ahn, Philippe-Henri Gosselin 외

Robust face reconstruction from monocular image in general lighting conditions is challenging. Methods combining deep neural network encoders with differentiable rendering have opened up the path for very fast monocular …

3D Face ReconstructionFace ReconstructionMonocular ReconstructionSelf-Supervised Learning

Text-to-image Editing by Image Information Removal

2023-05-27 · Zhongping Zhang, Jian Zheng, Jacob Zhiyuan Fang, Bryan A. Plummer

Diffusion models have demonstrated impressive performance in text-guided image generation. Current methods that leverage the knowledge of these models for image editing either fine-tune them using the input image (e.g., …

Image GenerationImage Reconstruction