paper-with-me

Papers

ReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondences

2025-02-14 · Liyuan Zhu, Shengqu Cai, Shengyu Huang, Gordon Wetzstein, Naji Khosravan, Iro Armeni

We introduce ReStyle3D, a novel framework for scene-level appearance transfer from a single style image to a real-world scene represented by multiple views. The method combines explicit semantic correspondences with multi-view consistency to achieve precise and coherent stylization. Unlike conventional stylization methods that apply a reference style globally, ReStyle3D uses open-vocabulary segmentation to establish dense, instance-level correspondences between the style and real-world images. This ensures that each object is stylized with semantically matched textures. It first transfers the style to a single view using a training-free semantic-attention mechanism in a diffusion model. It then lifts the stylization to additional views via a learned warp-and-refine network guided by monocular depth and pixel-wise correspondences. Experiments show that ReStyle3D consistently outperforms prior methods in structure preservation, perceptual style similarity, and multi-view coherence. User studies further validate its ability to produce photo-realistic, semantically faithful results. Our code, pretrained models, and dataset will be publicly released, to support new applications in interior design, virtual staging, and 3D-consistent stylization.

📄 PDF Abstract BibTeX arXiv:2502.10377

Code (0)

등록된 구현이 없습니다.

Tasks

Appearance Transfer

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

ImagineNet: Restyling Apps Using Neural Style Transfer

2020-01-14 · Michael H. Fischer, Richard R. Yang, Monica S. Lam

This paper presents ImagineNet, a tool that uses a novel neural style transfer model to enable end-users and app developers to restyle GUIs using an image of their choice. Former neural style transfer techniques are inad…

Style Transfer

Jigsaw3D: Disentangled 3D Style Transfer via Patch Shuffling and Masking

2025-10-12 · Yuteng Ye, Zheng Zhang, Qinchuan Zhang, Di Wang 외 arxiv

Controllable 3D style transfer seeks to restyle a 3D asset so that its textures match a reference image while preserving the integrity and multi-view consistency. The prevalent methods either rely on direct reference sty…

Style Transfer

MoreStyle: Relax Low-frequency Constraint of Fourier-based Image Reconstruction in Generalizable Medical Image Segmentation

2024-03-18 · Haoyu Zhao, Wenhui Dong, Rui Yu, Zhou Zhao 외

The task of single-source domain generalization (SDG) in medical image segmentation is crucial due to frequent domain shifts in clinical image datasets. To address the challenge of poor generalization across different do…

Data AugmentationDomain GeneralizationImage ReconstructionImage Segmentation+3

NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs

2024-02-13 · CVPR 2024 1 · Michael Fischer, Zhengqin Li, Thu Nguyen-Phuoc, Aljaz Bozic 외

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a sem…

3D geometryAppearance TransferAttributeNeRF

ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement

2021-04-06 · ICCV 2021 10 · Yuval Alaluf, Or Patashnik, Daniel Cohen-Or

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained …

Image GenerationReal-to-Cartoon translation