paper-with-me

홈 › Papers

MaTe: Images Are All You Need for Material Transfer via Diffusion Transformer

2026-05-15 · Nisha Huang, Henglin Liu, Yizhou Lin, Kaer Huang, Chubin Chen, Jie Guo, Tong-Yee Lee, Xiu Li arxiv

Recent diffusion-based methods for material transfer rely on image fine-tuning or complex architectures with assistive networks, but face challenges including text dependency, extra computational costs, and feature misalignment. To address these limitations, we propose MaTe, a streamlined diffusion framework that eliminates textual guidance and reference networks. MaTe integrates input images at the token level, enabling unified processing via multi-modal attention in a shared latent space. This design removes the need for additional adapters, ControlNet, inversion sampling, or model fine-tuning. Extensive experiments demonstrate that MaTe achieves high-quality material generation under a zero-shot, training-free paradigm. It outperforms state-of-the-art methods in both visual quality and efficiency while preserving precise detail alignment, significantly simplifying inference prerequisites.

📄 PDF Abstract BibTeX arXiv:2605.15660

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ZeST: Zero-Shot Material Transfer from a Single Image

2024-04-09 · Ta-Ying Cheng, Prafull Sharma, Andrew Markham, Niki Trigoni 외

We propose ZeST, a method for zero-shot material transfer to an object in the input image given a material exemplar image. ZeST leverages existing diffusion adapters to extract implicit material representation from the e…

Appearance TransferObject

Harmonizing Attention: Training-free Texture-aware Geometry Transfer

2024-08-19 · Eito Ikuta, Yohan Lee, Akihiro Iohara, Yu Saito 외

Extracting geometry features from photographic images independently of surface texture and transferring them onto different materials remains a complex challenge. In this study, we introduce Harmonizing Attention, a nove…

MatSwap: Light-aware material transfers in images

2025-02-11 · Ivan Lopes, Valentin Deschaintre, Yannick Hold-Geoffroy, Raoul de Charette

We present MatSwap, a method to transfer materials to designated surfaces in an image photorealistically. Such a task is non-trivial due to the large entanglement of material appearance, geometry, and lighting in a photo…

DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer

2026-05-15 · Nisha Huang, Yizhou Lin, Jie Guo, Xiu Li 외 arxiv

Recently, diffusion-based material transfer methods rely on image fine-tuning or complex architectures with auxiliary networks but face challenges such as text dependency, additional computational costs, and feature misa…

Computational Efficiency

MaterialFusion: High-Quality, Zero-Shot, and Controllable Material Transfer with Diffusion Models

2025-02-10 · Kamil Garifullin, Maxim Nikolaev, Andrey Kuznetsov, Aibek Alanov

Manipulating the material appearance of objects in images is critical for applications like augmented reality, virtual prototyping, and digital content creation. We present MaterialFusion, a novel framework for high-qual…