paper-with-me

홈 › Papers

Exploring Position Encoding in Diffusion U-Net for Training-free High-resolution Image Generation

2025-03-12 · Feng Zhou, Pu Cao, Yiyang Ma, Lu Yang, Jianqin Yin

Denoising higher-resolution latents via a pre-trained U-Net leads to repetitive and disordered image patterns. Although recent studies make efforts to improve generative quality by aligning denoising process across original and higher resolutions, the root cause of suboptimal generation is still lacking exploration. Through comprehensive analysis of position encoding in U-Net, we attribute it to inconsistent position encoding, sourced by the inadequate propagation of position information from zero-padding to latent features in convolution layers as resolution increases. To address this issue, we propose a novel training-free approach, introducing a Progressive Boundary Complement (PBC) method. This method creates dynamic virtual image boundaries inside the feature map to enhance position information propagation, enabling high-quality and rich-content high-resolution image synthesis. Extensive experiments demonstrate the superiority of our method.

📄 PDF Abstract BibTeX arXiv:2503.09830

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeDenoisingImage GenerationPosition

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion

2025-10-23 · Noam Issachar, Guy Yariv, Sagie Benaim, Yossi Adi 외 arxiv

Diffusion Transformer models can generate images with remarkable fidelity and detail, yet training them at ultra-high resolutions remains extremely costly due to the self-attention mechanism's quadratic scaling with the …

Image Generation

Training-Free Multi-Style Fusion Through Reference-Based Adaptive Modulation

2025-09-23 · Xu Liu, Yibo Lu, Xinxian Wang, Xinyu Wu arxiv

We propose Adaptive Multi-Style Fusion (AMSF), a reference-based training-free framework that enables controllable fusion of multiple reference styles in diffusion models. Most of the existing reference-based methods are…

Bridging Distance and Spectral Positional Encodings via Anchor-Based Diffusion Geometry Approximation

2026-01-08 · Zimo Yan, Zheng Xie, Runfan Duan, Chang Liu 외 arxiv

Molecular graph learning benefits from positional signals that capture both local neighborhoods and global topology. Two widely used families are spectral encodings derived from Laplacian or diffusion operators and ancho…

Graph Learning

MDLMPE: Distribution Aware Positional Encoding for Masked Diffusion Language Models

2026-08-04 · Tong Ling, Hang Lei, Feng Xiao, Changhui Sun 외 arxiv

Masked diffusion language models (MDLMs) enable parallel generation and bidirectional context modeling, but their positional context differs fundamentally from that of autoregressive (AR) models. Whereas AR decoding expo…

Exploring the Role of Large Language Models in Prompt Encoding for Diffusion Models

2024-06-17 · Bingqi Ma, Zhuofan Zong, Guanglu Song, Hongsheng Li 외

Large language models (LLMs) based on decoder-only transformers have demonstrated superior text understanding capabilities compared to CLIP and T5-series models. However, the paradigm for utilizing current advanced LLMs …

DecoderImage GenerationLanguage ModellingLarge Language Model+2