paper-with-me

홈 › Papers

TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restoration

2026-01-28 · Yanjie Tu, Qingsen Yan, Axi Niu, Jiacong Tang arxiv

All-in-one image restoration aims to address diverse degradation types using a single unified model. Existing methods typically rely on degradation priors to guide restoration, yet often struggle to reconstruct content in severely degraded regions. Although recent works leverage semantic information to facilitate content generation, integrating it into the shallow layers of diffusion models often disrupts spatial structures (\emph{e.g.}, blurring artifacts). To address this issue, we propose a Triple-Prior Guided Diffusion (TPGDiff) network for unified image restoration. TPGDiff incorporates degradation priors throughout the diffusion trajectory, while introducing structural priors into shallow layers and semantic priors into deep layers, enabling hierarchical and complementary prior guidance for image reconstruction. Specifically, we leverage multi-source structural cues as structural priors to capture fine-grained details and guide shallow layers representations. To complement this design, we further develop a distillation-driven semantic extractor that yields robust semantic priors, ensuring reliable high-level guidance at deep layers even under severe degradations. Furthermore, a degradation extractor is employed to learn degradation-aware priors, enabling stage-adaptive control of the diffusion process across all timesteps. Extensive experiments on both single- and multi-degradation benchmarks demonstrate that TPGDiff achieves superior performance and generalization across diverse restoration scenarios. Our project page is: https://leoyjtu.github.io/tpgdiff-project.

📄 PDF Abstract BibTeX arXiv:2601.20306

Code (0)

등록된 구현이 없습니다.

Tasks

Unified Image RestorationImage Reconstruction

Similar Papers 제목 키워드 기반

Prior-guided Hierarchical Harmonization Network for Efficient Image Dehazing

2025-03-03 · Xiongfei Su, Siyuan Li, Yuning Cui, Miao Cao 외

Image dehazing is a crucial task that involves the enhancement of degraded images to recover their sharpness and textures. While vision Transformers have exhibited impressive results in diverse dehazing tasks, their quad…

DecoderImage Dehazing

Diffusion-based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completion

2025-01-26 · Guanglin Niu, Xiaowei Zhang

Multimodal Knowledge Graph Completion (MMKGC) aims to address the critical issue of missing knowledge in multimodal knowledge graphs (MMKGs) for their better applications. However, both the previous MMGKC and negative sa…

Knowledge Graph CompletionKnowledge Graphs

DiffMath: Symbol- and Graph-Aware Latent Diffusion Transformer for Handwritten Mathematical Expression Generation

2026-06-18 · Wei Pan, Xuhan Zheng, Yilin Shi, Huiguo He 외 arxiv

Handwritten Mathematical Expression Generation (HMEG) is challenging due to the complex two-dimensional layouts and long-range structural dependencies of mathematical expressions. Existing methods typically rely on expli…

Data Augmentation

TrioPose: Native Triple-Stream Diffusion Transformers for Pose-Guided Text-to-Image Generation

2026-06-05 · Dian Gu, Zhengyi Yang arxiv

Pose-guided text-to-image generation often suffers from limb distortions and feature crosstalk in complex multi-person scenarios. While existing UNet-based adapters struggle with long-range spatial dependencies, emerging…

Text-to-Image Generation

Task-Guided Multi-Annotation Triplet Learning for Remote Sensing Representations

2026-04-04 · Meilun Zhou, Alina Zare arxiv

Prior multi-task triplet loss methods relied on static weights to balance supervision between various types of annotation. However, static weighting requires tuning and does not account for how tasks interact when shapin…