paper-with-me

홈 › Papers

BIR-Adapter: A parameter-efficient diffusion adapter for blind image restoration

2025-09-08 · Cem Eteke, Alexander Griessel, Wolfgang Kellerer, Eckehard Steinbach arxiv

We introduce the BIR-Adapter, a parameter-efficient diffusion adapter for blind image restoration. Diffusion-based restoration methods have demonstrated promising performance in addressing this fundamental problem in computer vision, typically relying on auxiliary feature extractors or extensive fine-tuning of pre-trained models. Building on the observation that large-scale pretrained diffusion models can retain informative representations under image degradations, BIR-Adapter introduces a parameter-efficient, plug-and-play attention mechanism that substantially reduces the number of trained parameters. To further improve reliability, we adapt a sampling guidance mechanism that mitigates hallucinations during restoration. Experiments on synthetic and real-world degradations demonstrate that BIR-Adapter achieves competitive, and in several settings superior, performance compared to state-of-the-art methods while requiring up to 36x fewer trained parameters. Moreover, the adapter-based design enables integration into existing models. We validate this generality by extending a super-resolution-only diffusion model to handle additional unknown degradations, highlighting the adaptability of our approach for broader image restoration tasks.

📄 PDF Abstract BibTeX arXiv:2509.06904

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Similar Papers 제목 키워드 기반

DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild

2024-05-30 · Honghao Fu, YuFei Wang, Wenhan Yang, Bihan Wen

Blind image quality assessment (IQA) in the wild, which assesses the quality of images with complex authentic distortions and no reference images, presents significant challenges. Given the difficulty in collecting large…

DenoisingImage Quality AssessmentNo-Reference Image Quality Assessment

UniCon: Unidirectional Information Flow for Effective Control of Large-Scale Diffusion Models

2025-03-21 · Fanghua Yu, Jinjin Gu, JinFan Hu, Zheyuan Li 외

We introduce UniCon, a novel architecture designed to enhance control and efficiency in training adapters for large-scale diffusion models. Unlike existing methods that rely on bidirectional interaction between the diffu…

GPU

Efficient Text-Guided Convolutional Adapter for the Diffusion Model

2026-02-16 · Aryan Das, Koushik Biswas, Swalpa Kumar Roy, Badri Narayana Patro 외 arxiv

We introduce the Nexus Adapters, novel text-guided efficient adapters to the diffusion-based framework for the Structure Preserving Conditional Generation (SPCG). Recently, structure-preserving methods have achieved prom…

Conditional Image Generation

Stylus: Automatic Adapter Selection for Diffusion Models

2024-04-29 · Michael Luo, Justin Wong, Brandon Trabucco, Yanping Huang 외

Beyond scaling base models with more data or parameters, fine-tuned adapters provide an alternative way to generate high fidelity, custom images at reduced costs. As such, adapters have been widely adopted by open-source…

IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models

2023-08-13 · Hu Ye, Jun Zhang, Sibo Liu, Xiao Han 외

Recent years have witnessed the strong power of large text-to-image diffusion models for the impressive generative capability to create high-fidelity images. However, it is very tricky to generate desired images using on…

Diffusion Personalization Tuning FreeImage GenerationPersonalized Image GenerationPrompt Engineering