paper-with-me

Papers

Visual Style Prompt Learning Using Diffusion Models for Blind Face Restoration

2024-12-30 · Wanglong Lu, Jikai Wang, Tao Wang, Kaihao Zhang, Xianta Jiang, Hanli Zhao

Blind face restoration aims to recover high-quality facial images from various unidentified sources of degradation, posing significant challenges due to the minimal information retrievable from the degraded images. Prior knowledge-based methods, leveraging geometric priors and facial features, have led to advancements in face restoration but often fall short of capturing fine details. To address this, we introduce a visual style prompt learning framework that utilizes diffusion probabilistic models to explicitly generate visual prompts within the latent space of pre-trained generative models. These prompts are designed to guide the restoration process. To fully utilize the visual prompts and enhance the extraction of informative and rich patterns, we introduce a style-modulated aggregation transformation layer. Extensive experiments and applications demonstrate the superiority of our method in achieving high-quality blind face restoration. The source code is available at \href{https://github.com/LonglongaaaGo/VSPBFR}{https://github.com/LonglongaaaGo/VSPBFR}.

📄 PDF Abstract BibTeX arXiv:2412.21042

Code (1)

longlongaaago/vspbfr 공식 구현 pytorch

Tasks

Blind Face RestorationPrompt Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Visual Style Prompting with Swapping Self-Attention

2024-02-20 · Jaeseok Jeong, Junho Kim, Yunjey Choi, Gayoung Lee 외

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled …

DenoisingImage GenerationStyle TransferText to Image Generation+1

VT-DUDA: Visual Token Conditioning for Diffusion-guided Unsupervised Domain Adaptation

2026-06-19 · Xuan Qi, Daniele Berardini, Dario Serez, Vito Paolo Pastore 외 arxiv

Unsupervised domain adaptation (UDA) aims to learn a target-domain classifier from labeled source data and unlabeled target data under distribution shift. Recent diffusion-based UDA methods approach this problem by synth…

Unsupervised Domain Adaptation

A2BFR: Attribute-Aware Blind Face Restoration

2026-03-31 · Chenxin Zhu, Yushun Fang, Lu Liu, Shibo Yin 외 arxiv

Blind face restoration (BFR) aims to recover high-quality facial images from degraded inputs, yet its inherently ill-posed nature leads to ambiguous and uncontrollable solutions. Recent diffusion-based BFR methods improv…

Blind Face Restoration

ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priors

2023-11-09 · Jingwen Chen, Yingwei Pan, Ting Yao, Tao Mei

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we …

Image GenerationStyle TransferText to Image GenerationText-to-Image Generation

Zero-Shot Face-to-Speech Synthesis via Latent Space Adaptation of a Style-Diffusion TTS Model

2026-07-29 · Carlos Muñoz-Romero, Jose A. Gonzalez-Lopez arxiv

Zero-shot text-to-speech (TTS) clones a voice from a short audio prompt, but this reliance on reference audio is a barrier when only visual information is available, e.g. for historical figures or video-game characters. …

Speech Synthesis