paper-with-me

홈 › Papers

Probabilistic Prior Driven Attention Mechanism Based on Diffusion Model for Imaging Through Atmospheric Turbulence

2024-11-15 · Guodong Sun, Qixiang Ma, Liqiang Zhang, Hongwei Wang, Zixuan Gao, Haotian Zhang

Atmospheric turbulence introduces severe spatial and geometric distortions, challenging traditional image restoration methods. We propose the Probabilistic Prior Turbulence Removal Network (PPTRN), which combines probabilistic diffusion-based prior modeling with Transformer-driven feature extraction to address this issue. PPTRN employs a two-stage approach: first, a latent encoder and Transformer are jointly trained on clear images to establish robust feature representations. Then, a Denoising Diffusion Probabilistic Model (DDPM) models prior distributions over latent vectors, guiding the Transformer in capturing diverse feature variations essential for restoration. A key innovation in PPTRN is the Probabilistic Prior Driven Cross Attention mechanism, which integrates the DDPM-generated prior with feature embeddings to reduce artifacts and enhance spatial coherence. Extensive experiments validate that PPTRN significantly improves restoration quality on turbulence-degraded images, setting a new benchmark in clarity and structural fidelity.

📄 PDF Abstract BibTeX arXiv:2411.10321

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingImage Restoration

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attention

2024-09-03 · Gaojie Lin, Jianwen Jiang, Chao Liang, Tianyun Zhong 외

Diffusion-based video generation technology has advanced significantly, catalyzing a proliferation of research in human animation. However, the majority of these studies are confined to same-modality driving settings, wi…

Human AnimationVideo Generation

Talking Head Generation with Probabilistic Audio-to-Visual Diffusion Priors

2022-12-07 · ICCV 2023 1 · Zhentao Yu, Zixin Yin, Deyu Zhou, Duomin Wang 외

In this paper, we introduce a simple and novel framework for one-shot audio-driven talking head generation. Unlike prior works that require additional driving sources for controlled synthesis in a deterministic manner, w…

Talking Head Generation

A Probabilistic Jump-Diffusion Framework for Open-World Egocentric Activity Recognition

2025-05-28 · Sanjoy Kundu, Shanmukha Vellamcheti, Sathyanarayanan N. Aakur

Open-world egocentric activity recognition poses a fundamental challenge due to its unconstrained nature, requiring models to infer unseen activities from an expansive, partially observed search space. We introduce ProbR…

Activity RecognitionEgocentric Activity Recognition

EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models

2025-10-30 · Igor Abramov, Ilya Makarov arxiv

Existing EEG-driven image reconstruction methods often overlook spatial attention mechanisms, limiting fidelity and semantic coherence. To address this, we propose a dual-conditioning framework that combines EEG embeddin…

Image ReconstructionImage Generation

DiffPLF: A Conditional Diffusion Model for Probabilistic Forecasting of EV Charging Load

2024-02-21 · Siyang Li, Hui Xiong, Yize Chen

Due to the vast electric vehicle (EV) penetration to distribution grid, charging load forecasting is essential to promote charging station operation and demand-side management.However, the stochastic charging behaviors a…

DenoisingLoad ForecastingProbabilistic Time Series ForecastingTime Series+1