paper-with-me

Papers

PIV-FlowDiffuser:Transfer-learning-based denoising diffusion models for PIV

2025-04-21 · Qianyu Zhu, Junjie Wang, Jeremiah Hu, Jia Ai, Yong Lee

Deep learning algorithms have significantly reduced the computational time and improved the spatial resolution of particle image velocimetry~(PIV). However, the models trained on synthetic datasets might have a degraded performance on practical particle images due to domain gaps. As a result, special residual patterns are often observed for the vector fields of deep learning-based estimators. To reduce the special noise step-by-step, we employ a denoising diffusion model~(FlowDiffuser) for PIV analysis. And the data-hungry iterative denoising diffusion model is trained via a transfer learning strategy, resulting in our PIV-FlowDiffuser method. Specifically, (1) pre-training a FlowDiffuser model with multiple optical flow datasets of the computer vision community, such as Sintel, KITTI, etc; (2) fine-tuning the pre-trained model on synthetic PIV datasets. Note that the PIV images are upsampled by a factor of two to resolve the small-scale turbulent flow structures. The visualized results indicate that our PIV-FlowDiffuser effectively suppresses the noise patterns. Therefore, the denoising diffusion model reduces the average end-point error~($AEE$) by 59.4% over RAFT256-PIV baseline on the classic Cai's dataset. Besides, PIV-FlowDiffuser exhibits enhanced generalization performance on unseen particle images due to transfer learning. Overall, this study highlights the transfer-learning-based denoising diffusion models for PIV. And a detailed implementation is recommended for interested readers in the repository https://github.com/Zhu-Qianyu/PIV-FlowDiffuser.

📄 PDF Abstract BibTeX arXiv:2504.14952

Code (1)

zhu-qianyu/piv-flowdiffuser 공식 구현 pytorch

Tasks

DenoisingOptical Flow EstimationTransfer Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FlowDiffuser: Advancing Optical Flow Estimation with Diffusion Models

2024-01-01 · CVPR 2024 1 · Ao Luo, Xin Li, Fan Yang, Jiangyu Liu 외

Optical flow estimation a process of predicting pixel-wise displacement between consecutive frames has commonly been approached as a regression task in the age of deep learning. Despite notable advancements this de f…

DecoderDenoisingOptical Flow Estimation

Addressing Negative Transfer in Diffusion Models

2023-06-01 · NeurIPS 2023 11 · Hyojun Go, Jinyoung Kim, Yunsung Lee, SeungHyun Lee 외

Diffusion-based generative models have achieved remarkable success in various domains. It trains a shared model on denoising tasks that encompass different noise levels simultaneously, representing a form of multi-task l…

ClusteringDenoisingMulti-Task Learning

Learning Generic Diffusion Processes for Image Restoration

2018-07-17 · Peng Qiao, Yong Dou, Yunjin Chen, Wensen Feng

Image restoration problems are typical ill-posed problems where the regularization term plays an important role. The regularization term learned via generative approaches is easy to transfer to various image restoration,…

DenoisingImage Restoration

TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution

2025-04-17 · Yide Liu, Haijiang Sun, Xiaowen Zhang, Qiaoyuan Liu 외

Remote Sensing Image Super-Resolution (RSISR) reconstructs high-resolution (HR) remote sensing images from low-resolution inputs to support fine-grained ground object interpretation. Existing methods face three key chall…

DenoisingImage Super-ResolutionSuper-Resolution

Timbre transfer using image-to-image denoising diffusion implicit models

2023-07-10 · Luca Comanducci, Fabio Antonacci, Augusto Sarti

Timbre transfer techniques aim at converting the sound of a musical piece generated by one instrument into the same one as if it was played by another instrument, while maintaining as much as possible the content in term…

DenoisingImage Denoising