PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis
Diffusion models are promising for sparse-view novel view synthesis (NVS), as they can generate pseudo-ground-truth views to aid 3D reconstruction pipelines like 3D Gaussian Splatting (3DGS). However, these synthesized images often contain photometric and geometric inconsistencies, and their direct use for supervision can impair reconstruction. To address this, we propose Partial-Reference Image Quality Assessment (PR-IQA), a framework that evaluates diffusion-generated views using reference images from different poses, eliminating the need for ground truth. PR-IQA first computes a geometrically consistent partial quality map in overlapping regions. It then performs quality completion to inpaint this partial map into a dense, full-image map. This completion is achieved via a cross-attention mechanism that incorporates reference-view context, ensuring cross-view consistency and enabling thorough quality assessment. When integrated into a diffusion-augmented 3DGS pipeline, PR-IQA restricts supervision to high-confidence regions identified by its quality maps. Experiments demonstrate that PR-IQA outperforms existing IQA methods, achieving full-reference-level accuracy without ground-truth supervision. Thus, our quality-aware 3DGS approach more effectively filters inconsistencies, producing superior 3D reconstructions and NVS results. The project page is available at https://kakaomacao.github.io/pr-iqa-project-page/.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Quality AssessmentNovel View Synthesis3D ReconstructionSimilar Papers 제목 키워드 기반
Dehazed Image Quality Evaluation: From Partial Discrepancy to Blind Perception
Image dehazing aims to restore spatial details from hazy images. There have emerged a number of image dehazing algorithms, designed to increase the visibility of those hazy images. However, much less work has been focuse…
Image DehazingUIEDP:Underwater Image Enhancement with Diffusion Prior
Underwater image enhancement (UIE) aims to generate clear images from low-quality underwater images. Due to the unavailability of clear reference images, researchers often synthesize them to construct paired datasets for…
Image EnhancementImage GenerationImage Quality AssessmentNo-Reference Image Quality Assessment+1Non-Reference Quality Assessment for Medical Imaging: Application to Synthetic Brain MRIs
Generating high-quality synthetic data is crucial for addressing challenges in medical imaging, such as domain adaptation, data scarcity, and privacy concerns. Existing image quality metrics often rely on reference image…
BenchmarkingDomain AdaptationGenzIQA: Generalized Image Quality Assessment using Prompt-Guided Latent Diffusion Models
The design of no-reference (NR) image quality assessment (IQA) algorithms is extremely important to benchmark and calibrate user experiences in modern visual systems. A major drawback of state-of-the-art NR-IQA methods i…
BenchmarkingDenoisingImage Quality AssessmentNR-IQAA survey on IQA
Image quality assessment(IQA) is of increasing importance for image-based applications. Its purpose is to establish a model that can replace humans for accurately evaluating image quality. According to whether the refere…
Deep LearningFull reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality Assessment+2