paper-with-me

Papers

2D Gaussian Splatting with Semantic Alignment for Image Inpainting

2025-09-02 · Hongyu Li, Chaofeng Chen, Xiaoming Li, Guangming Lu arxiv

Gaussian Splatting (GS), a recent technique for converting discrete points into continuous spatial representations, has shown promising results in 3D scene modeling and 2D image super-resolution. In this paper, we explore its untapped potential for image inpainting, which demands both locally coherent pixel synthesis and globally consistent semantic restoration. We propose the first image inpainting framework based on 2D Gaussian Splatting, which encodes incomplete images into a continuous field of 2D Gaussian splat coefficients and reconstructs the final image via a differentiable rasterization process. The continuous rendering paradigm of GS inherently promotes pixel-level coherence in the inpainted results. To improve efficiency and scalability, we introduce a patch-wise rasterization strategy that reduces memory overhead and accelerates inference. For global semantic consistency, we incorporate features from a pretrained DINO model. We observe that DINO's global features are naturally robust to small missing regions and can be effectively adapted to guide semantic alignment in large-mask scenarios, ensuring that the inpainted content remains contextually consistent with the surrounding scene. Extensive experiments on standard benchmarks demonstrate that our method achieves competitive performance in both quantitative metrics and perceptual quality, establishing a new direction for applying Gaussian Splatting to 2D image processing.

📄 PDF Abstract BibTeX arXiv:2509.01964

Code (0)

등록된 구현이 없습니다.

Tasks

Image Super-ResolutionImage Inpainting

Similar Papers 제목 키워드 기반

Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting

2024-12-02 · Jacob Fein-Ashley, Benjamin Fein-Ashley

Image inpainting is a fundamental task in computer vision, aiming to restore missing or corrupted regions in images realistically. While recent deep learning approaches have significantly advanced the state-of-the-art, c…

Image Inpainting

Visibility-Uncertainty-guided 3D Gaussian Inpainting via Scene Conceptional Learning

2025-04-23 · Mingxuan Cui, Qing Guo, Yuyi Wang, Hongkai Yu 외

3D Gaussian Splatting (3DGS) has emerged as a powerful and efficient 3D representation for novel view synthesis. This paper extends 3DGS capabilities to inpainting, where masked objects in a scene are replaced with new c…

3DGS3D InpaintingImage InpaintingNeRF+1

SplatFill: 3D Scene Inpainting via Depth-Guided Gaussian Splatting

2025-09-09 · Mahtab Dahaghin, Milind G. Padalkar, Matteo Toso, Alessio Del Bue arxiv

3D Gaussian Splatting (3DGS) has enabled the creation of highly realistic 3D scene representations from sets of multi-view images. However, inpainting missing regions, whether due to occlusion or scene editing, remains a…

GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting

2025-04-14 · Junlin Hao, Peiheng Wang, Haoyang Wang, Xinggong Zhang 외

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative mode…

3D Generation3D Scene ReconstructionOut-of-Distribution GeneralizationScene Generation+1

RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting

2025-07-11 · Ji Hyun Seo, Byounhyun Yoo, Gerard Jounghyun Kim

Radiance field methods, such as Neural Radiance Field or 3D Gaussian Splatting, have emerged as seminal 3D representations for synthesizing realistic novel views. For practical applications, there is ongoing research on …

Image Inpainting