paper-with-me

Papers

From Flight to Insight: Semantic 3D Reconstruction for Aerial Inspection via Gaussian Splatting and Language-Guided Segmentation

2025-05-23 · Mahmoud Chick Zaouali, Todd Charter, Homayoun Najjaran

High-fidelity 3D reconstruction is critical for aerial inspection tasks such as infrastructure monitoring, structural assessment, and environmental surveying. While traditional photogrammetry techniques enable geometric modeling, they lack semantic interpretability, limiting their effectiveness for automated inspection workflows. Recent advances in neural rendering and 3D Gaussian Splatting (3DGS) offer efficient, photorealistic reconstructions but similarly lack scene-level understanding. In this work, we present a UAV-based pipeline that extends Feature-3DGS for language-guided 3D segmentation. We leverage LSeg-based feature fields with CLIP embeddings to generate heatmaps in response to language prompts. These are thresholded to produce rough segmentations, and the highest-scoring point is then used as a prompt to SAM or SAM2 for refined 2D segmentation on novel view renderings. Our results highlight the strengths and limitations of various feature field backbones (CLIP-LSeg, SAM, SAM2) in capturing meaningful structure in large-scale outdoor environments. We demonstrate that this hybrid approach enables flexible, language-driven interaction with photorealistic 3D reconstructions, opening new possibilities for semantic aerial inspection and scene understanding.

📄 PDF Abstract BibTeX arXiv:2505.17402

Code (0)

등록된 구현이 없습니다.

Tasks

3DGS3D ReconstructionNeural RenderingScene Understanding

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
SAM 설명 없음

Similar Papers 제목 키워드 기반

Seeing Where to Deploy: Metric RGB-Based Traversability Analysis for Aerial-to-Ground Hidden Space Inspection

2026-03-15 · Seoyoung Lee, Shaekh Mohammad Shithil, Durgakant Pushp, Lantao Liu 외 arxiv

Inspection of confined infrastructure such as culverts often requires accessing hidden spaces whose entrances are reachable primarily from elevated viewpoints. Aerial-ground cooperation enables a UAV to deploy a compact …

Semantic Segmentation

AgiPIX: Bridging Simulation and Reality in Indoor Aerial Inspection

2026-04-09 · Sasanka Kuruppu Arachchige, Juan Jose Garcia, Changda Tian, Lauri Suomela 외 arxiv

Autonomous indoor flight for critical asset inspection presents fundamental challenges in perception, planning, control, and learning. Despite rapid progress, there is still a lack of a compact, active-sensing, open-sour…

Vision-model-based Real-time Localization of Unmanned Aerial Vehicle for Autonomous Structure Inspection under GPS-denied Environment

2019-04-10 · Zhexiong Shang, Zhigang Shen

UAVs have been widely used in visual inspections of buildings, bridges and other structures. In either outdoor autonomous or semi-autonomous flights missions strong GPS signal is vital for UAV to locate its own positions…

A Modular Dual-Camera Pipeline for Micro-Inspection Using Aerial Robots

2026-06-09 · S. H. Mirtajadini, N. Rublein, R. M. Ramakrishnan, G. ter Maat 외 arxiv

Most existing drone-based inspection systems require the drone to fly dangerously close to the target or follow complex flight paths to capture small details. In addition, drone flight is affected by disturbances and loc…

Trajectory Planning

Meteorology-Aware Multi-Goal Path Planning for Large-Scale Inspection Missions with Long-Endurance Solar-Powered Aircraft

2017-11-28 · Philipp Oettershagen, Julian Förster, Lukas Wirth, Jacques Ambühl 외

Solar-powered aircraft promise significantly increased flight endurance over conventional aircraft. While this makes them promising candidates for large-scale aerial inspection missions, their structural fragility necess…