paper-with-me

홈 › Papers

Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance

2024-12-03 · Jing Zeng, Qi Ye, Tianle Liu, Yang Xu, Jin Li, Jinming Xu, Liang Li, Jiming Chen

Implicit neural representations and 3D Gaussian splatting (3DGS) have shown great potential for scene reconstruction. Recent studies have expanded their applications in autonomous reconstruction through task assignment methods. However, these methods are mainly limited to single robot, and rapid reconstruction of large-scale scenes remains challenging. Additionally, task-driven planning based on surface uncertainty is prone to being trapped in local optima. To this end, we propose the first 3DGS-based centralized multi-robot autonomous 3D reconstruction framework. To further reduce time cost of task generation and improve reconstruction quality, we integrate online open-vocabulary semantic segmentation with surface uncertainty of 3DGS, focusing view sampling on regions with high instance uncertainty. Finally, we develop a multi-robot collaboration strategy with mode and task assignments improving reconstruction quality while ensuring planning efficiency. Our method demonstrates the highest reconstruction quality among all planning methods and superior planning efficiency compared to existing multi-robot methods. We deploy our method on multiple robots, and results show that it can effectively plan view paths and reconstruct scenes with high quality.

📄 PDF Abstract BibTeX arXiv:2412.02249

Code (0)

등록된 구현이 없습니다.

Tasks

3DGS3D ReconstructionOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping

2025-09-17 · Zhihao Cao, Hanyu Wu, Li Wa Tang, Zizhou Luo 외 arxiv

Recent progress in dense SLAM has primarily targeted monocular setups, often at the expense of robustness and geometric coverage. We present MCGS-SLAM, the first purely RGB-based multi-camera SLAM system built on 3D Gaus…

Autonomous Driving

ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation

2024-03-13 · Guanxing Lu, Shiyi Zhang, Ziwei Wang, Changliu Liu 외

Performing language-conditioned robotic manipulation tasks in unstructured environments is highly demanded for general intelligent robots. Conventional robotic manipulation methods usually learn semantic representation o…

Simulated Gaussian Manipulation

GS-SDF: LiDAR-Augmented Gaussian Splatting and Neural SDF for Geometrically Consistent Rendering and Reconstruction

2025-03-13 · Jianheng Liu, Yunfei Wan, Bowen Wang, Chunran Zheng 외

Digital twins are fundamental to the development of autonomous driving and embodied artificial intelligence. However, achieving high-granularity surface reconstruction and high-fidelity rendering remains a challenge. Gau…

Autonomous DrivingSurface Reconstruction

GS-LTS: 3D Gaussian Splatting-Based Adaptive Modeling for Long-Term Service Robots

2025-03-22 · Bin Fu, Jialin Li, Bin Zhang, Ruiping Wang 외

3D Gaussian Splatting (3DGS) has garnered significant attention in robotics for its explicit, high fidelity dense scene representation, demonstrating strong potential for robotic applications. However, 3DGS-based methods…

3DGSChange Detection

AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstruction

2024-07-02 · Mustafa Khan, Hamidreza Fazlali, Dhruv Sharma, Tongtong Cao 외

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene recon…

Autonomous DrivingNovel View Synthesis