paper-with-me

홈 › Papers

Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting

2026-03-18 · Guillem Casadesus Vila, Adam Dai, Grace Gao arxiv

Navigation and mapping on the lunar surface require robust perception under challenging conditions, including poorly textured environments, high-contrast lighting, and limited computational resources. This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation. We first benchmark several models on synthetic datasets generated with the LuPNT simulator, selecting a stereo dense depth estimation model based on Gated Recurrent Units for its balance of speed and accuracy in depth estimation, and a convolutional neural network for its superior performance in detecting semantic segments. Using ground truth poses to decouple the local scene understanding from the global state estimation, our pipeline reconstructs a 120-meter traverse with a geometric height accuracy of approximately 3 cm, outperforming a traditional point cloud baseline without LiDAR. The resulting 3DGS map enables novel view synthesis and serves as a foundation for a full SLAM system, where its capacity for joint map and pose optimization would offer significant advantages. Our results demonstrate that combining semantic segmentation and dense depth estimation with learned map representations is an effective approach for creating detailed, large-scale maps to support future lunar surface missions.

📄 PDF Abstract BibTeX arXiv:2603.18218

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic SegmentationNovel View SynthesisScene UnderstandingDepth Estimation

Similar Papers 제목 키워드 기반

Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations

2018-09-13 · Vladimir Nekrasov, Thanuja Dharmasiri, Andrew Spek, Tom Drummond 외

Deployment of deep learning models in robotics as sensory information extractors can be a daunting task to handle, even using generic GPU cards. Here, we address three of its most prominent hurdles, namely, i) the adapta…

Depth EstimationGPUKnowledge DistillationMonocular Depth Estimation+4

Learning Common Representation from RGB and Depth Images

2018-12-17 · Giorgio Giannone, Boris Chidlovskii

We propose a new deep learning architecture for the tasks of semantic segmentation and depth prediction from RGB-D images. We revise the state of art based on the RGB and depth feature fusion, where both modalities are a…

DecoderDepth EstimationDepth PredictionMULTI-VIEW LEARNING+2

Driving Scene Perception Network: Real-time Joint Detection, Depth Estimation and Semantic Segmentation

2018-03-10 · Liangfu Chen, Zeng Yang, Jianjun Ma, Zheng Luo

As the demand for enabling high-level autonomous driving has increased in recent years and visual perception is one of the critical features to enable fully autonomous driving, in this paper, we introduce an efficient ap…

Autonomous DrivingDepth EstimationGPUImage Segmentation+5

Geometry meets semantics for semi-supervised monocular depth estimation

2018-10-09 · Pierluigi Zama Ramirez, Matteo Poggi, Fabio Tosi, Stefano Mattoccia 외

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or struct…

DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1

The Edge of Depth: Explicit Constraints between Segmentation and Depth

2020-04-01 · CVPR 2020 6 · Shengjie Zhu, Garrick Brazil, Xiaoming Liu

In this work we study the mutual benefits of two common computer vision tasks, self-supervised depth estimation and semantic segmentation from images. For example, to help unsupervised monocular depth estimation, constra…

Depth EstimationMonocular Depth EstimationSegmentationSemantic Segmentation+1