paper-with-me

홈 › Papers

Synthetic-to-Real Domain Bridging for Single-View 3D Reconstruction of Ships for Maritime Monitoring

2026-01-29 · Borja Carrillo-Perez, Felix Sattler, Angel Bueno Rodriguez, Maurice Stephan, Sarah Barnes arxiv

Three-dimensional (3D) reconstruction of ships is an important part of maritime monitoring, allowing improved visualization, inspection, and decision-making in real-world monitoring environments. However, most state-ofthe-art 3D reconstruction methods require multi-view supervision, annotated 3D ground truth, or are computationally intensive, making them impractical for real-time maritime deployment. In this work, we present an efficient pipeline for single-view 3D reconstruction of real ships by training entirely on synthetic data and requiring only a single view at inference. Our approach uses the Splatter Image network, which represents objects as sparse sets of 3D Gaussians for rapid and accurate reconstruction from single images. The model is first fine-tuned on synthetic ShapeNet vessels and further refined with a diverse custom dataset of 3D ships, bridging the domain gap between synthetic and real-world imagery. We integrate a state-of-the-art segmentation module based on YOLOv8 and custom preprocessing to ensure compatibility with the reconstruction network. Postprocessing steps include real-world scaling, centering, and orientation alignment, followed by georeferenced placement on an interactive web map using AIS metadata and homography-based mapping. Quantitative evaluation on synthetic validation data demonstrates strong reconstruction fidelity, while qualitative results on real maritime images from the ShipSG dataset confirm the potential for transfer to operational maritime settings. The final system provides interactive 3D inspection of real ships without requiring real-world 3D annotations. This pipeline provides an efficient, scalable solution for maritime monitoring and highlights a path toward real-time 3D ship visualization in practical applications. Interactive demo: https://dlr-mi.github.io/ship3d-demo/.

📄 PDF Abstract BibTeX arXiv:2601.21786

Code (0)

등록된 구현이 없습니다.

Tasks

Single-View 3D Reconstruction

Similar Papers 제목 키워드 기반

StereoGAN: Bridging Synthetic-to-Real Domain Gap by Joint Optimization of Domain Translation and Stereo Matching

2020-05-05 · CVPR 2020 6 · Rui Liu, Chengxi Yang, Wenxiu Sun, Xiaogang Wang 외

Large-scale synthetic datasets are beneficial to stereo matching but usually introduce known domain bias. Although unsupervised image-to-image translation networks represented by CycleGAN show great potential in dealing …

Disparity EstimationDiversityImage-to-Image TranslationStereo Matching+3

Style-transfer GANs for bridging the domain gap in synthetic pose estimator training

2020-04-28 · Pavel Rojtberg, Thomas Pöllabauer, Arjan Kuijper

Given the dependency of current CNN architectures on a large training set, the possibility of using synthetic data is alluring as it allows generating a virtually infinite amount of labeled training data. However, produc…

Style TransferTranslation

Domain Adaptation for Vehicle Detection from Bird's Eye View LiDAR Point Cloud Data

2019-05-22 · Khaled Saleh, Ahmed Abobakr, Mohammed Attia, Julie Iskander 외

Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and…

Domain AdaptationUnsupervised Domain Adaptationvehicle detection

Real3D: Scaling Up Large Reconstruction Models with Real-World Images

2024-06-12 · Hanwen Jiang, QiXing Huang, Georgios Pavlakos

The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simpl…

Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment

2023-11-18 · Parth Rawal, Mrunal Sompura, Wolfgang Hintze

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an impo…

6D Pose Estimation using RGBObjectobject-detectionObject Detection+3