uScenes: A Multimodal RGB and 3D Sonar Dataset for Underwater Robot Perception

2026-08-28 · Trung Tien Dong, Zhenqi Wu, Aditya Penumarti, Zi-Hao Zhang, Micaiah Bartlett, Jane Shin, Xiaomin Lin arxiv

Robust perception is essential for the deployment of autonomous underwater robots. However, optical cameras become unreliable under poor illumination and backscatter. Forward looking (2D) acoustic sensors remain effective under these conditions, but they measure range and bearing while leaving elevation unresolved, creating an ambiguity that prevents individual sonar returns from being localized in three dimensional (3D) space. This complicates the sensor use for 3D scene understanding and precise object detection. We introduce \textbf{uScenes}, a multimodal underwater dataset containing synchronized 3D multibeam sonar point clouds and RGB imagery. The dataset contains 110 scenes and 95,834 synchronized observation, representing 277.6 minutes of data collected across multiple field sessions. uScenes establishes a foundation for underwater sensor fusion, cross modal representation learning and 3D scene understanding. Code and datasets are given at https://github.com/era-research-lab/uScenes.

📄 PDF Abstract BibTeX arXiv:2608.27795

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning Scene Understanding Object Detection Point Clouds

RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection

2026-08-26 · Zhuoyan Liu, Yihan Wang, Bo Wang, Bing Wang 외 arxiv

Underwater unimodal object detection faces many challenges in sensor imaging, such as optical images limited by underwater noise and visible distance, and sonar images limited by less object structural information. While…

Object Detection

A Sonar-Visual Dataset for Cross-Modal Underwater Robot Perception

2026-05-31 · Weitung Chen, Phil Tinn, Per Gunnar Auran, Martin Ludvigsen 외 arxiv

Underwater robots typically use both cameras and sonar for perception to leverage the rich semantic details of vision and the robust range measurements of acoustics. However, learning to map between these modalities via …

Robust Cross-Modal Foundation Model Perception for Underwater Robots under Degraded Visual Conditions

2026-08-20 · Mohammad Arif Ul Alam arxiv

Reliable underwater robotic perception remains difficult because optical imagery degrades under turbidity, wavelength-dependent attenuation, low illumination, scattering, and blur. Although sonar provides complementary i…

Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challenges

2024-12-16 · Martin Aubard, Ana Madureira, Luís Teixeira, José Pinto

With the growing interest in underwater exploration and monitoring, Autonomous Underwater Vehicles (AUVs) have become essential. The recent interest in onboard Deep Learning (DL) has advanced real-time environmental inte…

object-detection Object Detection

DRACo-SLAM2: Distributed Robust Acoustic Communication-efficient SLAM for Imaging Sonar EquippedUnderwater Robot Teams with Object Graph Matching

2025-07-31 · Yewei Huang, John McConnell, Xi Lin, Brendan Englot arxiv

We present DRACo-SLAM2, a distributed SLAM framework for underwater robot teams equipped with multibeam imaging sonar. This framework improves upon the original DRACo-SLAM by introducing a novel representation of sonar m…

Graph Matching