SPADES: A Realistic Spacecraft Pose Estimation Dataset using Event Sensing
In recent years, there has been a growing demand for improved autonomy for in-orbit operations such as rendezvous, docking, and proximity maneuvers, leading to increased interest in employing Deep Learning-based Spacecraft Pose Estimation techniques. However, due to limited access to real target datasets, algorithms are often trained using synthetic data and applied in the real domain, resulting in a performance drop due to the domain gap. State-of-the-art approaches employ Domain Adaptation techniques to mitigate this issue. In the search for viable solutions, event sensing has been explored in the past and shown to reduce the domain gap between simulations and real-world scenarios. Event sensors have made significant advancements in hardware and software in recent years. Moreover, the characteristics of the event sensor offer several advantages in space applications compared to RGB sensors. To facilitate further training and evaluation of DL-based models, we introduce a novel dataset, SPADES, comprising real event data acquired in a controlled laboratory environment and simulated event data using the same camera intrinsics. Furthermore, we propose an effective data filtering method to improve the quality of training data, thus enhancing model performance. Additionally, we introduce an image-based event representation that outperforms existing representations. A multifaceted baseline evaluation was conducted using different event representations, event filtering strategies, and algorithmic frameworks, and the results are summarized. The dataset will be made available at http://cvi2.uni.lu/spades.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationPose EstimationSpacecraft Pose EstimationSimilar Papers 제목 키워드 기반
Motion Aware ViT-based Framework for Monocular 6-DoF Spacecraft Pose Estimation
Monocular 6-DoF pose estimation plays an important role in multiple spacecraft missions. Most existing pose estimation approaches rely on single images with static keypoint localisation, failing to exploit valuable tempo…
Pose EstimationEfficient Onboard Spacecraft Pose Estimation with Event Cameras and Neuromorphic Hardware
Reliable relative pose estimation is a key enabler for autonomous rendezvous and proximity operations, yet space imagery is notoriously challenging due to extreme illumination, high contrast, and fast target motion. Even…
Event-based visionPose EstimationTALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation
Monocular 6-DoF spacecraft pose estimation methods predominantly process individual frames, discarding the temporal information present in an image sequence acquired during spacecraft manoeuvres. Few temporal approaches …
Pose EstimationDeep Learning for Spacecraft Pose Estimation from Photorealistic Rendering
On-orbit proximity operations in space rendezvous, docking and debris removal require precise and robust 6D pose estimation under a wide range of lighting conditions and against highly textured background, i.e., the Eart…
6D Pose Estimation6D Pose Estimation using RGBDeep LearningPose Estimation+1CAD-Free Learning of Spacecraft Pose Estimators via NeRF-Based Augmentations
Spacecraft pose estimation networks require tens of thousands of CAD-rendered images to be trained. This reliance on synthetic CAD data (i) limits applicability to targets with reliable geometry prior, excluding uncooper…
Domain GeneralizationImage AugmentationPose Estimation