3D Visual Tracking Framework with Deep Learning for Asteroid Exploration
3D visual tracking is significant to deep space exploration programs, which can guarantee spacecraft to flexibly approach the target. In this paper, we focus on the studied accurate and real-time method for 3D tracking. Considering the fact that there are almost no public dataset for this topic, A new large-scale 3D asteroid tracking dataset is presented, including binocular video sequences, depth maps, and point clouds of diverse asteroids with various shapes and textures. Benefitting from the power and convenience of simulation platform, all the 2D and 3D annotations are automatically generated. Meanwhile, we propose a deep-learning based 3D tracking framework, named as Track3D, which involves 2D monocular tracker and a novel light-weight amodal axis-aligned bounding-box network, A3BoxNet. The evaluation results demonstrate that Track3D achieves state-of-the-art 3D tracking performance in both accuracy and precision, comparing to a baseline algorithm. Moreover, our framework has great generalization ability to 2D monocular tracking performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningVisual TrackingSimilar Papers 제목 키워드 기반
Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning
Active visual tracking of space non-cooperative object is significant for future intelligent spacecraft to realise space debris removal, asteroid exploration, autonomous rendezvous and docking. However, existing works of…
Deep Reinforcement LearningPose EstimationPositionreinforcement-learning+3Gradient based reachability analysis for goal-oriented guidance. Application to Eros proximity operations
The recent growing interest in small solar system bodies such as asteroids and comets for scientific inspection, exploitation of resources, and planetary defense reasons is pushing the development of innovative engineeri…
Autonomous Asteroid Characterization Through Nanosatellite Swarming
This paper first defines a class of estimation problem called simultaneous navigation and characterization (SNAC), which is a superset of simultaneous localization and mapping (SLAM). A SNAC framework is then developed f…
Landmark TrackingNavigateSimultaneous Localization and MappingState EstimationDreamSat-2.0: Towards a General Single-View Asteroid 3D Reconstruction
To enhance asteroid exploration and autonomous spacecraft navigation, we introduce DreamSat-2.0, a pipeline that benchmarks three state-of-the-art 3D reconstruction models-Hunyuan-3D, Trellis-3D, and Ouroboros-3D-on cust…
3D ReconstructionNEOviz: Uncertainty-Driven Visual Analysis of Asteroid Trajectories
We introduce NEOviz, an interactive visualization system designed to assist planetary defense experts in the visual analysis of the movements of near-Earth objects in the Solar System that might prove hazardous to Earth.…