MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain
The visual detection and tracking of surface terrain is required for spacecraft to safely land on or navigate within close proximity to celestial objects. Current approaches rely on template matching with pre-gathered patch-based features, which are expensive to obtain and a limiting factor in perceptual capability. While recent literature has focused on in-situ detection methods to enhance navigation and operational autonomy, robust description is still needed. In this work, we explore metric learning as the lightweight feature description mechanism and find that current solutions fail to address inter-class similarity and multi-view observational geometry. We attribute this to the view-unaware attention mechanism and introduce Multi-view Attention Regularizations (MARs) to constrain the channel and spatial attention across multiple feature views, regularizing the what and where of attention focus. We thoroughly analyze many modern metric learning losses with and without MARs and demonstrate improved terrain-feature recognition performance by upwards of 85%. We additionally introduce the Luna-1 dataset, consisting of Moon crater landmarks and reference navigation frames from NASA mission data to support future research in this difficult task. Luna-1 and source code are publicly available at https://droneslab.github.io/mars/.
Code (1)
Tasks
AttributeMetric LearningNavigateTemplate MatchingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MarsSQE: Stereo Quality Enhancement for Martian Images Using Bi-level Cross-view Attention
Stereo images captured by Mars rovers are transmitted after lossy compression due to the limited bandwidth between Mars and Earth. Unfortunately, this process results in undesirable compression artifacts. In this paper, …
VID-Trans-ReID: Enhanced Video Transformers for Person Re-identification
Video-based person Re-identification (Re-ID) has received increasing attention recently due to its important role within surveillance video analysis. Video-based Re- ID expands upon earlier image-based methods by extract…
Person Re-IdentificationVideo-Based Person Re-IdentificationPatchMatch-RL: Deep MVS with Pixelwise Depth, Normal, and Visibility
Recent learning-based multi-view stereo (MVS) methods show excellent performance with dense cameras and small depth ranges. However, non-learning based approaches still outperform for scenes with large depth ranges and s…
MarsCode Agent: AI-native Automated Bug Fixing
Recent advances in large language models (LLMs) have shown significant potential to automate various software development tasks, including code completion, test generation, and bug fixing. However, the application of LLM…
Bug fixingCode CompletionDiversityFault localizationAnalysing high resolution digital Mars images using machine learning
The search for ephemeral liquid water on Mars is an ongoing activity. After the recession of the seasonal polar ice cap on Mars, small water ice patches may be left behind in shady places due to the low thermal conductiv…