Synthetic Data for Semantic Image Segmentation of Imagery of Unmanned Spacecraft
Images of spacecraft photographed from other spacecraft operating in outer space are difficult to come by, especially at a scale typically required for deep learning tasks. Semantic image segmentation, object detection and localization, and pose estimation are well researched areas with powerful results for many applications, and would be very useful in autonomous spacecraft operation and rendezvous. However, recent studies show that these strong results in broad and common domains may generalize poorly even to specific industrial applications on earth. To address this, we propose a method for generating synthetic image data that are labelled for semantic segmentation, generalizable to other tasks, and provide a prototype synthetic image dataset consisting of 2D monocular images of unmanned spacecraft, in order to enable further research in the area of autonomous spacecraft rendezvous. We also present a strong benchmark result (S{\o}rensen-Dice coefficient 0.8723) on these synthetic data, suggesting that it is feasible to train well-performing image segmentation models for this task, especially if the target spacecraft and its configuration are known.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Segmentationobject-detectionObject DetectionPose EstimationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery using Deep Learning
Deep convolutional neural networks (DCNNs) have been used to achieve state-of-the-art performance on many computer vision tasks (e.g., object recognition, object detection, semantic segmentation) thanks to a large reposi…
object-detectionObject DetectionObject RecognitionSegmentation+1Enabling Plant Phenotyping in Weedy Environments using Multi-Modal Imagery via Synthetic and Generated Training Data
Accurate plant segmentation in thermal imagery remains a significant challenge for high throughput field phenotyping, particularly in outdoor environments where low contrast between plants and weeds and frequent occlusio…
Semantic SegmentationImage SegmentationWeakly-Supervised Semantic Segmentation of Circular-Scan, Synthetic-Aperture-Sonar Imagery
We propose a weakly-supervised framework for the semantic segmentation of circular-scan synthetic-aperture-sonar (CSAS) imagery. The first part of our framework is trained in a supervised manner, on image-level labels, t…
SegmentationSemantic SegmentationStructured PredictionWeakly supervised Semantic Segmentation+1Conditional Generative Adversarial Networks for Data Augmentation and Adaptation in Remotely Sensed Imagery
The difficulty in obtaining labeled data relevant to a given task is among the most common and well-known practical obstacles to applying deep learning techniques to new or even slightly modified domains. The data volume…
Data Augmentationobject-detectionObject DetectionSegmentation+1Contrastive Multiview Coding with Electro-optics for SAR Semantic Segmentation
In the training of deep learning models, how the model parameters are initialized greatly affects the model performance, sample efficiency, and convergence speed. Representation learning for model initialization has rece…
Representation LearningSemantic Segmentation