MIMA: MAPPER-Induced Manifold Alignment for Semi-Supervised Fusion of Optical Image and Polarimetric SAR Data
Multi-modal data fusion has recently been shown promise in classification tasks in remote sensing. Optical data and radar data, two important yet intrinsically different data sources, are attracting more and more attention for potential data fusion. It is already widely known that, a machine learning based methodology often yields excellent performance. However, the methodology relies on a large training set, which is very expensive to achieve in remote sensing. The semi-supervised manifold alignment (SSMA), a multi-modal data fusion algorithm, has been designed to amplify the impact of an existing training set by linking labeled data to unlabeled data via unsupervised techniques. In this paper, we explore the potential of SSMA in fusing optical data and polarimetric SAR data, which are multi-sensory data sources. Furthermore, we propose a MAPPER-induced manifold alignment (MIMA) for semi-supervised fusion of multi-sensory data sources. Our proposed method unites SSMA with MAPPER, which is developed from the emerging topological data analysis (TDA) field. To our best knowledge, this is the first time that SSMA has been applied on fusing optical data and SAR data, and also the first time that TDA has been applied in remote sensing. The conventional SSMA derives a topological structure using k-nearest-neighbor (kNN), while MIMA employs MAPPER, which considers the field knowledge and derives a novel topological structure through the spectral clustering in a data-driven fashion. Experiment results on data fusion with respect to land cover land use classification and local climate zone classification suggest superior performance of MIMA.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringGeneral ClassificationTopological Data AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semimage: HSV-Based Semantic Image Encoding for Disentangled Text Representation
We propose SemImage, a novel method for representing a text document as a two-dimensional semantic image to be processed by convolutional neural networks (CNNs). In a SemImage, each word is represented as a pixel in a 2D…
Document ClassificationText ClassificationMulti-Task LearningMartingale property of exponential semimartingales: a note on explicit conditions and applications to financial models
We give a collection of explicit sufficient conditions for the true martingale property of a wide class of exponentials of semimartingales. We express the conditions in terms of semimartingale characteristics. This turns…
ShapeVis: High-dimensional Data Visualization at Scale
We present ShapeVis, a scalable visualization technique for point cloud data inspired from topological data analysis. Our method captures the underlying geometric and topological structure of the data in a compressed gra…
Community DetectionData VisualizationDimensionality ReductionTopological Data Analysis+1Power Forward Performance in Semimartingale Markets with Stochastic Integrated Factors
We study the forward investment performance process (FIPP) in an incomplete semimartingale market model with closed and convex portfolio constraints, when the investor's risk preferences are of the power form. We provide…
TripletPortfolio optimisation beyond semimartingales: shadow prices and fractional Brownian motion
While absence of arbitrage in frictionless financial markets requires price processes to be semimartingales, non-semimartingales can be used to model prices in an arbitrage-free way, if proportional transaction costs are…