Tensor-Based High-Order Semantic Relation Transfer for Semantic Scene Segmentation
We propose a novel nonparametric approach for semantic segmentation using high-order semantic relations. Conventional context models mainly focus on learning pairwise relationships between objects. Pairwise relations, however, are not enough to represent high-level contextual knowledge within images. In this paper, we propose semantic relation transfer, a method to transfer high-order semantic relations of objects from annotated images to unlabeled images analogous to label transfer techniques where label information are transferred. We first define semantic tensors representing high-order relations of objects. Semantic relation transfer problem is then formulated as semi-supervised learning using a quadratic objective function of the semantic tensors. By exploiting low-rank property of the semantic tensors and employing Kronecker sum similarity, an efficient approximation algorithm is developed. Based on the predicted high-order semantic relations, we reason semantic segmentation and evaluate the performance on several challenging datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
RelationScene SegmentationSegmentationSemantic SegmentationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Fast Disentangled Slim Tensor Learning for Multi-view Clustering
Tensor-based multi-view clustering has recently received significant attention due to its exceptional ability to explore cross-view high-order correlations. However, most existing methods still encounter some limitations…
ClusteringDisentanglementModeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field Inference
Second-order semantic parsing with end-to-end mean-field inference has been shown good performance. In this work we aim to improve this method by modeling label correlations between adjacent arcs. However, direct modelin…
Dependency ParsingSemantic Dependency ParsingSemantic ParsingSentence+1Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model
We present a simple and effective feed-forward neural architecture for discriminating between lexico-semantic relations (synonymy, antonymy, hypernymy, and meronymy). Our Specialization Tensor Model (STM) simultaneously …
Natural Language InferenceParaphrase GenerationText SimplificationWord EmbeddingsLEARNING SEMANTIC WORD RESPRESENTATIONS VIA TENSOR FACTORIZATION
Many state-of-the-art word embedding techniques involve factorization of a cooccurrence based matrix. We aim to extend this approach by studying word embedding techniques that involve factorization of co-occurrence based…
Outlier DetectionTensor decomposition of higher-order correlations by nonlinear Hebbian plasticity
Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the comput…
Tensor Decomposition