Visual Relationship Prediction via Label Clustering and Incorporation of Depth Information
In this paper, we investigate the use of an unsupervised label clustering technique and demonstrate that it enables substantial improvements in visual relationship prediction accuracy on the Person in Context (PIC) dataset. We propose to group object labels with similar patterns of relationship distribution in the dataset into fewer categories. Label clustering not only mitigates both the large classification space and class imbalance issues, but also potentially increases data samples for each clustered category. We further propose to incorporate depth information as an additional feature into the instance segmentation model. The additional depth prediction path supplements the relationship prediction model in a way that bounding boxes or segmentation masks are unable to deliver. We have rigorously evaluated the proposed techniques and performed various ablation analysis to validate the benefits of them.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDepth EstimationDepth PredictionGeneral ClassificationInstance SegmentationPredictionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Tensor Composition Net for Visual Relationship Prediction
We present a novel Tensor Composition Net (TCN) to predict visual relationships in images. Visual Relationship Prediction (VRP) provides a more challenging test of image understanding than conventional image tagging and …
Extreme Multi-Label Classificationimage-classificationImage ClassificationImage Retrieval+6Scene Graph Prediction with Limited Labels
Visual knowledge bases such as Visual Genome power numerous applications in computer vision, including visual question answering and captioning, but suffer from sparse, incomplete relationships. All scene graph models to…
Knowledge Base CompletionPredictionQuestion AnsweringTransfer Learning+2Preserving Clusters in Prompt Learning for Unsupervised Domain Adaptation
Recent approaches leveraging multi-modal pre-trained models like CLIP for Unsupervised Domain Adaptation (UDA) have shown significant promise in bridging domain gaps and improving generalization by utilizing rich sem…
Domain AdaptationPrompt LearningUnsupervised Domain AdaptationSemantic-Enhanced Image Clustering
Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the i…
ClusteringImage ClusteringSelf-Supervised LearningDeep Contrastive Graph Learning with Clustering-Oriented Guidance
Graph Convolutional Network (GCN) has exhibited remarkable potential in improving graph-based clustering. To handle the general clustering scenario without a prior graph, these models estimate an initial graph beforehand…
ClusteringContrastive LearningGraph Learning