paper-with-me

Papers

A Simple Baseline for Weakly-Supervised Scene Graph Generation

2021-01-01 · ICCV 2021 10 · Jing Shi, Yiwu Zhong, Ning Xu, Yin Li, Chenliang Xu

We investigate the weakly-supervised scene graph generation, which is a challenging task since no correspondence of label and object is provided. The previous work regards such correspondence as a latent variable which is iteratively updated via nested optimization of the scene graph generation objective. However, we further reduce the complexity by decoupling it into an efficient first-order graph matching module optimized via contrastive learning to obtain such correspondence, which is used to train a standard scene graph generation model. The extensive experiments show that such a simple pipeline can significantly surpass the previous state-of-the-art by more than 30% on the Visual Genome dataset, both in terms of graph matching accuracy and scene graph quality. We believe this work serves as a strong baseline for future research.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningGraph GenerationGraph MatchingScene Graph Generation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Audio Event and Scene Recognition: A Unified Approach using Strongly and Weakly Labeled Data

2016-11-12 · Anurag Kumar, Bhiksha Raj

In this paper we propose a novel learning framework called Supervised and Weakly Supervised Learning where the goal is to learn simultaneously from weakly and strongly labeled data. Strongly labeled data can be simply un…

Scene RecognitionWeakly-supervised Learning

Weakly Supervised Visual Semantic Parsing

2020-01-08 · CVPR 2020 6 · Alireza Zareian, Svebor Karaman, Shih-Fu Chang

Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications such as visual reasoning and image retriev…

Graph GenerationImage RetrievalRetrievalScene Graph Generation+3

WeCromCL: Weakly Supervised Cross-Modality Contrastive Learning for Transcription-only Supervised Text Spotting

2024-07-28 · Jingjing Wu, Zhengyao Fang, Pengyuan Lyu, Chengquan Zhang 외

Transcription-only Supervised Text Spotting aims to learn text spotters relying only on transcriptions but no text boundaries for supervision, thus eliminating expensive boundary annotation. The crux of this task lies in…

Contrastive LearningText Spotting

Visual Distant Supervision for Scene Graph Generation

2021-03-29 · ICCV 2021 10 · Yuan YAO, Ao Zhang, Xu Han, Mengdi Li 외

Scene graph generation aims to identify objects and their relations in images, providing structured image representations that can facilitate numerous applications in computer vision. However, scene graph models usually …

Graph GenerationPredicate ClassificationRelationScene Graph Generation

Exploring Visual Context for Weakly Supervised Person Search

2021-06-19 · Yichao Yan, Jinpeng Li, Shengcai Liao, Jie Qin 외

Person search has recently emerged as a challenging task that jointly addresses pedestrian detection and person re-identification. Existing approaches follow a fully supervised setting where both bounding box and identit…

ClusteringPedestrian DetectionPerson Re-IdentificationPerson Search