paper-with-me

Papers

Detecting Objects with Context-Likelihood Graphs and Graph Refinement

2022-12-23 · ICCV 2023 1 · Aritra Bhowmik, Yu Wang, Nora Baka, Martin R. Oswald, Cees G. M. Snoek

The goal of this paper is to detect objects by exploiting their interrelationships. Contrary to existing methods, which learn objects and relations separately, our key idea is to learn the object-relation distribution jointly. We first propose a novel way of creating a graphical representation of an image from inter-object relation priors and initial class predictions, we call a context-likelihood graph. We then learn the joint distribution with an energy-based modeling technique which allows to sample and refine the context-likelihood graph iteratively for a given image. Our formulation of jointly learning the distribution enables us to generate a more accurate graph representation of an image which leads to a better object detection performance. We demonstrate the benefits of our context-likelihood graph formulation and the energy-based graph refinement via experiments on the Visual Genome and MS-COCO datasets where we achieve a consistent improvement over object detectors like DETR and Faster-RCNN, as well as alternative methods modeling object interrelationships separately. Our method is detector agnostic, end-to-end trainable, and especially beneficial for rare object classes.

📄 PDF Abstract BibTeX arXiv:2212.12395

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject DetectionRelation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Detecting out-of-context objects using contextual cues

2022-02-11 · Manoj Acharya, Anirban Roy, Kaushik Koneripalli, Susmit Jha 외

This paper presents an approach to detect out-of-context (OOC) objects in an image. Given an image with a set of objects, our goal is to determine if an object is inconsistent with the scene context and detect the OOC ob…

Anomaly DetectionObject

Image Retrieval Using Scene Graphs

2015-06-01 · CVPR 2015 6 · Justin Johnson, Ranjay Krishna, Michael Stark, Li-Jia Li 외

This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects ("man", "boat"), attributes of objects ("boat is white") and relationships betwe…

Image RetrievalObject LocalizationRetrieval

Modeling Complex Object Changes in Satellite Image Time-Series: Approach based on CSP and Spatiotemporal Graph

2023-05-24 · Zouhayra Ayadi, Wadii Boulila, Imed Riadh Farah

This paper proposes a method for automatically monitoring and analyzing the evolution of complex geographic objects. The objects are modeled as a spatiotemporal graph, which separates filiation relations, spatial relatio…

Time Series

MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization

2025-12-03 · Gihyeon Lee, Jungwoo Lee, Juwon Kim, Young-Sik Shin 외 arxiv

Robots are often required to localize in environments with unknown object classes and semantic ambiguity. However, when performing global localization using semantic objects, high semantic ambiguity intensifies object mi…

Semantic correspondencePose EstimationGraph Matching

Detecting User Community in Sparse Domain via Cross-Graph Pairwise Learning

2020-09-06 · Zheng Gao, Hongsong Li, Zhuoren Jiang, Xiaozhong Liu

Cyberspace hosts abundant interactions between users and different kinds of objects, and their relations are often encapsulated as bipartite graphs. Detecting user community in such heterogeneous graphs is an essential t…

Community Detection