Salience-SGG: Enhancing Unbiased Scene Graph Generation with Iterative Salience Estimation
Scene Graph Generation (SGG) suffers from a long-tailed distribution, where a few predicate classes dominate while many others are underrepresented, leading to biased models that underperform on rare relations. Unbiased-SGG methods address this issue by implementing debiasing strategies, but often at the cost of spatial understanding, resulting in an over-reliance on semantic priors. We introduce Salience-SGG, a novel framework featuring an Iterative Salience Decoder (ISD) that emphasizes triplets with salient spatial structures. To support this, we propose semantic-agnostic salience labels guiding ISD. Evaluations on Visual Genome, Open Images V6, and GQA-200 show that Salience-SGG achieves state-of-the-art performance and improves existing Unbiased-SGG methods in their spatial understanding as demonstrated by the Pairwise Localization Average Precision
Code (0)
등록된 구현이 없습니다.
Tasks
Unbiased Scene Graph GenerationSimilar Papers 제목 키워드 기반
Generalized Unbiased Scene Graph Generation
Existing Unbiased Scene Graph Generation (USGG) methods only focus on addressing the predicate-level imbalance that high-frequency classes dominate predictions of rare ones, while overlooking the concept-level imbalance.…
Graph GenerationScene Graph GenerationUnbiased Scene Graph GenerationUnbiased Scene Graph Generation in Videos
The task of dynamic scene graph generation (SGG) from videos is complicated and challenging due to the inherent dynamics of a scene, temporal fluctuation of model predictions, and the long-tailed distribution of the visu…
Graph GenerationScene Graph GenerationUnbiased Scene Graph GenerationFloCoDe: Unbiased Dynamic Scene Graph Generation with Temporal Consistency and Correlation Debiasing
Dynamic scene graph generation (SGG) from videos requires not only a comprehensive understanding of objects across scenes but also a method to capture the temporal motions and interactions with different objects. Moreove…
Graph GenerationScene Graph GenerationUnbiased Scene Graph GenerationTowards Unbiased and Robust Spatio-Temporal Scene Graph Generation and Anticipation
Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modelling objects and their evolving relationships over time. However, real-world visual relationships often exhib…
Graph GenerationScene Graph GenerationSpatio-temporal Scene GraphsVideo scene graph generationBipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation
Scene graph generation is an important visual understanding task with a broad range of vision applications. Despite recent tremendous progress, it remains challenging due to the intrinsic long-tailed class distribution a…
Graph GenerationGraph Neural NetworkScene Graph GenerationUnbiased Scene Graph Generation