OSCAR-Net: Object-centric Scene Graph Attention for Image Attribution
Images tell powerful stories but cannot always be trusted. Matching images back to trusted sources (attribution) enables users to make a more informed judgment of the images they encounter online. We propose a robust image hashing algorithm to perform such matching. Our hash is sensitive to manipulation of subtle, salient visual details that can substantially change the story told by an image. Yet the hash is invariant to benign transformations (changes in quality, codecs, sizes, shapes, etc.) experienced by images during online redistribution. Our key contribution is OSCAR-Net (Object-centric Scene Graph Attention for Image Attribution Network); a robust image hashing model inspired by recent successes of Transformers in the visual domain. OSCAR-Net constructs a scene graph representation that attends to fine-grained changes of every object's visual appearance and their spatial relationships. The network is trained via contrastive learning on a dataset of original and manipulated images yielding a state of the art image hash for content fingerprinting that scales to millions of images.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningGraph AttentionImage AttributionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
OSCaR: Object State Captioning and State Change Representation
The capability of intelligent models to extrapolate and comprehend changes in object states is a crucial yet demanding aspect of AI research, particularly through the lens of human interaction in real-world settings. Thi…
Change DetectionObjectEgo-OSCAR: Egocentric Open source Stereo CAptuRe System
We present Ego-OSCAR, an open-hardware, low-cost, head-mounted stereo-inertial capture device for egocentric data collection in the wild. EgoOSCAR pairs a hardware-synchronized global-shutter stereo camera with a 6- axis…
OSCAR: Open-Set CAD Retrieval from a Language Prompt and a Single Image
6D object pose estimation plays a crucial role in scene understanding for applications such as robotics and augmented reality. To support the needs of ever-changing object sets in such context, modern zero-shot object po…
Scene UnderstandingImage CaptioningPose EstimationSlot-VAE: Object-Centric Scene Generation with Slot Attention
Slot attention has shown remarkable object-centric representation learning performance in computer vision tasks without requiring any supervision. Despite its object-centric binding ability brought by compositional model…
ObjectRepresentation LearningScene GenerationImage-Level Attentional Context Modeling Using Nested-Graph Neural Networks
We introduce a new scene graph generation method called image-level attentional context modeling (ILAC). Our model includes an attentional graph network that effectively propagates contextual information across the graph…
Graph GenerationGraph Neural NetworkObjectScene Graph Generation