Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations

2026-03-01 · Chengtai Li, Yuting He, Jianfeng Ren, Ruibin Bai, Yitian Zhao, Heng Yu, Xudong Jiang arxiv

While visual reasoning for simple analogies has received significant attention, compositional visual relations (CVR) remain relatively unexplored due to their greater complexity. To solve CVR tasks, we propose Predictive Reasoning with Augmented Anomaly Contrastive Learning (PR-A$^2$CL), \ie, to identify an outlier image given three other images that follow the same compositional rules. To address the challenge of modelling abundant compositional rules, an Augmented Anomaly Contrastive Learning is designed to distil discriminative and generalizable features by maximizing similarity among normal instances while minimizing similarity between normal and anomalous outliers. More importantly, a predict-and-verify paradigm is introduced for rule-based reasoning, in which a series of Predictive Anomaly Reasoning Blocks (PARBs) iteratively leverage features from three out of the four images to predict those of the remaining one. Throughout the subsequent verification stage, the PARBs progressively pinpoint the specific discrepancies attributable to the underlying rules. Experimental results on SVRT, CVR and MC$^2$R datasets show that PR-A$^2$CL significantly outperforms state-of-the-art reasoning models.

📄 PDF Abstract BibTeX arXiv:2603.01125

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning Visual Reasoning

Contrastive Predictive Coding for Anomaly Detection

2021-07-16 · Puck de Haan, Sindy Löwe

Reliable detection of anomalies is crucial when deploying machine learning models in practice, but remains challenging due to the lack of labeled data. To tackle this challenge, contrastive learning approaches are becomi…

Anomaly Detection Anomaly Segmentation Contrastive Learning Representation Learning+1

Beyond Forecasting: Compositional Time Series Reasoning for End-to-End Task Execution

2024-10-05 · Wen Ye, Yizhou Zhang, Wei Yang, Lumingyuan Tang 외

In recent decades, there has been substantial advances in time series models and benchmarks across various individual tasks, such as time series forecasting, classification, and anomaly detection. Meanwhile, compositiona…

Anomaly Detection Decision Making Large Language Model Question Answering+2

CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models

2023-10-12 · Sreyan Ghosh, Ashish Seth, Sonal Kumar, Utkarsh Tyagi 외

A fundamental characteristic of audio is its compositional nature. Audio-language models (ALMs) trained using a contrastive approach (e.g., CLAP) that learns a shared representation between audio and language modalities …

Attribute Audio Classification Zero-shot Audio Classification

DACR: Distribution-Augmented Contrastive Reconstruction for Time-Series Anomaly Detection

2024-01-20 · Lixu Wang, Shichao Xu, Xinyu Du, Qi Zhu

Anomaly detection in time-series data is crucial for identifying faults, failures, threats, and outliers across a range of applications. Recently, deep learning techniques have been applied to this topic, but they often …

Anomaly Detection Contrastive Learning Time Series Time Series Anomaly Detection

Context-Aware Zero-Shot Anomaly Detection in Surveillance Using Contrastive and Predictive Spatiotemporal Modeling

2025-08-25 · Md. Rashid Shahriar Khan, Md. Abrar Hasan, Mohammod Tareq Aziz Justice arxiv

Detecting anomalies in surveillance footage is inherently challenging due to their unpredictable and context-dependent nature. This work introduces a novel context-aware zero-shot anomaly detection framework that identif…

Anomaly Detection