paper-with-me

Papers

SynCB: A Synergy Concept-Based Model with Dynamic Routing Between Concepts and Complementary Neural Branches

2026-05-20 · Tores Julie, Sun Rémy, Sassatelli Lucile, Ancarani Elisa, Wu Hui-Yin, Precioso Frédéric arxiv

Concept-based (CB) models provide interpretability and support test-time human intervention, while standard neural networks (NN) offer strong task performance but little transparency. Prior work has explored hybrid formulations that integrate concepts and additional representations to improve accuracy, often at the cost of human interventions. We introduce the \emph{Synergy Concept-Based Model (SynCB)} framework, that combines a CB branch with a complementary neural branch, and a trainable routing module that dynamically selects which branch to use for each input. Unlike prior models, which fuse residual and concept-based predictions, SynCB keeps the two branches distinct and coordinates them through the routing module. Moreover, both branches are learned jointly, allowing information sharing between the complementary neural branch and CB branches through their common backbone. To improve responsiveness to interventions, we further introduce a test-time intervention policy and a corresponding loss. Across five datasets and CB benchmarks, SynCB consistently achieves higher task accuracy while remaining more responsive to human interventions, surpassing the full neural baseline by up to 3.9 percentage points and exceeding the strongest competitor in intervention performance by up to 6.43 percentage points.

📄 PDF Abstract BibTeX arXiv:2605.20908

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AsyncBEV: Cross-modal Flow Alignment in Asynchronous 3D Object Detection

2026-01-19 · Shiming Wang, Holger Caesar, Liangliang Nan, Julian F. P. Kooij arxiv

In autonomous driving, multi-modal perception tasks like 3D object detection typically rely on well-synchronized sensors, both at training and inference. However, despite the use of hardware- or software-based synchroniz…

Scene Flow Estimation3D Object DetectionAutonomous Driving

Quantifying Synchronization in a Biologically Inspired Neural Network

2020-12-11 · Pranav Mahajan, Advait Rane, Swapna Sasi, Basabdatta Sen Bhattacharya

We present a collated set of algorithms to obtain objective measures of synchronisation in brain time-series data. The algorithms are implemented in MATLAB; we refer to our collated set of 'tools' as SyncBox. Our motivat…

EEGElectroencephalogram (EEG)SSVEPTime Series+1

SyncBreaker:Stage-Aware Multimodal Adversarial Attacks on Audio-Driven Talking Head Generation

2026-04-09 · Wenli Zhang, Xianglong Shi, Sirui Zhao, Xinqi Chen 외 arxiv

Diffusion-based audio-driven talking-head generation enables realistic portrait animation, but also introduces risks of misuse, such as fraud and misinformation. Existing protection methods are largely limited to a singl…

Talking Head Generation

Synergy: End-to-end Concept Model

2025-07-17 · Keli Zheng, Zerong Xie arxiv

In this paper, we present Synergy, a language model that bridges different levels of abstraction in an end-to-end fashion through a learned routing mechanism. Focusing on low-level linguistic abstraction, we trained our …

AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization

2026-07-01 · Tianhong Zhou, Mingyang Han, Boyu Li, Yuxuan Jiang 외 arxiv

Audio-visual feature extraction is a fundamental component of multimodal understanding and generation tasks. However, existing evaluation protocols for feature extraction models exhibit dimensional bias, typically focusi…