paper-with-me

Papers

SVC-Probe: A Framework for Evaluating Perturbation Generalization in Spatial Foundation-Model Embeddings

2026-06-26 · Jake Y. Chen, Huu Phong Nguyen, Fuad Al Abir, Ehsan Saghapour arxiv

This work examines perturbation generalization in spatial foundation-model embeddings derived from fluorescence microscopy images. Although these models can discriminate drug conditions accurately, it remains unclear whether the learned representations reflect patterns consistent with expected perturbation axes that transfer across drugs. We introduce SVC-Probe, a perturbation-aware framework that combines Subcellular Embedding Atlas Stability, Mondrian Neighborhood Graphs, and a Foundation Model Perturbation Probe to assess embedding stability, neighborhood rewiring, and centroid prediction under drug treatment. Applied to the CM4AI MDA-MB-468 chemical-perturbation atlas comprising 462 antibody labels and SubCell 1536-dimensional embeddings, SVC-Probe demonstrates that 98.6% three-way condition accuracy does not correlate with reliable cross-drug prediction, with cosine similarity diminishing from 0.944 in-domain to 0.30 under leave-one-drug-out evaluation, constituting a two-drug stress test rather than a general benchmark. Null calibration indicates that raw residual-turnover coupling is largely influenced by generic embedding structure, whereas a drug-specific signal emerges under vorinostat and is consistent with chromatin-related reorganization. In contrast, the paclitaxel axis is not robustly reconstructed, likely due to sparse coverage of microtubule-associated proteins. Together, these results introduce and demonstrate a reusable diagnostic framework for stress-testing spatial virtual-cell representations and indicate that perturbation generalization may serve as a stricter and more informative benchmark than baseline condition discrimination.

📄 PDF Abstract BibTeX arXiv:2606.28465

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Show, Don't Tell: Evaluating Large Language Models Beyond Textual Understanding with ChildPlay

2024-07-12 · Gonçalo Hora de Carvalho, Oscar Knap, Robert Pollice

We develop a systematic benchmark set to test the generalization of state-of-the-art large language models on broader problems beyond linguistic tasks and evaluate it on a systematic progression of GPT models (GPT-3.5, G…

Spatial Reasoning

Predicting Deep Neural Network Generalization with Perturbation Response Curves

2021-06-09 · NeurIPS 2021 12 · Yair Schiff, Brian Quanz, Payel Das, Pin-Yu Chen

The field of Deep Learning is rich with empirical evidence of human-like performance on a variety of prediction tasks. However, despite these successes, the recent Predicting Generalization in Deep Learning (PGDL) NeurIP…

Non-robust Features through the Lens of Universal Perturbations

2021-01-01 · Sung Min Park, Kuo-An Wei, Kai Yuanqing Xiao, Jerry Li 외

Recent work ties adversarial perturbations to so-called non-robust features. These are features which are susceptible to small perturbations and believed to be incomprehensible to humans, but still useful for (generaliza…

Causally Guided Gaussian Perturbations for Out-Of-Distribution Generalization in Medical Imaging

2025-09-30 · Haoran Pei, Yuguang Yang, Kexin Liu, Baochang Zhang arxiv

Out-of-distribution (OOD) generalization remains a central challenge in deploying deep learning models to real-world scenarios, particularly in domains such as biomedical images, where distribution shifts are both subtle…

RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms

2020-05-02 · EMNLP 2021 11 · Pei Zhou, Rahul Khanna, Seyeon Lee, Bill Yuchen Lin 외

Pre-trained language models (PTLMs) have achieved impressive performance on commonsense inference benchmarks, but their ability to employ commonsense to make robust inferences, which is crucial for effective communicatio…