CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations

2026-06-02 · Yuxin Zhang, Yiyao Li, Ping Shu Ho, Simon See, Zhenqin Wu, Kevin Tsia arxiv

Cell Painting combines multiplexed fluorescent staining, high-content imaging, and quantitative analysis to generate high-dimensional phenotypic readouts to support diverse downstream tasks such as mechanism-of-action (MoA) inference, toxicity prediction, and construction of drug-disease atlases. However, existing workflows are slow, costly and difficult to interpret. Approaches for drug screening modeling predominantly focus on molecular representation learning, while neglecting actual experimental context (e.g., cell line, dosing schedule, etc.), limiting generalization and MoA resolution. We introduce CP-Agent, an agentic multimodal large language model (MLLM) capable of generating mechanism-relevant, human-interpretable rationales for cell morphological changes under drug perturbations. At its core, CP-Agent leverages a context-aware alignment module, CP-CLIP, that jointly embeds high-content images and experimental metadata to enable robust treatment and MoA discrimination (achieving a maximum F1-score of 0.896). By integrating CP-CLIP outputs with agentic tool usage and reasoning, CP-Agent compiles rationales into a structured report to guide experimental design and hypothesis refinement. These capabilities highlight CP-Agent's potential to accelerate drug discovery by enabling more interpretable, scalable, and context-aware phenotypic screening -- streamlining iterative cycles of hypothesis generation in drug discovery.

📄 PDF Abstract BibTeX arXiv:2606.03435

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning Multimodal Reasoning Drug Discovery

MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA

2026-06-04 · Kaifeng Chen, Hongtao Liu, Qiyao Peng, Jian Yang 외 arxiv

Iterative retrieval-reasoning agents have recently shown promise for multimodal long-document question answering. However, most existing systems maintain a single growing context that mixes retrieval traces, observations…

Question Answering

RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows

2025-09-24 · Kai Zhang, Corey D Barrett, Jangwon Kim, Lichao Sun 외 arxiv

Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use and external knowledge bases. Nevertheless, for chest X-ray (CXR) interpretatio…

Multimodal Reasoning

DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

2026-06-29 · Xinxin Chen, Yuchen Li, Zihan Wang, Haoyu Zhang 외 arxiv

Current multimodal fusion approaches, particularly those based on static Mixture-of-Experts (MoE) architectures, often struggle to provide the adaptive and efficient collaborative reasoning required by complex real-world…

Computational Efficiency Multimodal Reasoning

Context-Aware RL for Agentic and Multimodal LLMs

2026-06-15 · Peiyang Xu, Bangzheng Li, Sijia Liu, Karthik R. Narasimhan 외 arxiv

Large language models (LLMs) often fail when answering requires identifying a small but decisive piece of evidence within a long or complex context, such as a single line in a tool trace or a subtle detail in an image. W…

Visual Question Answering Reinforcement Learning Multimodal Reasoning

MemOCR: Layout-Aware Visual Memory for Efficient Long-Horizon Reasoning

2026-01-29 · Yaorui Shi, Shugui Liu, Yu Yang, Wenyu Mao 외 arxiv

Long-horizon agentic reasoning necessitates effectively compressing growing interaction histories into a limited context window. Most existing memory systems serialize history as text, where token-level cost is uniform a…

Reinforcement Learning