paper-with-me

Papers

Contextual Representation Anchor Network to Alleviate Selection Bias in Few-Shot Drug Discovery

2024-10-28 · Ruifeng Li, Wei Liu, Xiangxin Zhou, Mingqian Li, Qiang Zhang, Hongyang Chen, Xuemin Lin

In the drug discovery process, the low success rate of drug candidate screening often leads to insufficient labeled data, causing the few-shot learning problem in molecular property prediction. Existing methods for few-shot molecular property prediction overlook the sample selection bias, which arises from non-random sample selection in chemical experiments. This bias in data representativeness leads to suboptimal performance. To overcome this challenge, we present a novel method named contextual representation anchor Network (CRA), where an anchor refers to a cluster center of the representations of molecules and serves as a bridge to transfer enriched contextual knowledge into molecular representations and enhance their expressiveness. CRA introduces a dual-augmentation mechanism that includes context augmentation, which dynamically retrieves analogous unlabeled molecules and captures their task-specific contextual knowledge to enhance the anchors, and anchor augmentation, which leverages the anchors to augment the molecular representations. We evaluate our approach on the MoleculeNet and FS-Mol benchmarks, as well as in domain transfer experiments. The results demonstrate that CRA outperforms the state-of-the-art by 2.60% and 3.28% in AUC and $\Delta$AUC-PR metrics, respectively, and exhibits superior generalization capabilities.

📄 PDF Abstract BibTeX arXiv:2410.20711

Code (0)

등록된 구현이 없습니다.

Tasks

Drug DiscoveryFew-Shot LearningMolecular Property PredictionProperty PredictionSelection bias

Similar Papers 제목 키워드 기반

Code-Switching Reveals Language Anchoring in Multilingual LLMs

2026-06-18 · Jeonghyun Park, Seunghyun Yoon, Yonghyun Jun, Hwanhee Lee arxiv

Multilingual Large Language Models (MLLMs) are increasingly expected to handle Code-Switched (CS) inputs, yet mixing languages frequently degrades performance relative to source- or target-language monolingual counterpar…

Question Answering

Lost in Context? On the Sense-wise Variance of Contextualized Word Embeddings

2022-08-20 · Yile Wang, Yue Zhang

Contextualized word embeddings in language models have given much advance to NLP. Intuitively, sentential information is integrated into the representation of words, which can help model polysemy. However, context sensit…

PositionSentenceWord EmbeddingsWord Sense Disambiguation

AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning

2026-07-08 · Kyuan Oh, Bumsoo Kim arxiv

Large vision-language models incur substantial inference costs because high-resolution inputs introduce thousands of visual tokens, many of which are redundant for a given query. Existing pruning methods often combine qu…

Open-set Text Recognition via Character-Context Decoupling

2022-04-12 · CVPR 2022 1 · Chang Liu, Chun Yang, Xu-Cheng Yin

The open-set text recognition task is an emerging challenge that requires an extra capability to cognize novel characters during evaluation. We argue that a major cause of the limited performance for current methods is t…

Contextual StereoSet: Stress-Testing Bias Alignment Robustness in Large Language Models

2026-01-15 · Abhinaba Basu, Pavan Chakraborty arxiv

A model that avoids stereotypes in a lab benchmark may not avoid them in deployment. We show that measured bias shifts dramatically when prompts mention different places, times, or audiences -- no adversarial prompting r…