paper-with-me

Papers

Y-Mol: A Multiscale Biomedical Knowledge-Guided Large Language Model for Drug Development

2024-10-15 · Tengfei Ma, Xuan Lin, Tianle Li, Chaoyi Li, Long Chen, Peng Zhou, Xibao Cai, Xinyu Yang, Daojian Zeng, Dongsheng Cao, Xiangxiang Zeng

Large Language Models (LLMs) have recently demonstrated remarkable performance in general tasks across various fields. However, their effectiveness within specific domains such as drug development remains challenges. To solve these challenges, we introduce \textbf{Y-Mol}, forming a well-established LLM paradigm for the flow of drug development. Y-Mol is a multiscale biomedical knowledge-guided LLM designed to accomplish tasks across lead compound discovery, pre-clinic, and clinic prediction. By integrating millions of multiscale biomedical knowledge and using LLaMA2 as the base LLM, Y-Mol augments the reasoning capability in the biomedical domain by learning from a corpus of publications, knowledge graphs, and expert-designed synthetic data. The capability is further enriched with three types of drug-oriented instructions: description-based prompts from processed publications, semantic-based prompts for extracting associations from knowledge graphs, and template-based prompts for understanding expert knowledge from biomedical tools. Besides, Y-Mol offers a set of LLM paradigms that can autonomously execute the downstream tasks across the entire process of drug development, including virtual screening, drug design, pharmacological properties prediction, and drug-related interaction prediction. Our extensive evaluations of various biomedical sources demonstrate that Y-Mol significantly outperforms general-purpose LLMs in discovering lead compounds, predicting molecular properties, and identifying drug interaction events.

📄 PDF Abstract BibTeX arXiv:2410.11550

Code (0)

등록된 구현이 없습니다.

Tasks

Drug DesignKnowledge GraphsLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

BASE 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning

2022-04-11 · NAACL 2022 7 · Hongyi Yuan, Zheng Yuan, Sheng Yu

Entities lie in the heart of biomedical natural language understanding, and the biomedical entity linking (EL) task remains challenging due to the fine-grained and diversiform concept names. Generative methods achieve re…

DecoderEntity LinkingNatural Language Understanding

m-KAILIN: Knowledge-Driven Agentic Scientific Corpus Distillation Framework for Biomedical Large Language Models Training

2025-04-28 · Meng Xiao, Xunxin Cai, Qingqing Long, Chengrui Wang 외

Corpus distillation for biomedical large language models (LLMs) seeks to address the pressing challenge of insufficient quantity and quality in open-source annotated scientific corpora, which remains a bottleneck for eff…

Question Answering

Multivariate Multiscale Dispersion Entropy of Biomedical Times Series

2017-04-12

Objective: Due to the non-linearity of numerous biomedical signals, non-linear analysis of multi-channel time series, notably multivariate multiscale entropy (mvMSE), has been extensively used in biomedical signal proces…

Time SeriesTime Series Analysis

Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking

2023-05-07 · Deepak Gupta, Dina Demner-Fushman

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplis…

Language ModelingLanguage ModellingRe-Ranking

fastbmRAG: A Fast Graph-Based RAG Framework for Efficient Processing of Large-Scale Biomedical Literature

2025-11-13 · Guofeng Meng, Li Shen, Qiuyan Zhong, Wei Wang 외 arxiv

Large language models (LLMs) are rapidly transforming various domains, including biomedicine and healthcare, and demonstrate remarkable potential from scientific research to new drug discovery. Graph-based retrieval-augm…

Entity LinkingDrug Discovery