paper-with-me

홈 › Papers

Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications

2024-02-14 · David Oniani, Jordan Hilsman, Chengxi Zang, Junmei Wang, Lianjin Cai, Jan Zawala, Yanshan Wang

A drug molecule is a substance that changes the organism's mental or physical state. Every approved drug has an indication, which refers to the therapeutic use of that drug for treating a particular medical condition. While the Large Language Model (LLM), a generative Artificial Intelligence (AI) technique, has recently demonstrated effectiveness in translating between molecules and their textual descriptions, there remains a gap in research regarding their application in facilitating the translation between drug molecules and indications, or vice versa, which could greatly benefit the drug discovery process. The capability of generating a drug from a given indication would allow for the discovery of drugs targeting specific diseases or targets and ultimately provide patients with better treatments. In this paper, we first propose a new task, which is the translation between drug molecules and corresponding indications, and then test existing LLMs on this new task. Specifically, we consider nine variations of the T5 LLM and evaluate them on two public datasets obtained from ChEMBL and DrugBank. Our experiments show the early results of using LLMs for this task and provide a perspective on the state-of-the-art. We also emphasize the current limitations and discuss future work that has the potential to improve the performance on this task. The creation of molecules from indications, or vice versa, will allow for more efficient targeting of diseases and significantly reduce the cost of drug discovery, with the potential to revolutionize the field of drug discovery in the era of generative AI.

📄 PDF Abstract BibTeX arXiv:2402.09588

Code (0)

등록된 구현이 없습니다.

Tasks

Drug DiscoveryLanguage ModellingLarge Language ModelTranslation

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
SentencePiece 설명 없음
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Translation Analytics for Freelancers: I. Introduction, Data Preparation, Baseline Evaluations

2025-04-20 · Yuri Balashov, Alex Balashov, Shiho Fukuda Koski

This is the first in a series of papers exploring the rapidly expanding new opportunities arising from recent progress in language technologies for individual translators and language service providers with modest resour…

Machine TranslationTranslation

DiTTO-LLM: Framework for Discovering Topic-based Technology Opportunities via Large Language Model

2025-09-10 · Wonyoung Kim, Sujeong Seo, Juhyun Lee arxiv

Technology opportunities are critical information that serve as a foundation for advancements in technology, industry, and innovation. This paper proposes a framework based on the temporal relationships between technolog…

NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation

2023-02-15 · Quchen Fu, Zhongwei Teng, Marco Georgaklis, Jules White 외

Translating natural language into Bash Commands is an emerging research field that has gained attention in recent years. Most efforts have focused on producing more accurate translation models. To the best of our knowled…

Code TranslationDiversitySemantic ParsingTranslation

Scalable and Efficient MoE Training for Multitask Multilingual Models

2021-09-22 · Young Jin Kim, Ammar Ahmad Awan, Alexandre Muzio, Andres Felipe Cruz Salinas 외

The Mixture of Experts (MoE) models are an emerging class of sparsely activated deep learning models that have sublinear compute costs with respect to their parameters. In contrast with dense models, the sparse architect…

Machine TranslationMixture-of-ExpertsText Generation

Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey

2025-02-15 · Zirui Song, Bin Yan, YuHan Liu, Miao Fang 외

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits t…

Machine TranslationNatural Language UnderstandingText Summarization