Multimodal Search in Chemical Documents and Reactions
We present a multimodal search tool that facilitates retrieval of chemical reactions, molecular structures, and associated text from scientific literature. Queries may combine molecular diagrams, textual descriptions, and reaction data, allowing users to connect different representations of chemical information. To support this, the indexing process includes chemical diagram extraction and parsing, extraction of reaction data from text in tabular form, and cross-modal linking of diagrams and their mentions in text. We describe the system's architecture, key functionalities, and retrieval process, along with expert assessments of the system. This demo highlights the workflow and technical components of the search system.
Code (1)
Tasks
RetrievalSimilar Papers 제목 키워드 기반
Chemical Reaction Extraction from Long Patent Documents
The task of searching through patent documents is crucial for chemical patent recommendation and retrieval. This can be enhanced by creating a patent knowledge base (ChemPatKB) to aid in prior art searches and to provide…
The WEAVE Corpus: Annotating Synthetic Chemical Procedures in Patents with Chemical Named Entities
The Modern pharmaceutical industry depends on the iterative design of novel synthetic routes for drugs while not infringing on existing intellectual property rights. Such a design process calls for analyzing many existin…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERChem4DLLM: 4D Multimodal LLMs for Chemical Dynamics Understanding
Existing chemical understanding tasks primarily rely on static molecular representations, limiting their ability to model inherently dynamic phenomena such as bond breaking or conformational changes, which are essential …
Detecting Chemical Reactions in Patents
Extracting chemical reactions from patents is a crucial task for chemists working on chemical exploration. In this paper we introduce the novel task of detecting the textual spans that describe or refer to chemical react…
ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area
Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which …
Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model+3