paper-with-me

Papers

MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generation

2022-05-28 · Yujie Qian, Jiang Guo, Zhengkai Tu, Zhening Li, Connor W. Coley, Regina Barzilay

Molecular structure recognition is the task of translating a molecular image into its graph structure. Significant variation in drawing styles and conventions exhibited in chemical literature poses a significant challenge for automating this task. In this paper, we propose MolScribe, a novel image-to-graph generation model that explicitly predicts atoms and bonds, along with their geometric layouts, to construct the molecular structure. Our model flexibly incorporates symbolic chemistry constraints to recognize chirality and expand abbreviated structures. We further develop data augmentation strategies to enhance the model robustness against domain shifts. In experiments on both synthetic and realistic molecular images, MolScribe significantly outperforms previous models, achieving 76-93% accuracy on public benchmarks. Chemists can also easily verify MolScribe's prediction, informed by its confidence estimation and atom-level alignment with the input image. MolScribe is publicly available through Python and web interfaces: https://github.com/thomas0809/MolScribe.

📄 PDF Abstract BibTeX arXiv:2205.14311

Code (2)

thomas0809/molscribe 공식 구현 pytorch
DS4SD/MarkushGrapher pytorch

Tasks

Data AugmentationGraph Generation

Similar Papers 제목 키워드 기반

Exploring the Role of Artificial Intelligence and Machine Learning in Process Optimization for Chemical Industry

2025-02-15 · Zishuo Lin, Jiajie Wang, Zhe Yan, Peiyong Ma

The crucial field of Optical Chemical Structure Recognition (OCSR) aims to transform chemical structure photographs into machine-readable formats so that chemical databases may be efficiently stored and queried. Although…

SMiCRM: A Benchmark Dataset of Mechanistic Molecular Images

2024-07-25 · Ching Ting Leung, Yufan Chen, Hanyu Gao

Optical chemical structure recognition (OCSR) systems aim to extract the molecular structure information, usually in the form of molecular graph or SMILES, from images of chemical molecules. While many tools have been de…

Benchmarking

Image-to-Graph Transformers for Chemical Structure Recognition

2022-02-19 · Sanghyun Yoo, Ohyun Kwon, Hoshik Lee

For several decades, chemical knowledge has been published in written text, and there have been many attempts to make it accessible, for example, by transforming such natural language text to a structured format. Althoug…

GTR-CoT: Graph Traversal as Visual Chain of Thought for Molecular Structure Recognition

2025-06-09 · JingChao Wang, Haote Yang, Jiang Wu, Yifan He 외

Optical Chemical Structure Recognition (OCSR) is crucial for digitizing chemical knowledge by converting molecular images into machine-readable formats. While recent vision-language models (VLMs) have shown potential in …

Image Captioning

MolNexTR: A Generalized Deep Learning Model for Molecular Image Recognition

2024-03-06 · Yufan Chen, Ching Ting Leung, Yong Huang, Jianwei Sun 외

In the field of chemical structure recognition, the task of converting molecular images into machine-readable data formats such as SMILES string stands as a significant challenge, primarily due to the varied drawing styl…

Data AugmentationDeep Learning