paper-with-me

Papers

A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks

2017-03-15 · Satoshi Tsutsui, David Crandall

A key problem in automatic analysis and understanding of scientific papers is to extract semantic information from non-textual paper components like figures, diagrams, tables, etc. Much of this work requires a very first preprocessing step: decomposing compound multi-part figures into individual subfigures. Previous work in compound figure separation has been based on manually designed features and separation rules, which often fail for less common figure types and layouts. Moreover, few implementations for compound figure decomposition are publicly available. This paper proposes a data driven approach to separate compound figures using modern deep Convolutional Neural Networks (CNNs) to train the separator in an end-to-end manner. CNNs eliminate the need for manually designing features and separation rules, but require a large amount of annotated training data. We overcome this challenge using transfer learning as well as automatically synthesizing training exemplars. We evaluate our technique on the ImageCLEF Medical dataset, achieving 85.9% accuracy and outperforming previous techniques. We have released our implementation as an easy-to-use Python library, aiming to promote further research in scientific figure mining.

📄 PDF Abstract BibTeX arXiv:1703.05105

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

A Two-stage Framework for Compound Figure Separation

2021-01-25 · Weixin Jiang, Eric Schwenker, Trevor Spreadbury, Nicola Ferrier 외

Scientific literature contains large volumes of complex, unstructured figures that are compound in nature (i.e. composed of multiple images, graphs, and drawings). Separation of these compound figures is critical for inf…

feature selectionInformation RetrievalRetrievalVocal Bursts Valence Prediction

Automatic Separation of Compound Figures in Scientific Articles

2016-06-03 · Mario Taschwer, Oge Marques

Content-based analysis and retrieval of digital images found in scientific articles is often hindered by images consisting of multiple subfigures (compound figures). We address this problem by proposing a method to autom…

ArticlesRetrieval

Compound Figure Separation of Biomedical Images: Mining Large Datasets for Self-supervised Learning

2022-08-30 · Tianyuan Yao, Chang Qu, Jun Long, Quan Liu 외

With the rapid development of self-supervised learning (e.g., contrastive learning), the importance of having large-scale images (even without annotations) for training a more generalizable AI model has been widely recog…

Contrastive LearningImage Augmentationimage-classificationImage Classification+2

Compound Figure Separation of Biomedical Images with Side Loss

2021-07-19 · Tianyuan Yao, Chang Qu, Quan Liu, Ruining Deng 외

Unsupervised learning algorithms (e.g., self-supervised learning, auto-encoder, contrastive learning) allow deep learning models to learn effective image representations from large-scale unlabeled data. In medical image …

Contrastive LearningImage AugmentationMedical Image AnalysisSelf-Supervised Learning

Semantic Segmentation for Compound figures

2019-12-16 · Weixin Jiang, Eric Schwenker, Maria Chan, Oliver Cossairt

Scientific literature contains large volumes of unstructured data,with over 30\% of figures constructed as a combination of multiple images, these compound figures cannot be analyzed directly with existing information re…

Information RetrievalRetrievalSegmentationSemantic Segmentation