paper-with-me

홈 › Papers

Compound Figure Separation of Biomedical Images with Side Loss

2021-07-19 · Tianyuan Yao, Chang Qu, Quan Liu, Ruining Deng, Yuanhan Tian, Jiachen Xu, Aadarsh Jha, Shunxing Bao, Mengyang Zhao, Agnes B. Fogo, Bennett A. Landman, Catie Chang, Haichun Yang, Yuankai Huo

Unsupervised learning algorithms (e.g., self-supervised learning, auto-encoder, contrastive learning) allow deep learning models to learn effective image representations from large-scale unlabeled data. In medical image analysis, even unannotated data can be difficult to obtain for individual labs. Fortunately, national-level efforts have been made to provide efficient access to obtain biomedical image data from previous scientific publications. For instance, NIH has launched the Open-i search engine that provides a large-scale image database with free access. However, the images in scientific publications consist of a considerable amount of compound figures with subplots. To extract and curate individual subplots, many different compound figure separation approaches have been developed, especially with the recent advances in deep learning. However, previous approaches typically required resource extensive bounding box annotation to train detection models. In this paper, we propose a simple compound figure separation (SimCFS) framework that uses weak classification annotations from individual images. Our technical contribution is three-fold: (1) we introduce a new side loss that is designed for compound figure separation; (2) we introduce an intra-class image augmentation method to simulate hard cases; (3) the proposed framework enables an efficient deployment to new classes of images, without requiring resource extensive bounding box annotations. From the results, the SimCFS achieved a new state-of-the-art performance on the ImageCLEF 2016 Compound Figure Separation Database. The source code of SimCFS is made publicly available at https://github.com/hrlblab/ImageSeperation.

📄 PDF Abstract BibTeX arXiv:2107.08650

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningImage AugmentationMedical Image AnalysisSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Compound Figure Separation of Biomedical Images: Mining Large Datasets for Self-supervised Learning

2022-08-30 · Tianyuan Yao, Chang Qu, Jun Long, Quan Liu 외

With the rapid development of self-supervised learning (e.g., contrastive learning), the importance of having large-scale images (even without annotations) for training a more generalizable AI model has been widely recog…

Contrastive LearningImage Augmentationimage-classificationImage Classification+2

Automatic Separation of Compound Figures in Scientific Articles

2016-06-03 · Mario Taschwer, Oge Marques

Content-based analysis and retrieval of digital images found in scientific articles is often hindered by images consisting of multiple subfigures (compound figures). We address this problem by proposing a method to autom…

ArticlesRetrieval

A Two-stage Framework for Compound Figure Separation

2021-01-25 · Weixin Jiang, Eric Schwenker, Trevor Spreadbury, Nicola Ferrier 외

Scientific literature contains large volumes of complex, unstructured figures that are compound in nature (i.e. composed of multiple images, graphs, and drawings). Separation of these compound figures is critical for inf…

feature selectionInformation RetrievalRetrievalVocal Bursts Valence Prediction

Semantic Segmentation for Compound figures

2019-12-16 · Weixin Jiang, Eric Schwenker, Maria Chan, Oliver Cossairt

Scientific literature contains large volumes of unstructured data,with over 30\% of figures constructed as a combination of multiple images, these compound figures cannot be analyzed directly with existing information re…

Information RetrievalRetrievalSegmentationSemantic Segmentation

A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks

2017-03-15 · Satoshi Tsutsui, David Crandall

A key problem in automatic analysis and understanding of scientific papers is to extract semantic information from non-textual paper components like figures, diagrams, tables, etc. Much of this work requires a very first…

Transfer Learning