Automatic Separation of Compound Figures in Scientific Articles
Content-based analysis and retrieval of digital images found in scientific articles is often hindered by images consisting of multiple subfigures (compound figures). We address this problem by proposing a method to automatically classify and separate compound figures, which consists of two main steps: (i) a supervised compound figure classifier (CFC) discriminates between compound and non-compound figures using task-specific image features; and (ii) an image processing algorithm is applied to predicted compound images to perform compound figure separation (CFS). Our CFC approach is shown to achieve state-of-the-art classification performance on a published dataset. Our CFS algorithm shows superior separation accuracy on two different datasets compared to other known automatic approaches. Finally, we propose a method to evaluate the effectiveness of the CFC-CFS process chain and use it to optimize the misclassification loss of CFC for maximal effectiveness in the process chain.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesRetrievalSimilar Papers 제목 키워드 기반
A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks
A key problem in automatic analysis and understanding of scientific papers is to extract semantic information from non-textual paper components like figures, diagrams, tables, etc. Much of this work requires a very first…
Transfer LearningA Two-stage Framework for Compound Figure Separation
Scientific literature contains large volumes of complex, unstructured figures that are compound in nature (i.e. composed of multiple images, graphs, and drawings). Separation of these compound figures is critical for inf…
feature selectionInformation RetrievalRetrievalVocal Bursts Valence PredictionSemantic Segmentation for Compound figures
Scientific literature contains large volumes of unstructured data,with over 30\% of figures constructed as a combination of multiple images, these compound figures cannot be analyzed directly with existing information re…
Information RetrievalRetrievalSegmentationSemantic SegmentationCompound Figure Separation of Biomedical Images with Side Loss
Unsupervised learning algorithms (e.g., self-supervised learning, auto-encoder, contrastive learning) allow deep learning models to learn effective image representations from large-scale unlabeled data. In medical image …
Contrastive LearningImage AugmentationMedical Image AnalysisSelf-Supervised LearningSciCap: Generating Captions for Scientific Figures
Researchers use figures to communicate rich, complex information in scientific papers. The captions of these figures are critical to conveying effective messages. However, low-quality figure captions commonly occur in sc…
ArticlesImage CaptioningText Normalization