C2F-CHART: A Curriculum Learning Approach to Chart Classification
In scientific research, charts are usually the primary method for visually representing data. However, the accessibility of charts remains a significant concern. In an effort to improve chart understanding pipelines, we focus on optimizing the chart classification component. We leverage curriculum learning, which is inspired by the human learning process. In this paper, we introduce a novel training approach for chart classification that utilizes coarse-to-fine curriculum learning. Our approach, which we name C2F-CHART (for coarse-to-fine) exploits inter-class similarities to create learning tasks of varying difficulty levels. We benchmark our method on the ICPR 2022 CHART-Infographics UB UNITEC PMC dataset, outperforming the state-of-the-art results.
Code (0)
등록된 구현이 없습니다.
Tasks
Chart UnderstandingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning
Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding and coherent reasoning…
Chart Question AnsweringMultimodal ReasoningLogical ReasoningVisual ReasoningA Survey and Approach to Chart Classification
Charts represent an essential source of visual information in documents and facilitate a deep understanding and interpretation of information typically conveyed numerically. In the scientific literature, there are many c…
Chart UnderstandingClassificationdocument understandingSurveyChartEye: A Deep Learning Framework for Chart Information Extraction
The widespread use of charts and infographics as a means of data visualization in various domains has inspired recent research in automated chart understanding. However, information extraction from chart images is a comp…
Chart UnderstandingClassificationData VisualizationDeep Learning+3ChartNet: Visual Reasoning over Statistical Charts using MAC-Networks
Despite the improvements in perception accuracies brought about via deep learning, developing systems combining accurate visual perception with the ability to reason over the visual percepts remains extremely challenging…
General ClassificationVisual ReasoningBreaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation
While reinforcement learning (RL) has proven highly effective for general reasoning in vision-language models, its application to tasks requiring deep understanding of information-rich images and structured output genera…
Reinforcement LearningCode Generation