paper-with-me

홈 › Papers

LongFin: A Multimodal Document Understanding Model for Long Financial Domain Documents

2024-01-26 · Ahmed Masry, Amir Hajian

Document AI is a growing research field that focuses on the comprehension and extraction of information from scanned and digital documents to make everyday business operations more efficient. Numerous downstream tasks and datasets have been introduced to facilitate the training of AI models capable of parsing and extracting information from various document types such as receipts and scanned forms. Despite these advancements, both existing datasets and models fail to address critical challenges that arise in industrial contexts. Existing datasets primarily comprise short documents consisting of a single page, while existing models are constrained by a limited maximum length, often set at 512 tokens. Consequently, the practical application of these methods in financial services, where documents can span multiple pages, is severely impeded. To overcome these challenges, we introduce LongFin, a multimodal document AI model capable of encoding up to 4K tokens. We also propose the LongForms dataset, a comprehensive financial dataset that encapsulates several industrial challenges in financial documents. Through an extensive evaluation, we demonstrate the effectiveness of the LongFin model on the LongForms dataset, surpassing the performance of existing public models while maintaining comparable results on existing single-page benchmarks.

📄 PDF Abstract BibTeX arXiv:2401.15050

Code (0)

등록된 구현이 없습니다.

Tasks

4kDocument AIdocument understanding

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Facilitating Long Context Understanding via Supervised Chain-of-Thought Reasoning

2025-02-18 · Jingyang Lin, Andy Wong, Tian Xia, Shenghua He 외

Recent advances in Large Language Models (LLMs) have enabled them to process increasingly longer sequences, ranging from 2K to 2M tokens and even beyond. However, simply extending the input sequence length does not neces…

2kLong-Context Understanding

FinMMDocR: Benchmarking Financial Multimodal Reasoning with Scenario Awareness, Document Understanding, and Multi-Step Computation

2025-12-31 · Zichen Tang, Haihong E, Rongjin Li, Jiacheng Liu 외 arxiv

We introduce FinMMDocR, a novel bilingual multimodal benchmark for evaluating multimodal large language models (MLLMs) on real-world financial numerical reasoning. Compared to existing benchmarks, our work delivers three…

Multimodal Reasoning

IPO-Mine: A Toolkit and Dataset for Section-Structured Analysis of Long, Multimodal IPO Documents

2026-05-27 · Michael Galarnyk, Siddharth Lohani, Vidhyakshaya Kannan, Sagnik Nandi 외 arxiv

An Initial Public Offering (IPO) filing is a document released when a private firm goes public, allowing individual (retail) investors to purchase its shares. These filings describe a firm's business, financials, and ris…

Multimodal Reasoning

FinCriticalED: A Visual Benchmark for Financial Fact-Level OCR

2025-11-19 · Yueru He, Xueqing Peng, Yupeng Cao, Yan Wang 외 arxiv

Recent progress in multimodal large language models (MLLMs) has substantially improved document understanding, yet strong optical character recognition (OCR) performance on surface metrics does not guarantee faithful pre…

DocSplit: A Comprehensive Benchmark Dataset and Evaluation Approach for Document Packet Recognition and Splitting

2026-02-17 · Md Mofijul Islam, Md Sirajus Salekin, Nivedha Balakrishnan, Vincil C. Bishop 외 arxiv

Document understanding in real-world applications often requires processing heterogeneous, multi-page document packets containing multiple documents stitched together. Despite recent advances in visual document understan…