paper-with-me

홈 › Papers

Memory-Augmented Agent Training for Business Document Understanding

2024-12-17 · Jiale Liu, Yifan Zeng, Malte Højmark-Bertelsen, Marie Normann Gadeberg, Huazheng Wang, Qingyun Wu

Traditional enterprises face significant challenges in processing business documents, where tasks like extracting transport references from invoices remain largely manual despite their crucial role in logistics operations. While Large Language Models offer potential automation, their direct application to specialized business domains often yields unsatisfactory results. We introduce Matrix (Memory-Augmented agent Training through Reasoning and Iterative eXploration), a novel paradigm that enables LLM agents to progressively build domain expertise through experience-driven memory refinement and iterative learning. To validate this approach, we collaborate with one of the world's largest logistics companies to create a dataset of Universal Business Language format invoice documents, focusing on the task of transport reference extraction. Experiments demonstrate that Matrix outperforms prompting a single LLM by 30.3%, vanilla LLM agent by 35.2%. We further analyze the metrics of the optimized systems and observe that the agent system requires less API calls, fewer costs and can analyze longer documents on average. Our methods establish a new approach to transform general-purpose LLMs into specialized business tools through systematic memory enhancement in document processing tasks.

📄 PDF Abstract BibTeX arXiv:2412.15274

Code (0)

등록된 구현이 없습니다.

Tasks

document understanding

Similar Papers 제목 키워드 기반

Zep: A Temporal Knowledge Graph Architecture for Agent Memory

2025-01-20 · Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan 외

We introduce Zep, a novel memory layer service for AI agents that outperforms the current state-of-the-art system, MemGPT, in the Deep Memory Retrieval (DMR) benchmark. Additionally, Zep excels in more comprehensive and …

Large Language ModelRAGRetrievalRetrieval-augmented Generation

MATATA: Weakly Supervised End-to-End MAthematical Tool-Augmented Reasoning for Tabular Applications

2024-11-28 · Vishnou Vinayagame, Gregory Senay, Luis Martí

Business documents often contain substantial tabular and textual information with numerical values, requiring mathematical reasoning for effective document understanding. While Small Language Models (SLMs) still struggle…

document understandingMathematical ReasoningPrompt Engineering

MARK: Memory Augmented Refinement of Knowledge

2025-05-08 · Anish Ganguli, Prabal Deb, Debleena Banerjee

Large Language Models (LLMs) assist in specialized tasks but struggle to align with evolving domain knowledge without costly fine-tuning. Domain knowledge consists of: Knowledge: Immutable facts (e.g., 'A stone is solid'…

Information Retrieval

Retrieval-Augmented Multi-Agent System for Rapid Statement of Work Generation

2025-08-11 · Amulya Suravarjhula, Rashi Chandrashekhar Agrawal, Sakshi Jayesh Patel, Rahul Gupta arxiv

Drafting a Statement of Work (SOW) is a vital part of business and legal projects. It outlines key details like deliverables, timelines, responsibilities, and legal terms. However, creating these documents is often a slo…

CAGE-1: Control, Assurance, and Governance Evaluation for Enterprise Agentic AI

2026-07-03 · Roopam W. Sure arxiv

Enterprise artificial intelligence is moving from experimentation into operational workflows. Early programs focused on model access and retrieval-augmented generation, but enterprises are now beginning to deploy agents …