paper-with-me

홈 › Papers

Accounting Reasoning in Large Language Models: Concepts, Evaluation, and Empirical Analysis

2025-12-27 · Jie Zhou, Xin Chen, Jie Zhang, Zhe Li arxiv

Large language models (LLMs) are increasingly reshaping learning paradigms, cognitive processes, and research methodologies across diverse domains. As their adoption expands, effectively integrating LLMs into professional fields and clarifying their role in domain-specific applications has become a key challenge for enterprise digital transformation and broader societal development. In the accounting domain, successful integration requires a systematic understanding of LLMs' domain-specific reasoning capabilities. In this study, we introduce the concept of accounting reasoning and propose a set of evaluation criteria grounded in an analysis of the training data characteristics of representative GLM-series models. These criteria establish a foundation for studying accounting-oriented reasoning paradigms and provide benchmarks for assessing and improving model performance. Building on this framework, we evaluate several representative LLMs, including GLM-6B, GLM-130B, GLM-4, and GPT-4, across a range of accounting reasoning tasks. Our experimental results show that prompt engineering strategies can yield varying degrees of performance improvement across models, with GPT-4 demonstrating the strongest overall accounting reasoning capability. Nevertheless, the results indicate that current LLMs remain insufficient for real-world accounting applications. In particular, further optimization is required for deployment in enterprise-level accounting scenarios to fully realize the potential value of LLMs in this domain.

📄 PDF Abstract BibTeX arXiv:2512.22443

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt Engineering

Similar Papers 제목 키워드 기반

Evaluating Accounting Reasoning Capabilities of Large Language Models

2026-01-10 · Jie Zhou, Xin Chen, Jie Zhang, Hai Li 외 arxiv

Large language models are transforming learning, cognition, and research across many fields. Effectively integrating them into professional domains, such as accounting, is a key challenge for enterprise digital transform…

MedConceptsQA: Open Source Medical Concepts QA Benchmark

2024-05-12 · Ofir Ben Shoham, Nadav Rappoport

We present MedConceptsQA, a dedicated open source benchmark for medical concepts question answering. The benchmark comprises of questions of various medical concepts across different vocabularies: diagnoses, procedures, …

Few-Shot LearningQuestion AnsweringZero-Shot Learning

FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models

2024-03-12 · Yan Liu, Renren Jin, Ling Shi, Zheng Yao 외

To thoroughly assess the mathematical reasoning abilities of Large Language Models (LLMs), we need to carefully curate evaluation datasets covering diverse mathematical concepts and mathematical problems at different dif…

MathMathematical Reasoning

From Directions to Regions: Decomposing Activations in Language Models via Local Geometry

2026-02-02 · Or Shafran, Shaked Ronen, Omri Fahn, Shauli Ravfogel 외 arxiv

Activation decomposition methods in language models are tightly coupled to geometric assumptions on how concepts are realized in activation space. Existing approaches search for individual global directions, implicitly a…

Generative Transformers for Design Concept Generation

2022-11-07 · Qihao Zhu, Jianxi Luo

Generating novel and useful concepts is essential during the early design stage to explore a large variety of design opportunities, which usually requires advanced design thinking ability and a wide range of knowledge fr…

RetrievalText Generation