paper-with-me

Papers

Solving Math Word Problem with Problem Type Classification

2023-08-26 · Jie Yao, ZiHao Zhou, Qiufeng Wang

Math word problems (MWPs) require analyzing text descriptions and generating mathematical equations to derive solutions. Existing works focus on solving MWPs with two types of solvers: tree-based solver and large language model (LLM) solver. However, these approaches always solve MWPs by a single solver, which will bring the following problems: (1) Single type of solver is hard to solve all types of MWPs well. (2) A single solver will result in poor performance due to over-fitting. To address these challenges, this paper utilizes multiple ensemble approaches to improve MWP-solving ability. Firstly, We propose a problem type classifier that combines the strengths of the tree-based solver and the LLM solver. This ensemble approach leverages their respective advantages and broadens the range of MWPs that can be solved. Furthermore, we also apply ensemble techniques to both tree-based solver and LLM solver to improve their performance. For the tree-based solver, we propose an ensemble learning framework based on ten-fold cross-validation and voting mechanism. In the LLM solver, we adopt self-consistency (SC) method to improve answer selection. Experimental results demonstrate the effectiveness of these ensemble approaches in enhancing MWP-solving ability. The comprehensive evaluation showcases improved performance, validating the advantages of our proposed approach. Our code is available at this url: https://github.com/zhouzihao501/NLPCC2023-Shared-Task3-ChineseMWP.

📄 PDF Abstract BibTeX arXiv:2308.13844

Code (1)

zhouzihao501/nlpcc2023-shared-task3-chinesemwp 공식 구현 pytorch

Tasks

Answer SelectionClassificationEnsemble LearningLanguage ModellingLarge Language ModelMath

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems

2021-10-16 · Findings (ACL) 2022 5 · Zhongli Li, Wenxuan Zhang, Chao Yan, Qingyu Zhou 외

Math Word Problem (MWP) solving needs to discover the quantitative relationships over natural language narratives. Recent work shows that existing models memorize procedures from context and rely on shallow heuristics to…

Contrastive LearningMath

Reverse Operation based Data Augmentation for Solving Math Word Problems

2020-10-04 · Qianying Liu, Wenyu Guan, Sujian Li, Fei Cheng 외

Automatically solving math word problems is a critical task in the field of natural language processing. Recent models have reached their performance bottleneck and require more high-quality data for training. We propose…

Data AugmentationMathMathematical ReasoningMath Word Problem Solving

Noun-MWP: Math Word Problems Meet Noun Answers

2022-10-01 · COLING 2022 10 · Taehun Cha, Jaeheun Jung, Donghun Lee

We introduce a new type of problems for math word problem (MWP) solvers, named Noun-MWPs, whose answer is a non-numerical string containing a noun from the problem text. We present a novel method to empower existing MWP …

MathQuestion Answering

The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solvers

2018-08-22 · Dongxiang Zhang, Lei Wang, Luming Zhang, Bing Tian Dai 외

Solving mathematical word problems (MWPs) automatically is challenging, primarily due to the semantic gap between human-readable words and machine-understandable logics. Despite the long history dated back to the1960s, M…

MathSemantic ParsingSurvey

Solving Math Word Problems by Combining Language Models With Symbolic Solvers

2023-04-16 · Joy He-Yueya, Gabriel Poesia, Rose E. Wang, Noah D. Goodman

Automatically generating high-quality step-by-step solutions to math word problems has many applications in education. Recently, combining large language models (LLMs) with external tools to perform complex reasoning and…

GSM8KLanguage ModelingLanguage ModellingMath