paper-with-me

홈 › Papers

Self-consistent Reasoning For Solving Math Word Problems

2022-10-27 · Jing Xiong, Zhongwei Wan, Xiping Hu, Min Yang, Chengming Li

Math word problems (MWPs) is a task that automatically derives solution expression from a giving math problems in text. The previous studies suffer from spurious correlations between input text and output expression. To mitigate this issue, we propose a self-consistent reasoning framework called SCR, which attempts to adopt a pruning strategy to correct the output distribution shift so as to implicitly fix those spurious correlative samples. Specifically, we firstly obtain a sub-network by pruning a roberta2tree model, for the sake to use the gap on output distribution between the original roberta2tree model and the pruned sub-network to expose spurious correlative samples. Then, we calibrate the output distribution shift by applying symmetric Kullback-Leibler divergence to alleviate spurious correlations. In addition, SCR generates equivalent expressions, thereby, capturing the original text's logic rather than relying on hints from original text. Extensive experiments on two large-scale benchmarks demonstrate that our model substantially outperforms the strong baseline methods.

📄 PDF Abstract BibTeX arXiv:2210.15373

Code (0)

등록된 구현이 없습니다.

Tasks

Math

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

2021-07-28 · Findings (NAACL) 2022 7 · Zhenwen Liang, Jipeng Zhang, Lei Wang, Wei Qin 외

Math word problem (MWP) solving faces a dilemma in number representation learning. In order to avoid the number representation issue and reduce the search space of feasible solutions, existing works striving for MWP solv…

Common Sense ReasoningLanguage ModelingLanguage ModellingMath+3

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Math word problem (MWP) solving faces a dilemma in number representation learning. In order to avoid the number representation issue and reduce the search space of feasible solutions, existing works striving for MWP solv…

Language ModelingLanguage ModellingMathMath Word Problem Solving+2

Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem

2022-10-21 · Wenqi Zhang, Yongliang Shen, Yanna Ma, Xiaoxia Cheng 외

Math word problem solver requires both precise relation reasoning about quantities in the text and reliable generation for the diverse equation. Current sequence-to-tree or relation extraction methods regard this only fr…

Contrastive LearningMathMathematical ReasoningMath Word Problem Solving+2

VerityMath: Advancing Mathematical Reasoning by Self-Verification Through Unit Consistency

2023-11-13 · Vernon Toh Yan Han, Ratish Puduppully, Nancy F. Chen

Large Language Models (LLMs), combined with program-based solving techniques, are increasingly demonstrating proficiency in mathematical reasoning. For example, closed-source models such as OpenAI GPT-4 and Claude show e…

MathMathematical ReasoningMath Word Problem Solving

Not All Votes Count! Programs as Verifiers Improve Self-Consistency of Language Models for Math Reasoning

2024-10-16 · Vernon Y. H. Toh, Deepanway Ghosal, Soujanya Poria

Large language models (LLMs) have shown increasing competence in solving mathematical reasoning problems. However, many open-source LLMs still struggle with errors in calculation and semantic understanding during interme…

AllGSM8KMathMathematical Reasoning