Textual Enhanced Contrastive Learning for Solving Math Word Problems
Solving math word problems is the task that analyses the relation of quantities and requires an accurate understanding of contextual natural language information. Recent studies show that current models rely on shallow heuristics to predict solutions and could be easily misled by small textual perturbations. To address this problem, we propose a Textual Enhanced Contrastive Learning framework, which enforces the models to distinguish semantically similar examples while holding different mathematical logic. We adopt a self-supervised manner strategy to enrich examples with subtle textual variance by textual reordering or problem re-construction. We then retrieve the hardest to differentiate samples from both equation and textual perspectives and guide the model to learn their representations. Experimental results show that our method achieves state-of-the-art on both widely used benchmark datasets and also exquisitely designed challenge datasets in English and Chinese. \footnote{Our code and data is available at \url{https://github.com/yiyunya/Textual_CL_MWP}
Code (1)
Tasks
Contrastive LearningMathMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Math Word Problem Solving by Generating Linguistic Variants of Problem Statements
The art of mathematical reasoning stands as a fundamental pillar of intellectual progress and is a central catalyst in cultivating human ingenuity. Researchers have recently published a plethora of works centered around …
DecoderIngenuityMathMathematical Reasoning+1Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems
Math Word Problem (MWP) solving needs to discover the quantitative relationships over natural language narratives. Recent work shows that existing models memorize procedures from context and rely on shallow heuristics to…
Contrastive LearningMathAn Edge-Enhanced Hierarchical Graph-to-Tree Network for Math Word Problem Solving
Math word problem solving has attracted considerable research interest in recent years. Previous works have shown the effectiveness of utilizing graph neural networks to capture the relationships in the problem. However,…
DecoderMathMath Word Problem SolvingSentenceMATHion: Solving Math Word Problems with Logically Consistent Problems
Solving the math word problems (MWPs) is a challenging task. Some existing MWP solvers retrieve textually similar problems and draw on their solutions to solve the given problem. However, textually similar questions are …
Language ModelingLanguage ModellingMathRetrievalA Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solving
Math Word Problem (MWP) solving is a critical task in natural language processing, has garnered significant research interest in recent years. Various recent studies heavily rely on Seq2Seq models and their extensions (e…
DiversityKnowledge DistillationMathMath Word Problem Solving