paper-with-me

홈 › Papers

Leveraging Small LLMs for Argument Mining in Education: Argument Component Identification, Classification, and Assessment

2025-02-20 · Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver

Argument mining algorithms analyze the argumentative structure of essays, making them a valuable tool for enhancing education by providing targeted feedback on the students' argumentation skills. While current methods often use encoder or encoder-decoder deep learning architectures, decoder-only models remain largely unexplored, offering a promising research direction. This paper proposes leveraging open-source, small Large Language Models (LLMs) for argument mining through few-shot prompting and fine-tuning. These models' small size and open-source nature ensure accessibility, privacy, and computational efficiency, enabling schools and educators to adopt and deploy them locally. Specifically, we perform three tasks: segmentation of student essays into arguments, classification of the arguments by type, and assessment of their quality. We empirically evaluate the models on the Feedback Prize - Predicting Effective Arguments dataset of grade 6-12 students essays and demonstrate how fine-tuned small LLMs outperform baseline methods in segmenting the essays and determining the argument types while few-shot prompting yields comparable performance to that of the baselines in assessing quality. This work highlights the educational potential of small, open-source LLMs to provide real-time, personalized feedback, enhancing independent learning and writing skills while ensuring low computational cost and privacy.

📄 PDF Abstract BibTeX arXiv:2502.14389

Code (0)

등록된 구현이 없습니다.

Tasks

Argument MiningComputational EfficiencyDecoder

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here

Similar Papers 제목 키워드 기반

Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essays

2026-02-04 · Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver arxiv

Automated Essay Scoring systems have traditionally focused on holistic scores, limiting their pedagogical usefulness, especially in the case of complex essay genres such as argumentative writing. In educational contexts,…

Automated Essay Scoring

Towards Comprehensive Argument Analysis in Education: Dataset, Tasks, and Method

2025-05-17 · Yupei Ren, Xinyi Zhou, Ning Zhang, Shangqing Zhao 외

Argument mining has garnered increasing attention over the years, with the recent advancement of Large Language Models (LLMs) further propelling this trend. However, current argument relations remain relatively simplisti…

Argument MiningRelationRelation Prediction

Corpus Wide Argument Mining -- a Working Solution

2019-11-25 · Liat Ein-Dor, Eyal Shnarch, Lena Dankin, Alon Halfon 외

One of the main tasks in argument mining is the retrieval of argumentative content pertaining to a given topic. Most previous work addressed this task by retrieving a relatively small number of relevant documents as the …

Argument MiningArticlesRetrievalSentence

Are Large Language Models Reliable Argument Quality Annotators?

2024-04-15 · Nailia Mirzakhmedova, Marcel Gohsen, Chia Hao Chang, Benno Stein

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requi…

Argument Mining

Assessing Open-Source Large Language Models on Argumentation Mining Subtasks

2024-11-08 · Mohammad Yeghaneh Abkenar, Weixing Wang, Hendrik Graupner, Manfred Stede

We explore the capability of four open-sourcelarge language models (LLMs) in argumentation mining (AM). We conduct experiments on three different corpora; persuasive essays(PE), argumentative microtexts (AMT) Part 1 and …

ARCRelation Classification