paper-with-me

홈 › Papers

Knowledge Tagging with Large Language Model based Multi-Agent System

2024-09-12 · Hang Li, Tianlong Xu, Ethan Chang, Qingsong Wen

Knowledge tagging for questions is vital in modern intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally, these annotations have been performed by pedagogical experts, as the task demands not only a deep semantic understanding of question stems and knowledge definitions but also a strong ability to link problem-solving logic with relevant knowledge concepts. With the advent of advanced natural language processing (NLP) algorithms, such as pre-trained language models and large language models (LLMs), pioneering studies have explored automating the knowledge tagging process using various machine learning models. In this paper, we investigate the use of a multi-agent system to address the limitations of previous algorithms, particularly in handling complex cases involving intricate knowledge definitions and strict numerical constraints. By demonstrating its superior performance on the publicly available math question knowledge tagging dataset, MathKnowCT, we highlight the significant potential of an LLM-based multi-agent system in overcoming the challenges that previous methods have encountered. Finally, through an in-depth discussion of the implications of automating knowledge tagging, we underscore the promising results of deploying LLM-based algorithms in educational contexts.

📄 PDF Abstract BibTeX arXiv:2409.08406

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelMath

Similar Papers 제목 키워드 기반

LabelBuddy: An Open Source Music and Audio Language Annotation Tagging Tool Using AI Assistance

2026-03-04 · Ioannis Prokopiou, Ioannis Sina, Agisilaos Kounelis, Pantelis Vikatos 외 arxiv

The advancement of Machine learning (ML), Large Audio Language Models (LALMs), and autonomous AI agents in Music Information Retrieval (MIR) necessitates a shift from static tagging to rich, human-aligned representation …

Representation LearningInformation Retrieval

PersonaAgent with GraphRAG: Community-Aware Knowledge Graphs for Personalized LLM

2025-11-21 · Siqi Liang, Yudi Zhang, Yue Guo arxiv

We propose a novel framework for persona-based language model system, motivated by the need for personalized AI agents that adapt to individual user preferences. In our approach, the agent embodies the user's "persona" (…

Community DetectionPrompt EngineeringKnowledge Graphs

LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Tagging

2022-09-20 · COLING 2022 10 · Andy Rosenbaum, Saleh Soltan, Wael Hamza, Yannick Versley 외

We present LINGUIST, a method for generating annotated data for Intent Classification and Slot Tagging (IC+ST), via fine-tuning AlexaTM 5B, a 5-billion-parameter multilingual sequence-to-sequence (seq2seq) model, on a fl…

intent-classificationIntent ClassificationLanguage ModelingLanguage Modelling+2

LLM4Tag: Automatic Tagging System for Information Retrieval via Large Language Models

2025-02-19 · Ruiming Tang, Chenxu Zhu, Bo Chen, Weipeng Zhang 외

Tagging systems play an essential role in various information retrieval applications such as search engines and recommender systems. Recently, Large Language Models (LLMs) have been applied in tagging systems due to thei…

Information RetrievalRecommendation SystemsRetrievalTAG+1

MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languages

2023-05-23 · Cheikh M. Bamba Dione, David Adelani, Peter Nabende, Jesujoba Alabi 외

In this paper, we present MasakhaPOS, the largest part-of-speech (POS) dataset for 20 typologically diverse African languages. We discuss the challenges in annotating POS for these languages using the UD (universal depen…

Cross-Lingual Transferparameter-efficient fine-tuningPart-Of-Speech TaggingPOS+1