paper-with-me

Papers

Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information

2024-09-30 · Hyeongdon Moon, Richard Davis, Seyed Parsa Neshaei, Pierre Dillenbourg

Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students. However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical data and instructor-defined knowledge components, making it challenging to integrate AI-generated educational content with traditional established methods. We propose a method for automatically extracting knowledge components from educational content using instruction-tuned large multimodal models. We validate this approach by comprehensively evaluating it against knowledge tracing benchmarks in five domains. Our results indicate that the automatically extracted knowledge components can effectively replace human-tagged labels, offering a promising direction for enhancing intelligent tutoring systems in limited-data scenarios, achieving more explainable assessments in educational settings, and laying the groundwork for automated assessment.

📄 PDF Abstract BibTeX arXiv:2409.20167

Code (1)

donimoon/llmkt 공식 구현

Tasks

Knowledge Tracing

Similar Papers 제목 키워드 기반

Agents-K1: Towards Agent-native Knowledge Orchestration

2026-06-11 · Zongsheng Cao, Bihao Zhan, Jinxin Shi, Jiong Wang 외 arxiv

Current LLM-based research agents have advanced through agent orchestration, yet largely overlook scientific knowledge orchestration. Existing works often reduce papers to abstracts, surface mentions, and flat \texttt{ci…

Information ExtractionKnowledge Graphs

MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency

2024-06-19 · Junzhe Zhang, Huixuan Zhang, Xunjian Yin, Baizhou Huang 외

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmark…

knowledge editing

Can Linguistic Knowledge Improve Multimodal Alignment in Vision-Language Pretraining?

2023-08-24 · Fei Wang, Liang Ding, Jun Rao, Ye Liu 외

The multimedia community has shown a significant interest in perceiving and representing the physical world with multimodal pretrained neural network models, and among them, the visual-language pertaining (VLP) is, curre…

AttributeNegationSentence

DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population

2022-01-10 · Ningyu Zhang, Xin Xu, Liankuan Tao, Haiyang Yu 외

We present an open-source and extensible knowledge extraction toolkit DeepKE, supporting complicated low-resource, document-level and multimodal scenarios in the knowledge base population. DeepKE implements various infor…

AttributeAttribute ExtractionCross-Domain Named Entity RecognitionKnowledge Base Population+4

Knowledge Base Completion using Web-Based Question Answering and Multimodal Fusion

2022-11-14 · Yang Peng, Daisy Zhe Wang

Over the past few years, large knowledge bases have been constructed to store massive amounts of knowledge. However, these knowledge bases are highly incomplete. To solve this problem, we propose a web-based question ans…

Knowledge Base CompletionQuestion Answering