paper-with-me

홈 › Papers

Using machine learning to measure evidence of students' sensemaking in physics courses

2025-03-19 · Kaitlin Gili, Kyle Heuton, Astha Shah, Michael C. Hughes

In the education system, problem-solving correctness is often inappropriately conflated with student learning. Advances in both Physics Education Research (PER) and Machine Learning (ML) provide the initial tools to develop a more meaningful and efficient measurement scheme for whether physics students are engaging in sensemaking: a learning process of figuring out the how and why for a particular phenomena. In this work, we contribute such a measurement scheme, which quantifies the evidence of students' physical sensemaking given their written explanations for their solutions to physics problems. We outline how the proposed human annotation scheme can be automated into a deployable ML model using language encoders and shared probabilistic classifiers. The procedure is scalable for a large number of problems and students. We implement three unique language encoders with logistic regression, and provide a deployability analysis on 385 real student explanations from the 2023 Introduction to Physics course at Tufts University. Furthermore, we compute sensemaking scores for all students, and analyze these measurements alongside their corresponding problem-solving accuracies. We find no linear relationship between these two variables, supporting the hypothesis that one is not a reliable proxy for the other. We discuss how sensemaking scores can be used alongside problem-solving accuracies to provide a more nuanced snapshot of student performance in physics class.

📄 PDF Abstract BibTeX arXiv:2503.15638

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Computationally Identifying Funneling and Focusing Questions in Classroom Discourse

2022-07-08 · NAACL (BEA) 2022 7 · Sterling Alic, Dorottya Demszky, Zid Mancenido, Jing Liu 외

Responsive teaching is a highly effective strategy that promotes student learning. In math classrooms, teachers might "funnel" students towards a normative answer or "focus" students to reflect on their own thinking, dee…

Math

Explainability via Interactivity? Supporting Nonexperts' Sensemaking of Pretrained CNN by Interacting with Their Daily Surroundings

2021-05-31 · Chao Wang, Pengcheng An

Current research on Explainable AI (XAI) heavily targets on expert users (data scientists or AI developers). However, increasing importance has been argued for making AI more understandable to nonexperts, who are expecte…

Explainable Artificial Intelligence (XAI)

Tracing the Invisible: Understanding Students' Judgment in AI-Supported Design Work

2025-05-13 · Suchismita Naik, Prakash Shukla, Ike Obi, Jessica Backus 외

As generative AI tools become integrated into design workflows, students increasingly engage with these tools not just as aids, but as collaborators. This study analyzes reflections from 33 student teams in an HCI design…

Overview of the Sensemaking Task at the ELOQUENT 2025 Lab: LLMs as Teachers, Students and Evaluators

2025-07-16 · Pavel Šindelář, Ondřej Bojar arxiv

ELOQUENT is a set of shared tasks that aims to create easily testable high-level criteria for evaluating generative language models. Sensemaking is one such shared task. In Sensemaking, we try to assess how well generati…

Question Answering

iAgentBench: Benchmarking Sensemaking Capabilities of Information-Seeking Agents on High-Traffic Topics

2026-03-04 · Preetam Prabhu Srikar Dammu, Arnav Palkhiwala, Tanya Roosta, Chirag Shah arxiv

With the emergence of search-enabled generative QA systems, users are increasingly turning to tools that browse, aggregate, and reconcile evidence across multiple sources on their behalf. Yet many widely used QA benchmar…