paper-with-me

홈 › Papers

PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback

2026-06-18 · Wei Xia, Jin Wu, Haoran Shi, Xiangyu Wang, Chanjin Zheng arxiv

Effective Automated Essay Scoring (AES) are expected to support both reliable assessment and actionable instructional feedback. However, existing approaches often treat scoring and feedback as separate components: neural scoring models provide limited interpretability, while Large Language Model (LLM)-based feedback is typically insensitive to learners proficiency levels. To address this fragmentation, this work proposes PsyScore, a psychometrically-aware framework that integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. PsyScore comprises three key modules: a Trait-Adaptive Neural IRT Scorer that incorporates the Graded Partial Credit Model (GPCM) into a neural architecture, enabling the precise estimation of student ability while maintaining psychometric interpretability, a ZPD-Scaffolded Feedback Generator, which conditions multi-agent feedback strategies on the diagnosed ability parameter to adapt instructional focus across different proficiency levels, and a Multi-Perspective Feedback Evaluation Strategy that assesses feedback quality via pairwise preference judgements and student revision simulations. Experiments on the ASAP++ dataset demonstrate that PsyScore achieves competitive scoring performance while providing more pedagogically aligned feedback.

📄 PDF Abstract BibTeX arXiv:2606.20287

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Essay Scoring

Similar Papers 제목 키워드 기반

Who We Are, Where We Are: Mental Health at the Intersection of Person, Situation, and Large Language Models

2026-03-06 · Nikita Soni, August Håkan Nilsson, Syeda Mahwish, Vasudha Varadarajan 외 arxiv

Mental health is not a fixed trait but a dynamic process shaped by the interplay between individual dispositions and situational contexts. Building on interactionist and constructionist psychological theories, we develop…

Designing LLM-Agents with Personalities: A Psychometric Approach

2024-10-25 · Muhua Huang, Xijuan Zhang, Christopher Soto, James Evans

This research introduces a novel methodology for assigning quantifiable, controllable and psychometrically validated personalities to Large Language Models-Based Agents (Agents) using the Big Five personality framework. …

Decision Makingvalid

Elder-Sim: A Psychometrically Validated Platform for Personality-Stable Elderly Digital Twins

2026-03-16 · Jiaqing Wang, Zhongfang Yang, Xingyuan Zhu, Zong'an Huang 외 arxiv

Background: LLMs enable patient-facing conversational agents, creating a pathway toward digital twins that capture older adults' lived experiences and behavioral responses across time. A central barrier is personality dr…

Domain Adaptation

Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics

2024-06-20 · Seungbeen Lee, Seungwon Lim, Seungju Han, Giyeong Oh 외

Recent advancements in Large Language Models (LLMs) have led to their adaptation in various domains as conversational agents. We wonder: can personality tests be applied to these agents to analyze their behavior, similar…

8kDescriptive

Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants

2024-10-16 · Rafael Ferreira, David Semedo, João Magalhães

Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits. Capturing and simulating these diverse traits coherently and efficiently presents a complex challenge. This…

DiversityUser Simulation