Reading Cognition as Decisions Unfold in Words: A Factorized Inverse Decision Model
Inverse decision modeling infers latent properties of decision processes from observed behavior, but existing formulations rely primarily on action trajectories. In verbalized cognitive tasks, task execution also produces response dynamics that action-only formulations leave unmodeled, such as verbal production, interaction, and hesitation. We propose a factorized inverse decision model (FIDM) that decomposes each individual's task-execution likelihood into an action factor and an effort factor, governed by separate individual-specific parameters. From raw verbal transcripts, a language model produces structured task-execution traces for factorized inference. On data from 400 older adults performing a grocery-shopping dialog task for cognitive screening, controlled recovery shows selective estimation of the intended factors, while matched semi-synthetic conditions show that FIDM preserves action-execution distinctions even when aggregate behavioral summaries are matched. Action evidence further localizes task-defined deviations across participants. In cognitive-status classification, FIDM provides information complementary to clinical scores, trajectory summaries, and frozen language representations, with consistent gains across all evaluated baselines in the binary setting.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Semantic Role Labeling with Iterative Structure Refinement
Modern state-of-the-art Semantic Role Labeling (SRL) methods rely on expressive sentence encoders (e.g., multi-layer LSTMs) but tend to model only local (if any) interactions between individual argument labeling decision…
Semantic Role LabelingSentenceVisual Words for Automatic Lip-Reading
Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties. The ability to lip read enables a person with a hearing impairment to communi…
Lip Readingspeech-recognitionSpeech RecognitionVisual Speech RecognitionDeep Learning for Lip Reading using Audio-Visual Information for Urdu Language
Human lip-reading is a challenging task. It requires not only knowledge of underlying language but also visual clues to predict spoken words. Experts need certain level of experience and understanding of visual expressio…
Lip Readingspeech-recognitionSpeech RecognitionA Cognition Based Attention Model for Sentiment Analysis
Attention models are proposed in sentiment analysis because some words are more important than others. However,most existing methods either use local context based text information or user preference information. In this…
Feature EngineeringmodelProduct RecommendationSentiment AnalysisDeep Audio-Visual Speech Recognition
The goal of this work is to recognise phrases and sentences being spoken by a talking face, with or without the audio. Unlike previous works that have focussed on recognising a limited number of words or phrases, we tack…
Audio-Visual Speech RecognitionAutomatic Speech Recognition (ASR)LipreadingLip Reading+3