paper-with-me

홈 › Papers

Automated coherence measures fail to index thought disorder in individuals at risk for psychosis

2021-06-01 · NAACL (CLPsych) 2021 6 · Kasia Hitczenko, Henry Cowan, Vijay Mittal, Matthew Goldrick

Thought disorder – linguistic disturbances including incoherence and derailment of topic – is seen in individuals both with and at risk for psychosis. Methods from computational linguistics have increasingly sought to quantify thought disorder to detect group differences between clinical populations and healthy controls. While previous work has been quite successful at these classification tasks, the lack of interpretability of the computational metrics has made it unclear whether they are in fact measuring thought disorder. In this paper, we dive into these measures to try to better understand what they reflect. While we find group differences between at-risk and healthy control populations, we also find that the measures mostly do not correlate with existing measures of thought disorder symptoms (what they are intended to measure), but rather correlate with surface properties of the speech (e.g., sentence length) and sociodemographic properties of the speaker (e.g., race). These results highlight the importance of considering interpretability and front and center as the field continues to grow. Ethical use of computational measures like those studied here – especially in the high-stakes context of clinical care – requires us to devote substantial attention to potential biases in our measures.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Similar Papers 제목 키워드 기반

Fabula Entropy Indexing: Objective Measures of Story Coherence

2021-03-23 · NAACL (NUSE) 2021 6 · Louis Castricato, Spencer Frazier, Jonathan Balloch, Mark Riedl

Automated story generation remains a difficult area of research because it lacks strong objective measures. Generated stories may be linguistically sound, but in many cases suffer poor narrative coherence required for a …

Question AnsweringStory Generation

Reading Between the Lines: Combining Pause Dynamics and Semantic Coherence for Automated Assessment of Thought Disorder

2025-07-17 · Feng Chen, Weizhe Xu, Changye Li, Serguei Pakhomov 외 arxiv

Formal thought disorder (FTD), a hallmark of schizophrenia spectrum disorders, manifests as incoherent speech and poses challenges for clinical assessment. Traditional clinical rating scales, though validated, are resour…

Speech Recognition

Pat-DEVAL: Chain-of-Legal-Thought Evaluation for Patent Description

2026-01-01 · Yongmin Yoo, Kris W Pan arxiv

Patent descriptions must deliver comprehensive technical disclosure while meeting strict legal standards such as enablement and written description requirements. Although large language models have enabled end-to-end aut…

MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Models

2025-12-09 · Jusheng Zhang, Kaitong Cai, Xiaoyang Guo, Sidi Liu 외 arxiv

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning ge…

Logical ReasoningVisual GroundingVisual Reasoning

High Dimensional Model Explanations: an Axiomatic Approach

2020-06-16 · Neel Patel, Martin Strobel, Yair Zick

Complex black-box machine learning models are regularly used in critical decision-making domains. This has given rise to several calls for algorithmic explainability. Many explanation algorithms proposed in literature as…

Decision MakingmodelVocal Bursts Intensity Prediction