Validating psychometric survey responses
We present an approach to classify user validity in survey responses by using a machine learning techniques. The approach is based on collecting user mouse activity on web-surveys and fast predicting validity of the survey in general without analysis of specific answers. Rule based approach, LSTM and HMM models are considered. The approach might be used in web-survey applications to detect suspicious users behaviour and request from them proper answering instead of false data recording.
Code (2)
Tasks
BIG-bench Machine LearningSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Psychometric Item Validation Using Virtual Respondents with Trait-Response Mediators
As psychometric surveys are increasingly used to assess the traits of large language models (LLMs), the need for scalable survey item generation suited for LLMs has also grown. A critical challenge here is ensuring the c…
Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancement
The rapid advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. It presents novel challenges, such as measuring human-like psychological constructs, navigating beyond static and t…
BenchmarkingLanguage ModelingLanguage ModellingLarge Language ModelLimited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysis
The humanlike responses of large language models (LLMs) have prompted social scientists to investigate whether LLMs can be used to simulate human participants in experiments, opinion polls and surveys. Of central interes…
Multiple-choiceQuestion AnsweringConstructing a Testbed for Psychometric Natural Language Processing
Psychometric measures of ability, attitudes, perceptions, and beliefs are crucial for understanding user behaviors in various contexts including health, security, e-commerce, and finance. Traditionally, psychometric dime…
SurveyDrawing Lines in Psychological Space: What K-means Clustering Reveals in Simulated and Real Psychometric Data
K-means clustering is widely used in psychological and psychometric research to identify profiles, subgroups, and potential typologies, yet its classical formulation does not test whether such groups exist as latent psyc…