Toward best research practices in AI Psychology
Language models have become an essential part of the burgeoning field of AI Psychology. I discuss 14 methodological considerations that can help design more robust, generalizable studies evaluating the cognitive abilities of language-based AI systems, as well as to accurately interpret the results of these studies.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversitySimilar Papers 제목 키워드 기반
A Cross-modal Review of Indicators for Depression Detection Systems
Automatic detection of depression has attracted increasing attention from researchers in psychology, computer science, linguistics, and related disciplines. As a result, promising depression detection systems have been r…
Depression DetectionPerspectives on Machine Learning from Psychology's Reproducibility Crisis
In the early 2010s, a crisis of reproducibility rocked the field of psychology. Following a period of reflection, the field has responded with radical reform of its scientific practices. More recently, similar questions …
BIG-bench Machine LearningMachine Psychology
Large language models (LLMs) show increasingly advanced emergent capabilities and are being incorporated across various societal domains. Understanding their behavior and reasoning abilities therefore holds significant i…
Information RetrievalRetrievalInterdisciplinary Methods in Computational Creativity: How Human Variables Shape Human-Inspired AI Research
The word creativity originally described a concept from human psychology, but in the realm of computational creativity (CC), it has become much more. The question of what creativity means when it is part of a computation…
The ethical ambiguity of AI data enrichment: Measuring gaps in research ethics norms and practices
The technical progression of artificial intelligence (AI) research has been built on breakthroughs in fields such as computer science, statistics, and mathematics. However, in the past decade AI researchers have increasi…
Ethics