paper-with-me

홈 › Papers

Reading Users' Minds from What They Say: An Investigation into LLM-based Empathic Mental Inference

2024-03-20 · Qihao Zhu, Leah Chong, Maria Yang, Jianxi Luo

In human-centered design, developing a comprehensive and in-depth understanding of user experiences, i.e., empathic understanding, is paramount for designing products that truly meet human needs. Nevertheless, accurately comprehending the real underlying mental states of a large human population remains a significant challenge today. This difficulty mainly arises from the trade-off between depth and scale of user experience research: gaining in-depth insights from a small group of users does not easily scale to a larger population, and vice versa. This paper investigates the use of Large Language Models (LLMs) for performing mental inference tasks, specifically inferring users' underlying goals and fundamental psychological needs (FPNs). Baseline and benchmark datasets were collected from human users and designers to develop an empathic accuracy metric for measuring the mental inference performance of LLMs. The empathic accuracy of inferring goals and FPNs of different LLMs with varied zero-shot prompt engineering techniques are experimented against that of human designers. Experimental results suggest that LLMs can infer and understand the underlying goals and FPNs of users with performance comparable to that of human designers, suggesting a promising avenue for enhancing the scalability of empathic design approaches through the integration of advanced artificial intelligence technologies. This work has the potential to significantly augment the toolkit available to designers during human-centered design, enabling the development of both large-scale and in-depth understanding of users' experiences.

📄 PDF Abstract BibTeX arXiv:2403.13301

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt Engineering

Similar Papers 제목 키워드 기반

The Universe of Minds

2014-10-01 · Roman V. Yampolskiy

The paper attempts to describe the space of possible mind designs by first equating all minds to software. Next it proves some interesting properties of the mind design space such as infinitude of minds, size and represe…

Survey

Language models emulate certain cognitive profiles: An investigation of how predictability measures interact with individual differences

2024-06-07 · Patrick Haller, Lena S. Bolliger, Lena A. Jäger

To date, most investigations on surprisal and entropy effects in reading have been conducted on the group level, disregarding individual differences. In this work, we revisit the predictive power of surprisal and entropy…

Mindstorms in Natural Language-Based Societies of Mind

2023-05-26 · Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley 외

Both Minsky's "society of mind" and Schmidhuber's "learning to think" inspire diverse societies of large multimodal neural networks (NNs) that solve problems by interviewing each other in a "mindstorm." Recent implementa…

3D GenerationImage CaptioningImage GenerationQuestion Answering+1

Cognitive network science for understanding online social cognitions: A brief review

2021-02-25 · Massimo Stella

Social media are digitalising massive amounts of users' cognitions in terms of timelines and emotional content. Such Big Data opens unprecedented opportunities for investigating cognitive phenomena like perception, perso…

Data Integration

E3: Entailment-driven Extracting and Editing for Conversational Machine Reading

2019-06-12 · ACL 2019 7 · Victor Zhong, Luke Zettlemoyer

Conversational machine reading systems help users answer high-level questions (e.g. determine if they qualify for particular government benefits) when they do not know the exact rules by which the determination is made(e…

Reading Comprehension