Using Voice and Biofeedback to Predict User Engagement during Product Feedback Interviews
Capturing users' engagement is crucial for gathering feedback about the features of a software product. In a market-driven context, current approaches to collect and analyze users' feedback are based on techniques leveraging information extracted from product reviews and social media. These approaches are hardly applicable in bespoke software development, or in contexts in which one needs to gather information from specific users. In such cases, companies need to resort to face-to-face interviews to get feedback on their products. In this paper, we propose to utilize biometric data, in terms of physiological and voice features, to complement interviews with information about the engagement of the user on the discussed product-relevant topics. We evaluate our approach by interviewing users while gathering their physiological data (i.e., biofeedback) using an Empatica E4 wristband, and capturing their voice through the default audio-recorder of a common laptop. Our results show that we can predict users' engagement by training supervised machine learning algorithms on biometric data (F1=0.72), and that voice features alone are sufficiently effective (F1=0.71). Our work contributes with one the first studies in requirements engineering in which biometrics are used to identify emotions. This is also the first study in software engineering that considers voice analysis. The usage of voice features could be particularly helpful for emotion-aware requirements elicitation in remote communication, either performed by human analysts or voice-based chatbots, and can also be exploited to support the analysis of meetings in software engineering research.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Assessing the Level of Autonomic Nervous Activity for Effective Biofeedback Training
This paper proposes a prototype of a new biofeedback training based on mathematical models of cardiovascular control. For this purpose we develop a low-cost device that is able to record and process arterial pulse wave v…
Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach
Human behavior expression and experience are inherently multi-modal, and characterized by vast individual and contextual heterogeneity. To achieve meaningful human-computer and human-robot interactions, multi-modal model…
Active LearningDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1Skilog: A Smart Sensor System for Performance Analysis and Biofeedback in Ski Jumping
In ski jumping, low repetition rates of jumps limit the effectiveness of training. Thus, increasing learning rate within every single jump is key to success. A critical element of athlete training is motor learning, whic…
Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfaces
Conversational Task Assistants (CTAs) guide users in performing a multitude of activities, such as making recipes. However, ensuring that interactions remain engaging, interesting, and enjoyable for CTA users is not triv…
CarMem: Enhancing Long-Term Memory in LLM Voice Assistants through Category-Bounding
In today's assistant landscape, personalisation enhances interactions, fosters long-term relationships, and deepens engagement. However, many systems struggle with retaining user preferences, leading to repetitive user r…