paper-with-me

Papers

Towards Interpretability in Audio and Visual Affective Machine Learning: A Review

2023-06-15 · David S. Johnson, Olya Hakobyan, Hanna Drimalla

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it is important that models be made transparent to detect and mitigate biased decision making. In this regard, affective machine learning could benefit from the recent advancements in explainable artificial intelligence (XAI) research. We perform a structured literature review to examine the use of interpretability in the context of affective machine learning. We focus on studies using audio, visual, or audiovisual data for model training and identified 29 research articles. Our findings show an emergence of the use of interpretability methods in the last five years. However, their use is currently limited regarding the range of methods used, the depth of evaluations, and the consideration of use-cases. We outline the main gaps in the research and provide recommendations for researchers that aim to implement interpretable methods for affective machine learning.

📄 PDF Abstract BibTeX arXiv:2306.08933

Code (0)

등록된 구현이 없습니다.

Tasks

ArticlesDecision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: A Systematic Review of Task Formulations and Machine Learning Methods

2023-10-30 · Md Rakibul Hasan, Md Zakir Hossain, Shreya Ghosh, Aneesh Krishna 외

Empathy indicates an individual's ability to understand others. Over the past few years, empathy has drawn attention from various disciplines, including but not limited to Affective Computing, Cognitive Science, and Psyc…

Privacy PreservingSystematic Literature Review

Generative Adversarial Networks in Human Emotion Synthesis:A Review

2020-10-28 · Noushin Hajarolasvadi, Miguel Arjona Ramírez, Hasan Demirel

Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processin…

Emotion Recognition

Beyond the Mouth: Upper-Face Affective Cues in Audiovisual Sentence Recognition under Acoustic Uncertainty

2026-05-30 · Zhou Yang, Yueyi Yang arxiv

Face-to-face speech comprehension is inherently multimodal, integrating acoustic signals with visible articulation, facial expression, head motion, and other socially relevant cues. While audiovisual speech systems typic…

Towards Understanding Confusion and Affective States Under Communication Failures in Voice-Based Human-Machine Interaction

2022-07-15 · Sujeong Kim, Abhinav Garlapati, Jonah Lubin, Amir Tamrakar 외

We present a series of two studies conducted to understand user's affective states during voice-based human-machine interactions. Emphasis is placed on the cases of communication errors or failures. In particular, we are…

A Review of Affective Generation Models

2022-02-22 · Guangtao Nie, Yibing Zhan

Affective computing is an emerging interdisciplinary field where computational systems are developed to analyze, recognize, and influence the affective states of a human. It can generally be divided into two subproblems:…