Predicting User Annoyance Using Visual Attributes
Computer Vision algorithms make mistakes. In human-centric applications, some mistakes are more annoying to users than others. In order to design algorithms that minimize the annoyance to users, we need access to an annoyance or cost matrix that holds the annoyance of each type of mistake. Such matrices are not readily available, especially for a wide gamut of human-centric applications where annoyance is tied closely to human perception. To avoid having to conduct extensive user studies to gather the annoyance matrix for all possible mistakes, we propose predicting the annoyance of previously unseen mistakes by learning from example mistakes and their corresponding annoyance. We promote the use of attribute-based representations to transfer this knowledge of annoyance. Our experimental results with faces and scenes demonstrate that our approach can predict annoyance more accurately than baselines. We show that as a result, our approach makes less annoying mistakes in a real-world image retrieval application.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
AI-based soundscape analysis: Jointly identifying sound sources and predicting annoyance
Soundscape studies typically attempt to capture the perception and understanding of sonic environments by surveying users. However, for long-term monitoring or assessing interventions, sound-signal-based approaches are r…
Drone Acoustic Analysis for Predicting Psychoacoustic Annoyance via Artificial Neural Networks
Unmanned Aerial Vehicles (UAVs) have become widely used in various fields and industrial applications thanks to their low operational cost, compact size and wide accessibility. However, the noise generated by drone prope…
Multi-level graph learning for audio event classification and human-perceived annoyance rating prediction
WHO's report on environmental noise estimates that 22 M people suffer from chronic annoyance related to noise caused by audio events (AEs) from various sources. Annoyance may lead to health issues and adverse effects on …
Graph LearningQuick Question: Interrupting Users for Microtasks with Reinforcement Learning
Human attention is a scarce resource in modern computing. A multitude of microtasks vie for user attention to crowdsource information, perform momentary assessments, personalize services, and execute actions with a singl…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Effects of a Hovering Unmanned Aerial Vehicle on Urban Soundscapes Perception
Several industry leaders and governmental agencies are currently investigating the use of Unmanned Aerial Vehicles (UAVs), or drones as commonly known, for an ever-growing number of applications from blue light services …