Play Me Something Icy: Practical Challenges, Explainability and the Semantic Gap in Generative AI Music
This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative potential of these tools and have sought to understand and evaluate them from perspectives of prompt creation, control, usability, understandability, explainability of the AI process, and overall aesthetic effectiveness of the results. One of the challenges we have identified that is not explicitly addressed by these tools is the inherent semantic gap in using text-based tools to describe something as abstract as music. Other gaps include explainability vs. useability, and user control and input vs. the human creative process. The aim of this pictorial is to raise questions for discussion and make a few general suggestions on the kinds of improvements we would like to see in generative AI music tools.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Material Driven HRI Design: Aesthetics as Explainability
Aesthetics - often treated as secondary to function-guides how people interpret robots' roles. A great deal of robot designs - both real and fictitious - use sleek industrial aesthetics. These feature hard glossy plastic…
Interactive Fusion of Multi-level Features for Compositional Activity Recognition
To understand a complex action, multiple sources of information, including appearance, positional, and semantic features, need to be integrated. However, these features are difficult to be fused since they often differ s…
Action RecognitionActivity RecognitionTrokens: Semantic-Aware Relational Trajectory Tokens for Few-Shot Action Recognition
Video understanding requires effective modeling of both motion and appearance information, particularly for few-shot action recognition. While recent advances in point tracking have been shown to improve few-shot action …
Action RecognitionPoint TrackingFly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models
Game design hinges on understanding how static rules and content translate into dynamic player behavior - something modern generative systems that inspect only a game's code or assets struggle to capture. We present an a…
Game DesignReinforcement Learning (RL)Towards Transparent AI: A Survey on Explainable Large Language Models
Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black…
DecoderExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Survey