paper-with-me

홈 › Papers

A Survey on World Models Grounded in Acoustic Physical Information

2025-06-16 · Xiaoliang Chen, Le Chang, Xin Yu, Yunhe Huang, Xianling Tu

This survey provides a comprehensive overview of the emerging field of world models grounded in the foundation of acoustic physical information. It examines the theoretical underpinnings, essential methodological frameworks, and recent technological advancements in leveraging acoustic signals for high-fidelity environmental perception, causal physical reasoning, and predictive simulation of dynamic events. The survey explains how acoustic signals, as direct carriers of mechanical wave energy from physical events, encode rich, latent information about material properties, internal geometric structures, and complex interaction dynamics. Specifically, this survey establishes the theoretical foundation by explaining how fundamental physical laws govern the encoding of physical information within acoustic signals. It then reviews the core methodological pillars, including Physics-Informed Neural Networks (PINNs), generative models, and self-supervised multimodal learning frameworks. Furthermore, the survey details the significant applications of acoustic world models in robotics, autonomous driving, healthcare, and finance. Finally, it systematically outlines the important technical and ethical challenges while proposing a concrete roadmap for future research directions toward robust, causal, uncertainty-aware, and responsible acoustic intelligence. These elements collectively point to a research pathway towards embodied active acoustic intelligence, empowering AI systems to construct an internal "intuitive physics" engine through sound.

📄 PDF Abstract BibTeX arXiv:2506.13833

Code (1)

soundai2016/survey_acoustic_world_models 공식 구현

Tasks

Autonomous DrivingSurvey

Similar Papers 제목 키워드 기반

Ubiquitous Acoustic Sensing on Commodity IoT Devices: A Survey

2019-01-11 · Chao Cai, Rong Zheng, Jun Luo

With the proliferation of Internet-of-Things devices, acoustic sensing attracts much attention in recent years. It exploits acoustic transceivers such as microphones and speakers beyond their primary functions, namely re…

Survey

PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generation

2025-12-30 · Tianxin Xie, Wentao Lei, Kai Jiang, Guanjie Huang 외 arxiv

Text-to-audio-video (T2AV) generation is central to applications such as filmmaking and world modeling. However, current models often fail to produce physically plausible sounds. Previous benchmarks primarily focus on au…

Video Generation

MMAudioReverbs: Video-Guided Acoustic Modeling for Dereverberation and Room Impulse Response Estimation

2026-05-01 · Akira Takahashi, Ryosuke Sawata, Shusuke Takahashi, Yuki Mitsufuji arxiv

Although recent video-to-audio (V2A) models excelled at synthesizing semantically plausible sounds from visual inputs, they do not explicitly model room-acoustic effects such as reverberation or room impulse responses (R…

VibraVerse: A Large-Scale Geometry-Acoustics Alignment Dataset for Physically-Consistent Multimodal Learning

2025-11-25 · Bo Pang, Chenxi Xu, Jierui Ren, Guoping Wang 외 arxiv

Understanding the physical world requires perceptual models grounded in physical laws rather than mere statistical correlations. However, existing multimodal learning frameworks, focused on vision and language, lack phys…

Representation LearningContrastive Learning

Generative Physical AI in Vision: A Survey

2025-01-19 · Daochang Liu, Junyu Zhang, Anh-Dung Dinh, Eunbyung Park 외

Generative Artificial Intelligence (AI) has rapidly advanced the field of computer vision by enabling machines to create and interpret visual data with unprecedented sophistication. This transformation builds upon a foun…

Survey