paper-with-me

Papers

A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings

2020-08-09 · Chirag Raman, Stephanie Tan, Hayley Hung

Existing data acquisition literature for human behavior research provides wired solutions, mainly for controlled laboratory setups. In uncontrolled free-standing conversation settings, where participants are free to walk around, these solutions are unsuitable. While wireless solutions are employed in the broadcasting industry, they can be prohibitively expensive. In this work, we propose a modular and cost-effective wireless approach for synchronized multisensor data acquisition of social human behavior. Our core idea involves a cost-accuracy trade-off by using Network Time Protocol (NTP) as a source reference for all sensors. While commonly used as a reference in ubiquitous computing, NTP is widely considered to be insufficiently accurate as a reference for video applications, where Precision Time Protocol (PTP) or Global Positioning System (GPS) based references are preferred. We argue and show, however, that the latency introduced by using NTP as a source reference is adequate for human behavior research, and the subsequent cost and modularity benefits are a desirable trade-off for applications in this domain. We also describe one instantiation of the approach deployed in a real-world experiment to demonstrate the practicality of our setup in-the-wild.

📄 PDF Abstract BibTeX arXiv:2008.03715

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics

2025-11-30 · Jiahua Wang, Leqi Zheng, Jialong Wu, Yaoxin Mao 외 arxiv

World models simulate environmental dynamics to enable embodied agents to plan and reason about future states. While real-world perception is inherently multimodal, existing approaches focus primarily on visual observati…

Sound Source LocalizationVisual Navigation

UrbanV2X: A Multisensory Vehicle-Infrastructure Dataset for Cooperative Navigation in Urban Areas

2025-12-23 · Qijun Qin, Ziqi Zhang, Yihan Zhong, Feng Huang 외 arxiv

Due to the limitations of a single autonomous vehicle, Cellular Vehicle-to-Everything (C-V2X) technology opens a new window for achieving fully autonomous driving through sensor information sharing. However, real-world d…

Autonomous Driving

SiLVR: A Simple Language-based Video Reasoning Framework

2025-05-30 · Ce Zhang, Yan-Bo Lin, Ziyang Wang, Mohit Bansal 외

Recent advances in test-time optimization have led to remarkable reasoning capabilities in Large Language Models (LLMs), enabling them to solve highly complex problems in math and coding. However, the reasoning capabilit…

MathMMEMMLUToken Reduction+2

Touch Speaks, Sound Feels: A Multimodal Approach to Affective and Social Touch from Robots to Humans

2025-08-11 · Qiaoqiao Ren, Tony Belpaeme arxiv

Affective tactile interaction constitutes a fundamental component of human communication. In natural human-human encounters, touch is seldom experienced in isolation; rather, it is inherently multisensory. Individuals no…

Foundations of Multisensory Artificial Intelligence

2024-04-29 · Paul Pu Liang

Building multisensory AI systems that learn from multiple sensory inputs such as text, speech, video, real-world sensors, wearable devices, and medical data holds great promise for impact in many scientific areas with pr…

Prognosis