paper-with-me

Papers

What Physics do Data-Driven MoCap-to-Radar Models Learn?

2026-04-19 · Kevin Chen, Kenneth W. Parker, Anish Arora arxiv

Data-driven MoCap-to-radar models generate plausible micro-Doppler spectrograms, but do they actually learn the underlying physics? We introduce a physics-based interpretability framework to answer this question via two proposed complementary metrics: one measures alignment between model predictions and the physics-derived Doppler frequency, while the other tests whether predictions preserve the velocity-frequency relationship under velocity intervention. Both metrics require only MoCap input and model predictions, without access to measured radar data. Experiments across several model architectures reveal that low reconstruction error does not guarantee physical consistency: some, but not all, models achieve low error yet perform poorly on the two physics-based metrics. Further analysis shows that temporal attention is critical for transformer-based models to learn the underlying physics.

📄 PDF Abstract BibTeX arXiv:2605.00018

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MoCap2Radar: A Spatiotemporal Transformer for Synthesizing Micro-Doppler Radar Signatures from Motion Capture

2025-11-14 · Kevin Chen, Kenneth W. Parker, Anish Arora arxiv

We present a pure machine learning process for synthesizing radar spectrograms from Motion-Capture (MoCap) data. We formulate MoCap-to-spectrogram translation as a windowed sequence-to-sequence task using a transformer-b…

Sim2Radar: Toward Bridging the Radar Sim-to-Real Gap with VLM-Guided Scene Reconstruction

2026-02-10 · Emily Bejerano, Federico Tondolo, Ayaan Qayyum, Xiaofan Yu 외 arxiv

Millimeter-wave (mmWave) radar provides reliable perception in visually degraded indoor environments (e.g., smoke, dust, and low light), but learning-based radar perception is bottlenecked by the scarcity and cost of col…

Monocular Depth EstimationTransfer LearningObject Detection

RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception

2026-06-24 · Emily Bejerano, Federico Tondolo, Devang Gupta, Aaron Mano Cherian 외 arxiv

Millimeter-wave (mmWave) radar perception is limited by data scarcity: models trained on existing radar datasets fail to generalize to new objects, environments, and sensing trajectories. We present RadarTwin, a framewor…

3D Reconstruction

Selecting the motion ground truth for loose-fitting wearables: benchmarking optical MoCap methods

2023-07-21 · Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh, Paul Lukowicz

To help smart wearable researchers choose the optimal ground truth methods for motion capturing (MoCap) for all types of loose garments, we present a benchmark, DrapeMoCapBench (DMCB), specifically designed to evaluate t…

Benchmarking

MoCapAct: A Multi-Task Dataset for Simulated Humanoid Control

2022-08-15 · Nolan Wagener, Andrey Kolobov, Felipe Vieira Frujeri, Ricky Loynd 외

Simulated humanoids are an appealing research domain due to their physical capabilities. Nonetheless, they are also challenging to control, as a policy must drive an unstable, discontinuous, and high-dimensional physical…

Humanoid Control