paper-with-me

Papers

Roto-translated Local Coordinate Frames For Interacting Dynamical Systems

2021-10-28 · NeurIPS 2021 12 · Miltiadis Kofinas, Naveen Shankar Nagaraja, Efstratios Gavves

Modelling interactions is critical in learning complex dynamical systems, namely systems of interacting objects with highly non-linear and time-dependent behaviour. A large class of such systems can be formalized as $\textit{geometric graphs}$, $\textit{i.e.}$, graphs with nodes positioned in the Euclidean space given an $\textit{arbitrarily}$ chosen global coordinate system, for instance vehicles in a traffic scene. Notwithstanding the arbitrary global coordinate system, the governing dynamics of the respective dynamical systems are invariant to rotations and translations, also known as $\textit{Galilean invariance}$. As ignoring these invariances leads to worse generalization, in this work we propose local coordinate frames per node-object to induce roto-translation invariance to the geometric graph of the interacting dynamical system. Further, the local coordinate frames allow for a natural definition of anisotropic filtering in graph neural networks. Experiments in traffic scenes, 3D motion capture, and colliding particles demonstrate that the proposed approach comfortably outperforms the recent state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2110.14961

Code (1)

mkofinas/locs 공식 구현 pytorch

Tasks

Trajectory ForecastingTrajectory Prediction

Similar Papers 제목 키워드 기반

Angle-Displacement Rigidity Theory with Application to Distributed Network Localization

2023-12-19 · Xu Fang, Xiaolei Li, Lihua Xie

This paper investigates the localization problem of a network in 2-D and 3-D spaces given the positions of anchor nodes in a global frame and inter-node relative measurements in local coordinate frames. It is assumed tha…

Position

CrystalFramer: Rethinking the Role of Frames for SE(3)-Invariant Crystal Structure Modeling

2025-03-04 · Yusei Ito, Tatsunori Taniai, Ryo Igarashi, Yoshitaka Ushiku 외

Crystal structure modeling with graph neural networks is essential for various applications in materials informatics, and capturing SE(3)-invariant geometric features is a fundamental requirement for these networks. A st…

Property Prediction

CAPE: Camera View Position Embedding for Multi-View 3D Object Detection

2023-03-17 · CVPR 2023 1 · Kaixin Xiong, Shi Gong, Xiaoqing Ye, Xiao Tan 외

In this paper, we address the problem of detecting 3D objects from multi-view images. Current query-based methods rely on global 3D position embeddings (PE) to learn the geometric correspondence between images and 3D spa…

3D Object Detectionobject-detectionObject DetectionPosition

Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models

2026-05-12 · Huoren Yang, Jianchao Zhao, Hu Yusong, Qiguan Ou 외 arxiv

Vision-Language-Action (VLA) models have advanced rapidly with stronger backbones, broader pre-training, and larger demonstration datasets, yet their action heads remain largely homogeneous: most directly predict action …

Collaboration of AI Agents via Cooperative Multi-Agent Deep Reinforcement Learning

2019-06-30 · Niranjan Balachandar, Justin Dieter, Govardana Sachithanandam Ramachandran

There are many AI tasks involving multiple interacting agents where agents should learn to cooperate and collaborate to effectively perform the task. Here we develop and evaluate various multi-agent protocols to train ag…

counterfactualDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1