paper-with-me

홈 › Papers

Learning the Latent Space of Robot Dynamics for Cutting Interaction Inference

2020-07-22 · Sahand Rezaei-Shoshtari, David Meger, Inna Sharf

Utilization of latent space to capture a lower-dimensional representation of a complex dynamics model is explored in this work. The targeted application is of a robotic manipulator executing a complex environment interaction task, in particular, cutting a wooden object. We train two flavours of Variational Autoencoders---standard and Vector-Quantised---to learn the latent space which is then used to infer certain properties of the cutting operation, such as whether the robot is cutting or not, as well as, material and geometry of the object being cut. The two VAE models are evaluated with reconstruction, prediction and a combined reconstruction/prediction decoders. The results demonstrate the expressiveness of the latent space for robotic interaction inference and the competitive prediction performance against recurrent neural networks.

📄 PDF Abstract BibTeX arXiv:2007.11167

Code (1)

McGill-AML/aml_robot_cutting_dataset 공식 구현 tf

Tasks

ObjectPrediction

Methods 이 논문이 사용한 방법론

USD Coin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Learning Multimodal Latent Dynamics for Human-Robot Interaction

2023-11-27 · Vignesh Prasad, Lea Heitlinger, Dorothea Koert, Ruth Stock-Homburg 외

This article presents a method for learning well-coordinated Human-Robot Interaction (HRI) from Human-Human Interactions (HHI). We devise a hybrid approach using Hidden Markov Models (HMMs) as the latent space priors for…

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

2022-10-22 · Vignesh Prasad, Dorothea Koert, Ruth Stock-Homburg, Jan Peters 외

Modeling interaction dynamics to generate robot trajectories that enable a robot to adapt and react to a human's actions and intentions is critical for efficient and effective collaborative Human-Robot Interactions (HRI)…

Representation Learning

MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrations

2024-07-10 · Vignesh Prasad, Alap Kshirsagar, Dorothea Koert, Ruth Stock-Homburg 외

Shared dynamics models are important for capturing the complexity and variability inherent in Human-Robot Interaction (HRI). Therefore, learning such shared dynamics models can enhance coordination and adaptability to en…

Mixture-of-Experts

JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups

2024-04-06 · CVPR 2024 1 · Simindokht Jahangard, Zhixi Cai, Shiki Wen, Hamid Rezatofighi

Understanding human social behaviour is crucial in computer vision and robotics. Micro-level observations like individual actions fall short, necessitating a comprehensive approach that considers individual behaviour, in…

SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulation

2026-02-02 · Mu Huang, Hui Wang, Kerui Ren, Linning Xu 외 arxiv

Simulating deformable objects under rich interactions remains a fundamental challenge for real-to-sim robot manipulation, with dynamics jointly driven by environmental effects and robot actions. Existing simulators rely …

Robot Manipulation