paper-with-me

Papers

MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds

2025-02-26 · Gabriele Tiboni, Raffaello Camoriano, Tatiana Tommasi

Object-Centric Motion Generation (OCMG) plays a key role in a variety of industrial applications$\unicode{x2014}$such as robotic spray painting and welding$\unicode{x2014}$requiring efficient, scalable, and generalizable algorithms to plan multiple long-horizon trajectories over free-form 3D objects. However, existing solutions rely on specialized heuristics, expensive optimization routines, or restrictive geometry assumptions that limit their adaptability to real-world scenarios. In this work, we introduce a novel, fully data-driven framework that tackles OCMG directly from 3D point clouds, learning to generalize expert path patterns across free-form surfaces. We propose MaskPlanner, a deep learning method that predicts local path segments for a given object while simultaneously inferring "path masks" to group these segments into distinct paths. This design induces the network to capture both local geometric patterns and global task requirements in a single forward pass. Extensive experimentation on a realistic robotic spray painting scenario shows that our approach attains near-complete coverage (above 99%) for unseen objects, while it remains task-agnostic and does not explicitly optimize for paint deposition. Moreover, our real-world validation on a 6-DoF specialized painting robot demonstrates that the generated trajectories are directly executable and yield expert-level painting quality. Our findings crucially highlight the potential of the proposed learning method for OCMG to reduce engineering overhead and seamlessly adapt to several industrial use cases.

📄 PDF Abstract BibTeX arXiv:2502.18745

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Generation

Similar Papers 제목 키워드 기반

Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects

2024-03-25 · Zicong Fan, Takehiko Ohkawa, Linlin Yang, Nie Lin 외

We interact with the world with our hands and see it through our own (egocentric) perspective. A holistic 3Dunderstanding of such interactions from egocentric views is important for tasks in robotics, AR/VR, action recog…

Action RecognitionMotion GenerationObjectObject Reconstruction+1

EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control

2026-06-07 · Haoyang Ge, Peng Ren, Yukun Shi, Cong Huang 외 arxiv

Humanoid robots require whole-body motions that adapt to scene context, task requirements, and user intent. Motion tracking reproduces specified trajectories, and humanoid vision-language-action systems provide semantic …

Hand2World: Autoregressive Egocentric Interaction Generation via Free-Space Hand Gestures

2026-02-10 · Yuxi Wang, Wenqi Ouyang, Tianyi Wei, Yi Dong 외 arxiv

Egocentric interactive world models are essential for augmented reality and embodied AI, where visual generation must respond to user input with low latency, geometric consistency, and long-term stability. We study egoce…

Video Generation

MEgoHand: Multimodal Egocentric Hand-Object Interaction Motion Generation

2025-05-22 · Bohan Zhou, Yi Zhan, Zhongbin Zhang, Zongqing Lu

Egocentric hand-object motion generation is crucial for immersive AR/VR and robotic imitation but remains challenging due to unstable viewpoints, self-occlusions, perspective distortion, and noisy ego-motion. Existing me…

Motion GenerationObjectSpatial Reasoning

E$^3$C: Video Generation with 3D Environmental Memory and Ego-Exo Human Pose Control

2026-05-25 · Qiao Gu, Lingni Ma, Adam W Harley, Richard Newcombe 외 arxiv

Controllable and physically grounded egocentric video generation is essential for embodied agents to reason about how their own and others' actions manifest and change the world. Compared to generic video synthesis, egoc…

Video Generation