paper-with-me

홈 › Papers

Learning Quasi-Static 3D Models of Markerless Deformable Linear Objects for Bimanual Robotic Manipulation

2023-09-14 · Piotr Kicki, Michał Bidziński, Krzysztof Walas

The robotic manipulation of Deformable Linear Objects (DLOs) is a vital and challenging task that is important in many practical applications. Classical model-based approaches to this problem require an accurate model to capture how robot motions affect the deformation of the DLO. Nowadays, data-driven models offer the best tradeoff between quality and computation time. This paper analyzes several learning-based 3D models of the DLO and proposes a new one based on the Transformer architecture that achieves superior accuracy, even on the DLOs of different lengths, thanks to the proposed scaling method. Moreover, we introduce a data augmentation technique, which improves the prediction performance of almost all considered DLO data-driven models. Thanks to this technique, even a simple Multilayer Perceptron (MLP) achieves close to state-of-the-art performance while being significantly faster to evaluate. In the experiments, we compare the performance of the learning-based 3D models of the DLO on several challenging datasets quantitatively and demonstrate their applicability in the task of shaping a DLO.

📄 PDF Abstract BibTeX arXiv:2309.07609

Code (1)

ppi-put/neural_dlo_model 공식 구현 tf

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

HMDO: Markerless Multi-view Hand Manipulation Capture with Deformable Objects

2023-01-18 · Wei Xie, Zhipeng Yu, Zimeng Zhao, Binghui Zuo 외

We construct the first markerless deformable interaction dataset recording interactive motions of the hands and deformable objects, called HMDO (Hand Manipulation with Deformable Objects). With our built multi-view captu…

ObjectObject ReconstructionPose Estimation

Coordinated Manipulation of Hybrid Deformable-Rigid Objects in Constrained Environments

2026-03-13 · Anees Peringal, Anup Teejo Mathew, Panagiotis liatsis, Federico Renda arxiv

Coordinated robotic manipulation of deformable linear objects (DLOs), such as ropes and cables, has been widely studied; however, handling hybrid assemblies composed of both deformable and rigid elements in constrained e…

Self-supervised Physics-Informed Manipulation of Deformable Linear Objects with Non-negligible Dynamics

2026-02-03 · Youyuan Long, Gokhan Solak, Sara Zeynalpour, Heng Zhang 외 arxiv

We address dynamic manipulation of deformable linear objects by presenting SPiD, a physics-informed self-supervised learning framework that couples an accurate deformable object model with an augmented self-supervised tr…

Self-Supervised Learning

TrackDeform3D: Markerless and Autonomous 3D Keypoint Tracking and Dataset Collection for Deformable Objects

2026-03-17 · Yeheng Zong, Yizhou Chen, Alexander Bowler, Chia-Tung Yang 외 arxiv

Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometric and topological information useful for downstream tasks such as dynamic…

Motion Planning

Benchmarking the Sim-to-Real Gap in Cloth Manipulation

2023-10-14 · David Blanco-Mulero, Oriol Barbany, Gokhan Alcan, Adrià Colomé 외

Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object…

BenchmarkingMuJoCoObject