Self-Supervised Damage-Avoiding Manipulation Strategy Optimization via Mental Simulation
Everyday robotics are challenged to deal with autonomous product handling in applications like logistics or retail, possibly causing damage on the items during manipulation. Traditionally, most approaches try to minimize physical interaction with goods. However, this paper proposes to take into account any unintended object motion and to learn damage-minimizing manipulation strategies in a self-supervised way. The presented approach consists of a simulation-based planning method for an optimal manipulation sequence with respect to possible damage. The planned manipulation sequences are generalized to new, unseen scenes in the same application scenario using machine learning. This learned manipulation strategy is continuously refined in a self-supervised, simulation-in-the-loop optimization cycle during load-free times of the system, commonly known as mental simulation. In parallel, the generated manipulation strategies can be deployed in near-real time in an anytime fashion. The approach is validated on an industrial container-unloading scenario and on a retail shelf-replenishment scenario.
Code (2)
Similar Papers 제목 키워드 기반
OopsieVerse: A Safety Benchmark with Damage-Aware Simulation for Robot Manipulation
While robotic manipulation capabilities have advanced rapidly, physical safety remains a major barrier to deploying household robots: task success is insufficient if the robot damages itself or its surroundings. Simulati…
Reinforcement LearningRobot ManipulationCar Damage Detection and Patch-to-Patch Self-supervised Image Alignment
Most computer vision applications aim to identify pixels in a scene and use them for diverse purposes. One intriguing application is car damage detection for insurance carriers which tends to detect all car damages by co…
Learning Image Representations by Completing Damaged Jigsaw Puzzles
In this paper, we explore methods of complicating self-supervised tasks for representation learning. That is, we do severe damage to data and encourage a network to recover them. First, we complicate each of three powerf…
ColorizationRepresentation LearningSemantic SegmentationTransfer LearningBuilding Damage Mapping with Self-PositiveUnlabeled Learning
Humanitarian organizations must have fast and reliable data to respond to disasters. Deep learning approaches are difficult to implement in real-world disasters because it might be challenging to collect ground truth dat…
Building Damage AssessmentHumanitarianSelf-Supervised Feature Learning by Learning to Spot Artifacts
We introduce a novel self-supervised learning method based on adversarial training. Our objective is to train a discriminator network to distinguish real images from images with synthetic artifacts, and then to extract f…
DecoderSelf-Supervised Learning