Uncertainty-aware Planning with Inaccurate Models for Robotized Liquid Handling
Physics-based simulations and learning-based models are vital for complex robotics tasks like deformable object manipulation and liquid handling. However, these models often struggle with accuracy due to epistemic uncertainty or the sim-to-real gap. For instance, accurately pouring liquid from one container to another poses challenges, particularly when models are trained on limited demonstrations and may perform poorly in novel situations. This paper proposes an uncertainty-aware Monte Carlo Tree Search (MCTS) algorithm designed to mitigate these inaccuracies. By incorporating estimates of model uncertainty, the proposed MCTS strategy biases the search towards actions with lower predicted uncertainty. This approach enhances the reliability of planning under uncertain conditions. Applied to a liquid pouring task, our method demonstrates improved success rates even with models trained on minimal data, outperforming traditional methods and showcasing its potential for robust decision-making in robotics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Bounding-Box Inference for Error-Aware Model-Based Reinforcement Learning
In model-based reinforcement learning, simulated experiences from the learned model are often treated as equivalent to experience from the real environment. However, when the model is inaccurate, it can catastrophically …
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningLook Before Leap: Look-Ahead Planning with Uncertainty in Reinforcement Learning
Model-based reinforcement learning (MBRL) has demonstrated superior sample efficiency compared to model-free reinforcement learning (MFRL). However, the presence of inaccurate models can introduce biases during policy le…
Atari GamesModel-based Reinforcement LearningDiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solving
We propose DiffusionRollout, a novel selective rollout planning strategy for autoregressive diffusion models, aimed at mitigating error accumulation in long-horizon predictions of physical systems governed by partial dif…
A Systematic Literature Review of Computer Vision Applications in Robotized Wire Harness Assembly
This article provides a systematic literature review of computer vision applications in robotized wire harness assembly.
Systematic Literature ReviewOverview of Computer Vision Techniques in Robotized Wire Harness Assembly: Current State and Future Opportunities
Wire harnesses are essential hardware for electronic systems in modern automotive vehicles. With a shift in the automotive industry towards electrification and autonomous driving, more and more automotive electronics are…
Autonomous Driving