Object-Centric Task and Motion Planning in Dynamic Environments
We address the problem of applying Task and Motion Planning (TAMP) in real world environments. TAMP combines symbolic and geometric reasoning to produce sequential manipulation plans, typically specified as joint-space trajectories, which are valid only as long as the environment is static and perception and control are highly accurate. In case of any changes in the environment, slow re-planning is required. We propose a TAMP algorithm that optimizes over Cartesian frames defined relative to target objects. The resulting plan then remains valid even if the objects are moving and can be executed by reactive controllers that adapt to these changes in real time. We apply our TAMP framework to a torque-controlled robot in a pick and place setting and demonstrate its ability to adapt to changing environments, inaccurate perception, and imprecise control, both in simulation and the real world.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion PlanningObjectTask and Motion PlanningvalidSimilar Papers 제목 키워드 기반
Unified Task and Motion Planning using Object-centric Abstractions of Motion Constraints
In task and motion planning (TAMP), the ambiguity and underdetermination of abstract descriptions used by task planning methods make it difficult to characterize physical constraints needed to successfully execute a task…
Computational EfficiencyHeuristic SearchMotion PlanningTask and Motion Planning+1Safe Local Motion Planning With Self-Supervised Freespace Forecasting
Safe local motion planning for autonomous driving in dynamic environments requires forecasting how the scene evolves. Practical autonomy stacks adopt a semantic object-centric representation of a dynamic scene and bu…
Autonomous DrivingMotion Planningobject-detectionObject Detection+1Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations
Predictive world models enable agents to model scene dynamics and reason about the consequences of their actions. Inspired by human perception, object-centric world models capture scene dynamics using object-level repres…
Reinforcement LearningHigh-Degrees-of-Freedom Dynamic Neural Fields for Robot Self-Modeling and Motion Planning
A robot self-model is a task-agnostic representation of the robot's physical morphology that can be used for motion planning tasks in the absence of a classical geometric kinematic model. In particular, when the latter i…
Motion PlanningCausal Object-Centric Models for Planning with Monte Carlo Tree Search
We introduce COMET (Causal Object-centric Model for Efficient Tree search), a model-based reinforcement learning algorithm that performs Monte Carlo Tree Search in a slot-structured latent space. COMET pairs a frozen uns…
Reinforcement Learning