RUMI: Rummaging Using Mutual Information
This paper presents Rummaging Using Mutual Information (RUMI), a method for online generation of robot action sequences to gather information about the pose of a known movable object in visually-occluded environments. Focusing on contact-rich rummaging, our approach leverages mutual information between the object pose distribution and robot trajectory for action planning. From an observed partial point cloud, RUMI deduces the compatible object pose distribution and approximates the mutual information of it with workspace occupancy in real time. Based on this, we develop an information gain cost function and a reachability cost function to keep the object within the robot's reach. These are integrated into a model predictive control (MPC) framework with a stochastic dynamics model, updating the pose distribution in a closed loop. Key contributions include a new belief framework for object pose estimation, an efficient information gain computation strategy, and a robust MPC-based control scheme. RUMI demonstrates superior performance in both simulated and real tasks compared to baseline methods.
Code (1)
Tasks
Model Predictive ControlObjectPose EstimationSimilar Papers 제목 키워드 기반
Dairy Cow rumination detection: A deep learning approach
Cattle activity is an essential index for monitoring health and welfare of the ruminants. Thus, changes in the livestock behavior are a critical indicator for early detection and prevention of several diseases. Ruminatio…
Deep LearningVideo-R4: Reinforcing Text-Rich Video Reasoning with Visual Rumination
Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations an…
Reinforcement LearningMultimodal ReasoningRuminating Reader: Reasoning with Gated Multi-Hop Attention
To answer the question in machine comprehension (MC) task, the models need to establish the interaction between the question and the context. To tackle the problem that the single-pass model cannot reflect on and correct…
Question AnsweringReading ComprehensionControllable Game Level Generation: Assessing the Effect of Negative Examples in GAN Models
Generative Adversarial Networks (GANs) are unsupervised models designed to learn and replicate a target distribution. The vanilla versions of these models can be extended to more controllable models. Conditional Generati…
Microbial Engineering to Mitigate Methane Emissions in Ruminant Livestock -- A Review
The most recent and promising strategies for mitigating methane emissions in ruminants are reviewed highlighting the potential of reductive acetogenesis as a viable alternative to methanogenesis. The emergence of Cluster…