See the Glass Half Full: Reasoning about Liquid Containers, their Volume and Content
Humans have rich understanding of liquid containers and their contents; for example, we can effortlessly pour water from a pitcher to a cup. Doing so requires estimating the volume of the cup, approximating the amount of water in the pitcher, and predicting the behavior of water when we tilt the pitcher. Very little attention in computer vision has been made to liquids and their containers. In this paper, we study liquid containers and their contents, and propose methods to estimate the volume of containers, approximate the amount of liquid in them, and perform comparative volume estimations all from a single RGB image. Furthermore, we show the results of the proposed model for predicting the behavior of liquids inside containers when one tilts the containers. We also introduce a new dataset of Containers Of liQuid contEnt (COQE) that contains more than 5,000 images of 10,000 liquid containers in context labelled with volume, amount of content, bounding box annotation, and corresponding similar 3D CAD models.
Code (1)
Similar Papers 제목 키워드 기반
A Thermodynamics-informed Active Learning Approach to Perception and Reasoning about Fluids
Learning and reasoning about physical phenomena is still a challenge in robotics development, and computational sciences play a capital role in the search for accurate methods able to provide explanations for past events…
Active LearningPerceiving and Reasoning About Liquids Using Fully Convolutional Networks
Liquids are an important part of many common manipulation tasks in human environments. If we wish to have robots that can accomplish these types of tasks, they must be able to interact with liquids in an intelligent mann…
Deep Learning for Automated Classification and Characterization of Amorphous Materials
It is difficult to quantify structure-property relationships and to identify structural features of complex materials. The characterization of amorphous materials is especially challenging because their lack of long-rang…
ClassificationDeep LearningGeneral ClassificationReasoning About Liquids via Closed-Loop Simulation
Simulators are powerful tools for reasoning about a robot's interactions with its environment. However, when simulations diverge from reality, that reasoning becomes less useful. In this paper, we show how to close the l…
Liquid SimulationA new behavioral model for portfolio selection using the Half-Full/Half-Empty approach
We focus on a behavioral model, that has been recently proposed in the literature, whose rational can be traced back to the Half-Full/Half-Empty glass metaphor. More precisely, we generalize the Half-Full/Half-Empty appr…