Functional Object-Oriented Network: Construction & Expansion
We build upon the functional object-oriented network (FOON), a structured knowledge representation which is constructed from observations of human activities and manipulations. A FOON can be used for representing object-motion affordances. Knowledge retrieval through graph search allows us to obtain novel manipulation sequences using knowledge spanning across many video sources, hence the novelty in our approach. However, we are limited to the sources collected. To further improve the performance of knowledge retrieval as a follow up to our previous work, we discuss generalizing knowledge to be applied to objects which are similar to what we have in FOON without manually annotating new sources of knowledge. We discuss two means of generalization: 1) expanding our network through the use of object similarity to create new functional units from those we already have, and 2) compressing the functional units by object categories rather than specific objects. We discuss experiments which compare the performance of our knowledge retrieval algorithm with both expansion and compression by categories.
Code (1)
Tasks
ObjectRetrievalSimilar Papers 제목 키워드 기반
An Ecological Robustness-Oriented Approach for Power System Network Expansion
Power systems are critical infrastructure for reliable and secure electric energy delivery. Incidents are increasing, as unexpected multiple hazards ranging from natural disasters to cyberattacks threaten the security an…
Task Tree Retrieval Algorithms for Robotic Cooking Using The Functional Object-Oriented Network
Using the Functional Object-Oriented Network, we have implemented three search algorithms for generating the task trees for the given goal nodes. The approach, process, and results are written in this paper.
ObjectRetrievalLong Activity Video Understanding using Functional Object-Oriented Network
Video understanding is one of the most challenging topics in computer vision. In this paper, a four-stage video understanding pipeline is presented to simultaneously recognize all atomic actions and the single on-going a…
ObjectVideo UnderstandingProvably scale-covariant networks from oriented quasi quadrature measures in cascade
This article presents a continuous model for hierarchical networks based on a combination of mathematically derived models of receptive fields and biologically inspired computations. Based on a functional model of comple…
Texture ClassificationFunctional Expansions
Path dependence is omnipresent in many disciplines such as engineering, system theory and finance. It reflects the influence of the past on the future, often expressed through functionals. However, non-Markovian problems…