paper-with-me

홈 › Papers

Affordances Provide a Fundamental Categorization Principle for Visual Scenes

2014-11-19 · Michelle R. Greene, Christopher Baldassano, Andre Esteva, Diane M. Beck, Li Fei-Fei

How do we know that a kitchen is a kitchen by looking? Relatively little is known about how we conceptualize and categorize different visual environments. Traditional models of visual perception posit that scene categorization is achieved through the recognition of a scene's objects, yet these models cannot account for the mounting evidence that human observers are relatively insensitive to the local details in an image. Psychologists have long theorized that the affordances, or actionable possibilities of a stimulus are pivotal to its perception. To what extent are scene categories created from similar affordances? Using a large-scale experiment using hundreds of scene categories, we show that the activities afforded by a visual scene provide a fundamental categorization principle. Affordance-based similarity explained the majority of the structure in the human scene categorization patterns, outperforming alternative similarities based on objects or visual features. We all models were combined, affordances provided the majority of the predictive power in the combined model, and nearly half of the total explained variance is captured only by affordances. These results challenge many existing models of high-level visual perception, and provide immediately testable hypotheses for the functional organization of the human perceptual system.

📄 PDF Abstract BibTeX arXiv:1411.5340

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Visual Affordance and Function Understanding: A Survey

2018-07-18 · Mohammed Hassanin, Salman Khan, Murat Tahtali

Nowadays, robots are dominating the manufacturing, entertainment and healthcare industries. Robot vision aims to equip robots with the ability to discover information, understand it and interact with the environment. The…

Affordance DetectionScene UnderstandingSurvey

Mining Semantic Affordances of Visual Object Categories

2015-06-01 · CVPR 2015 6 · Yu-Wei Chao, Zhan Wang, Rada Mihalcea, Jia Deng

Affordances are fundamental attributes of objects. Affordances reveal the functionalities of objects and the possible actions that can be performed on them. Understanding affordances is crucial for recognizing human acti…

Collaborative FilteringObject

Object-agnostic Affordance Categorization via Unsupervised Learning of Graph Embeddings

2023-03-30 · Alexia Toumpa, Anthony G. Cohn

Acquiring knowledge about object interactions and affordances can facilitate scene understanding and human-robot collaboration tasks. As humans tend to use objects in many different ways depending on the scene and the ob…

ObjectScene Understanding

Blocks as Probes: Dissecting Categorization Ability of Large Multimodal Models

2024-09-03 · Bin Fu, Qiyang Wan, Jialin Li, Ruiping Wang 외

Categorization, a core cognitive ability in humans that organizes objects based on common features, is essential to cognitive science as well as computer vision. To evaluate the categorization ability of visual AI models…

Question AnsweringVisual Question Answering

Learning Intermediate Features of Object Affordances with a Convolutional Neural Network

2020-02-20 · Aria Yuan Wang, Michael J. Tarr

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visu…