paper-with-me

홈 › Papers

Understanding Human Context in 3D Scenes by Learning Spatial Affordances with Virtual Skeleton Models

2019-06-13 · Lasitha Piyathilaka, Sarath Kodagoda

Robots are often required to operate in environments where humans are not present, but yet require the human context information for better human-robot interaction. Even when humans are present in the environment, detecting their presence in cluttered environments could be challenging. As a solution to this problem, this paper presents the concept of spatial affordance map which learns human context by looking at geometric features of the environment. Instead of observing real humans to learn human context, it uses virtual human models and their relationships with the environment to map hidden human affordances in 3D scenes by placing virtual skeleton models in 3D scenes with their confidence values. The spatial affordance map learning problem is formulated as a multi-label classification problem that can be learned using Support Vector Machine (SVM) based learners. Experiments carried out in a real 3D scene dataset recorded promising results and proved the applicability of affordance-map for mapping human context.

📄 PDF Abstract BibTeX arXiv:1906.05498

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Similar Papers 제목 키워드 기반

Text-Scene: A Scene-to-Language Parsing Framework for 3D Scene Understanding

2025-09-20 · Haoyuan Li, Rui Liu, Hehe Fan, Yi Yang arxiv

Enabling agents to understand and interact with complex 3D scenes is a fundamental challenge for embodied artificial intelligence systems. While Multimodal Large Language Models (MLLMs) have achieved significant progress…

Scene Understanding

TB-HSU: Hierarchical 3D Scene Understanding with Contextual Affordances

2024-12-07 · Wenting Xu, Viorela Ila, Luping Zhou, Craig T. Jin

The concept of function and affordance is a critical aspect of 3D scene understanding and supports task-oriented objectives. In this work, we develop a model that learns to structure and vary functional affordance across…

Multi-Task LearningObjectScene Understanding

Augmenting Human Cognition through Everyday AR

2025-05-06 · Xiaoan Liu

As spatial computing and multimodal LLMs mature, AR is tending to become an intuitive "thinking tool," embedding semantic and context-aware intelligence directly into everyday environments. This paper explores how always…

Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments

2019-03-13 · CVPR 2019 6 · Xueting Li, Sifei Liu, Kihwan Kim, Xiaolong Wang 외

Affordance modeling plays an important role in visual understanding. In this paper, we aim to predict affordances of 3D indoor scenes, specifically what human poses are afforded by a given indoor environment, such as sit…

valid

Object-agnostic Affordance Categorization via Unsupervised Learning of Graph Embeddings

2023-03-30 · Alexia Toumpa, Anthony G. Cohn

Acquiring knowledge about object interactions and affordances can facilitate scene understanding and human-robot collaboration tasks. As humans tend to use objects in many different ways depending on the scene and the ob…

ObjectScene Understanding