paper-with-me

Papers

Interpretable Affordance Detection on 3D Point Clouds with Probabilistic Prototypes

2025-04-25 · Maximilian Xiling Li, Korbinian Rudolf, Nils Blank, Rudolf Lioutikov

Robotic agents need to understand how to interact with objects in their environment, both autonomously and during human-robot interactions. Affordance detection on 3D point clouds, which identifies object regions that allow specific interactions, has traditionally relied on deep learning models like PointNet++, DGCNN, or PointTransformerV3. However, these models operate as black boxes, offering no insight into their decision-making processes. Prototypical Learning methods, such as ProtoPNet, provide an interpretable alternative to black-box models by employing a "this looks like that" case-based reasoning approach. However, they have been primarily applied to image-based tasks. In this work, we apply prototypical learning to models for affordance detection on 3D point clouds. Experiments on the 3D-AffordanceNet benchmark dataset show that prototypical models achieve competitive performance with state-of-the-art black-box models and offer inherent interpretability. This makes prototypical models a promising candidate for human-robot interaction scenarios that require increased trust and safety.

📄 PDF Abstract BibTeX arXiv:2504.18355

Code (0)

등록된 구현이 없습니다.

Tasks

Affordance DetectionDecision Making

Methods 이 논문이 사용한 방법론

DGCNN 설명 없음

Similar Papers 제목 키워드 기반

Open-Vocabulary Affordance Detection in 3D Point Clouds

2023-03-04 · Toan Nguyen, Minh Nhat Vu, An Vuong, Dzung Nguyen 외

Affordance detection is a challenging problem with a wide variety of robotic applications. Traditional affordance detection methods are limited to a predefined set of affordance labels, hence potentially restricting the …

Affordance Detection

Affordance detection with Dynamic-Tree Capsule Networks

2022-11-09 · Antonio Rodríguez-Sánchez, Simon Haller-Seeber, David Peer, Chris Engelhardt 외

Affordance detection from visual input is a fundamental step in autonomous robotic manipulation. Existing solutions to the problem of affordance detection rely on convolutional neural networks. However, these networks do…

Affordance Detection

Task-Aware 3D Affordance Segmentation via 2D Guidance and Geometric Refinement

2025-11-12 · Lian He, Meng Liu, Qilang Ye, Yu Zhou 외 arxiv

Understanding 3D scene-level affordances from natural language instructions is essential for enabling embodied agents to interact meaningfully in complex environments. However, this task remains challenging due to the ne…

Affordance DetectionPoint Clouds

VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection

2026-05-02 · Haowen Sun, Shaolong Zhang, Mingyang Li, Chengzhong Ma 외 arxiv

Open-vocabulary 3D affordance detection requires localizing interaction regions on point clouds given novel affordance descriptions. Recent methods extend multimodal large language models (MLLMs) with special output toke…

Affordance DetectionPoint Clouds

AffordMatcher: Affordance Learning in 3D Scenes from Visual Signifiers

2026-03-30 · Nghia Vu, Tuong Do, Khang Nguyen, Baoru Huang 외 arxiv

Affordance learning is a complex challenge in many applications, where existing approaches primarily focus on the geometric structures, visual knowledge, and affordance labels of objects to determine interactable regions…

Point Clouds