paper-with-me

Papers

Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusions

2023-09-14 · NeurIPS 2023 11

Perceiving and manipulating 3D articulated objects in diverse environments is essential for home-assistant robots. Recent studies have shown that point-level affordance provides actionable priors for downstream manipulation tasks. However, existing works primarily focus on single-object scenarios with homogeneous agents, overlooking the realistic constraints imposed by the environment and the agent's morphology, e.g., occlusions and physical limitations. In this paper, we propose an environment-aware affordance framework that incorporates both object-level actionable priors and environment constraints. Unlike object-centric affordance approaches, learning environment-aware affordance faces the challenge of combinatorial explosion due to the complexity of various occlusions, characterized by their quantities, geometries, positions and poses. To address this and enhance data efficiency, we introduce a novel contrastive affordance learning framework capable of training on scenes containing a single occluder and generalizing to scenes with complex occluder combinations. Experiments demonstrate the effectiveness of our proposed approach in learning affordance considering environment constraints. Project page at https://chengkaiacademycity.github.io/EnvAwareAfford/

📄 PDF Abstract BibTeX arXiv:2309.07510

Code (0)

등록된 구현이 없습니다.

Tasks

Object

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

ArtiBench and ArtiBrain: Benchmarking Generalizable Vision-Language Articulated Object Manipulation

2025-11-25 · Yuhan Wu, Tiantian Wei, Shuo Wang, ZhiChao Wang 외 arxiv

Interactive articulated manipulation requires long-horizon, multi-step interactions with appliances while maintaining physical consistency. Existing vision-language and diffusion-based policies struggle to generalize acr…

AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactions

2021-12-01 · Yian Wang, Ruihai Wu, Kaichun Mo, Jiaqi Ke 외

Perceiving and interacting with 3D articulated objects, such as cabinets, doors, and faucets, pose particular challenges for future home-assistant robots performing daily tasks in human environments. Besides parsing the …

Friction

ManipGPT: Is Affordance Segmentation by Large Vision Models Enough for Articulated Object Manipulation?

2024-12-13 · Taewhan Kim, Hojin Bae, Zeming Li, Xiaoqi Li 외

Visual actionable affordance has emerged as a transformative approach in robotics, focusing on perceiving interaction areas prior to manipulation. Traditional methods rely on pixel sampling to identify successful interac…

Robot Manipulation

Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Grounding

2025-07-24 · Xiaojie Zhang, Yuanfei Wang, Ruihai Wu, Kunqi Xu 외 arxiv

Articulated objects pose diverse manipulation challenges for robots. Since their internal structures are not directly observable, robots must adaptively explore and refine actions to generate successful manipulation traj…

IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments

2025-01-01 · CVPR 2025 1 · Can Zhang, Gim Hee Lee

This work presents IAAO, a novel framework that builds an explicit 3D model for intelligent agents to gain understanding of articulated objects in their environment through interaction. Unlike prior methods that rely…

3DGS