paper-with-me

Papers

Open-vocabulary 3D scene perception in industrial environments

2026-02-23 · Keno Moenck, Adrian Philip Florea, Julian Koch, Thorsten Schüppstuhl arxiv

Autonomous vision applications in production, intralogistics, or manufacturing environments require perception capabilities beyond a small, fixed set of classes. Recent open-vocabulary methods, leveraging 2D Vision-Language Foundation Models (VLFMs), target this task but often rely on class-agnostic segmentation models pre-trained on non-industrial datasets (e.g., household scenes). In this work, we first demonstrate that such models fail to generalize, performing poorly on common industrial objects. Therefore, we propose a training-free, open-vocabulary 3D perception pipeline that overcomes this limitation. Instead of using a pre-trained model to generate instance proposals, our method simply generates masks by merging pre-computed superpoints based on their semantic features. Following, we evaluate the domain-adapted VLFM "IndustrialCLIP" on a representative 3D industrial workshop scene for open-vocabulary querying. Our qualitative results demonstrate successful segmentation of industrial objects.

📄 PDF Abstract BibTeX arXiv:2602.19823

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments

2026-06-29 · Yirum Kim, Ue-Hwan Kim arxiv

3D scene graphs (3DSGs) provide a compact and structured abstraction of 3D environments. Although advances in foundation models have enabled open-vocabulary 3DSG generation, existing approaches remain object-centric and …

Scene Graph GenerationRelational Reasoning

Masked Point-Entity Contrast for Open-Vocabulary 3D Scene Understanding

2025-04-28 · CVPR 2025 1 · Yan Wang, Baoxiong Jia, Ziyu Zhu, Siyuan Huang

Open-vocabulary 3D scene understanding is pivotal for enhancing physical intelligence, as it enables embodied agents to interpret and interact dynamically within real-world environments. This paper introduces MPEC, a nov…

3D Semantic SegmentationContrastive LearningScene UnderstandingSemantic Segmentation

Open 3D World in Autonomous Driving

2024-08-20 · Xinlong Cheng, Lei LI

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite …

Autonomous DrivingAutonomous Navigation

SuperMap: A Spatio-Temporal SLAM System for Visual-Language Navigation

2026-08-24 · Shibo Zhao, Guofei Chen, Honghao Zhu, Zhiheng Li 외 arxiv

Robotic navigation in human environments requires a spatio-temporal semantic representation that can rec- oncile open-vocabulary perception with long-term environmental changes. While foundation models provide strong zer…

Open-World 3D Scene Graph Generation for Retrieval-Augmented Reasoning

2025-11-08 · Fei Yu, Quan Deng, Shengeng Tang, Yuehua Li 외 arxiv

Understanding 3D scenes in open-world settings poses fundamental challenges for vision and robotics, particularly due to the limitations of closed-vocabulary supervision and static annotations. To address this, we propos…

Scene Graph GenerationScene UnderstandingQuestion AnsweringVisual Grounding