paper-with-me

Papers

Privacy-Preserving Depth-Only Open-Vocabulary 3D Semantic Segmentation Via Uncertainty-Guided Test-Time Optimization

2026-07-01 · Xuying Huang, Sicong Pan, Maren Bennewitz arxiv

Privacy-preserving perception is a critical requirement for deploying 3D scene understanding systems in real-world indoor environments, yet it remains underexplored in open-vocabulary 3D semantic segmentation. Existing methods typically rely on obtaining rich semantic cues from RGB images, which may expose privacy-sensitive visual information. Depth-only 3D geometry provides a privacy-preserving alternative, but the absence of appearance-based semantic cues makes open-vocabulary predictions highly uncertain and less reliable. Under this setting, we propose to convert uncertainty into a guidance signal to identify unreliable semantic responses and use semantic priors from foundation models to regularize their refinement. We present UTTO, an uncertainty-guided test-time optimization framework for depth-only open-vocabulary 3D semantic segmentation. Without additional training, experiments on ScanNet20, ScanNet40, and ScanNet200 demonstrate that UTTO consistently improves depth-only open-vocabulary 3D segmentation and outperforms representative baselines under privacy-preserving conditions.

📄 PDF Abstract BibTeX arXiv:2607.00978

Code (0)

등록된 구현이 없습니다.

Tasks

3D Semantic SegmentationScene Understanding

Similar Papers 제목 키워드 기반

VEON: Vocabulary-Enhanced Occupancy Prediction

2024-07-17 · Jilai Zheng, Pin Tang, Zhongdao Wang, Guoqing Wang 외

Perceiving the world as 3D occupancy supports embodied agents to avoid collision with any types of obstacle. While open-vocabulary image understanding has prospered recently, how to bind the predicted 3D occupancy grids …

Prediction

LEXI-SG: Monocular 3D Scene Graph Mapping with Room-Guided Feed-Forward Reconstruction

2026-05-13 · Christina Kassab, Hyeonjae Gil, Matías Mattamala, Ayoung Kim 외 arxiv

Scene graphs are becoming a standard representation for robot navigation, providing hierarchical geometric and semantic scene understanding. However, most scene graph mapping methods rely on depth cameras or LiDAR sensor…

Object SegmentationScene UnderstandingRobot Navigation

Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained Devices

2022-07-18 · MingBin Xu, Congzheng Song, Ye Tian, Neha Agrawal 외

Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network …

Federated LearningLanguage ModelingLanguage Modelling

Semantic-Drive: Democratizing Long-Tail Data Curation via Open-Vocabulary Grounding and Neuro-Symbolic VLM Consensus

2025-12-12 · Antonio Guillen-Perez arxiv

The development of robust Autonomous Vehicles (AVs) is bottlenecked by the scarcity of "Long-Tail" training data. While fleets collect petabytes of video logs, identifying rare safety-critical events (e.g., erratic jaywa…

Autonomous Vehicles

GoalSwarm: Multi-UAV Semantic Coordination for Open-Vocabulary Object Navigation

2026-03-13 · MoniJesu Wonders James, Amir Atef Habel, Aleksey Fedoseev, Dzmitry Tsetserokou arxiv

Cooperative visual semantic navigation is a foundational capability for aerial robot teams operating in unknown environments. However, achieving robust open-vocabulary object-goal navigation remains challenging due to th…