paper-with-me

홈 › Papers

AdaCo: Overcoming Visual Foundation Model Noise in 3D Semantic Segmentation via Adaptive Label Correction

2024-12-24 · Pufan Zou, Shijia Zhao, Weijie Huang, Qiming Xia, Chenglu Wen, Wei Li, Cheng Wang

Recently, Visual Foundation Models (VFMs) have shown a remarkable generalization performance in 3D perception tasks. However, their effectiveness in large-scale outdoor datasets remains constrained by the scarcity of accurate supervision signals, the extensive noise caused by variable outdoor conditions, and the abundance of unknown objects. In this work, we propose a novel label-free learning method, Adaptive Label Correction (AdaCo), for 3D semantic segmentation. AdaCo first introduces the Cross-modal Label Generation Module (CLGM), providing cross-modal supervision with the formidable interpretive capabilities of the VFMs. Subsequently, AdaCo incorporates the Adaptive Noise Corrector (ANC), updating and adjusting the noisy samples within this supervision iteratively during training. Moreover, we develop an Adaptive Robust Loss (ARL) function to modulate each sample's sensitivity to noisy supervision, preventing potential underfitting issues associated with robust loss. Our proposed AdaCo can effectively mitigate the performance limitations of label-free learning networks in 3D semantic segmentation tasks. Extensive experiments on two outdoor benchmark datasets highlight the superior performance of our method.

📄 PDF Abstract BibTeX arXiv:2412.18255

Code (0)

등록된 구현이 없습니다.

Tasks

3D Semantic SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

AdaCoder: Adaptive Prompt Compression for Programmatic Visual Question Answering

2024-07-28 · Mahiro Ukai, Shuhei Kurita, Atsushi Hashimoto, Yoshitaka Ushiku 외

Visual question answering aims to provide responses to natural language questions given visual input. Recently, visual programmatic models (VPMs), which generate executable programs to answer questions through large lang…

Question AnsweringVisual Question Answering

AdaCodec: A Predictive Visual Code for Video MLLMs

2026-06-01 · Haowen Hou, Zhen Huang, Zheming Liang, Qingyi Si 외 arxiv

Video is temporally redundant: adjacent frames usually share most objects, background, and layout. Yet existing video multimodal large language models (video MLLMs) usually encode each sampled frame as an independent RGB…

Neural Image Compression Using Masked Sparse Visual Representation

2023-09-20 · Wei Jiang, Wei Wang, Yue Chen

We study neural image compression based on the Sparse Visual Representation (SVR), where images are embedded into a discrete latent space spanned by learned visual codebooks. By sharing codebooks with the decoder, the en…

DecoderImage Compression

AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting

2026-07-02 · Muhammad Ibraheem Siddiqui, Muhammad Haris Khan arxiv

Zero-shot object counting (ZOC) aims to count instances of arbitrary object categories specified only through textual prompts. Recent training-free approaches leverage foundation models such as SAM to reformulate countin…

Object Counting

Temporally-Adaptive Models for Efficient Video Understanding

2023-08-10 · Ziyuan Huang, Shiwei Zhang, Liang Pan, Zhiwu Qing 외

Spatial convolutions are extensively used in numerous deep video models. It fundamentally assumes spatio-temporal invariance, i.e., using shared weights for every location in different frames. This work presents Temporal…

Action ClassificationAction RecognitionVideo Understanding