paper-with-me

홈 › Papers

Lighting-aware Unified Model for Instance Segmentation

2026-05-19 · Qisai Liu, Alloy Das, Zhanhong Jiang, Joshua R. Waite, Aditya Balu, Adarsh Krishnamurthy, Soumik Sarkar arxiv

Foundation models like the Segment Anything Model (SAM) demonstrate impressive zero-shot generalization but frequently degrade under diverse real-world illumination, particularly for instance segmentation. In this work, we address this limitation by developing \textit{Lighting Convolutional-Attention (\lca{})}, an adapter module that enhances segmentation robustness without fine-tuning the heavy backbone. \lca{} employs a dual-branch architecture to process RGB features alongside contrast maps, enabling physically motivated sensitivity to structural changes rather than illumination artifacts. We optimize \lca{} through a pairwise training strategy, introducing a targeted loss term that explicitly penalizes discrepancies between clean images and their corresponding illumination variants. To evaluate and support this architecture, we conduct a comprehensive empirical study across multiple existing benchmarks and present a novel Unity-based synthetic dataset specifically designed to accurately replicate complex real-world lighting conditions. Extensive experimental results demonstrate that our approach successfully bridges the domain gap, delivering superior lighting-robust segmentation.

📄 PDF Abstract BibTeX arXiv:2605.20436

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot GeneralizationInstance Segmentation

Similar Papers 제목 키워드 기반

PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentation

2022-06-01 · CVPR 2022 1 · Naiyu Gao, Fei He, Jian Jia, Yanhu Shan 외

This paper presents a unified framework for depth-aware panoptic segmentation (DPS), which aims to reconstruct 3D scene with instance-level semantics from one single image. Prior works address this problem by simply addi…

Depth EstimationDepth PredictionPanoptic SegmentationSegmentation

DocSAM: Unified Document Image Segmentation via Query Decomposition and Heterogeneous Mixed Learning

2025-01-01 · CVPR 2025 1 · Xiao-Hui Li, Fei Yin, Cheng-Lin Liu

Document image segmentation is crucial in document analysis and recognition but remains challenging due to the heterogeneity of document formats and diverse segmentation tasks. Existing methods often treat these task…

Document Layout AnalysisImage SegmentationSegmentationSemantic Segmentation+2

SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentation

2023-05-08 · Ayan Banerjee, Sanket Biswas, Josep Lladós, Umapada Pal

Instance-level segmentation of documents consists in assigning a class-aware and instance-aware label to each pixel of the image. It is a key step in document parsing for their understanding. In this paper, we present a …

DecoderInstance SegmentationSegmentationSemantic Segmentation

SRFormer: Text Detection Transformer with Incorporated Segmentation and Regression

2023-08-21 · Qingwen Bu, Sungrae Park, Minsoo Khang, Yichuan Cheng

Existing techniques for text detection can be broadly classified into two primary groups: segmentation-based and regression-based methods. Segmentation models offer enhanced robustness to font variations but require intr…

DecoderregressionScene Text DetectionSegmentation+1

PUPS: Point Cloud Unified Panoptic Segmentation

2023-02-13 · Shihao Su, Jianyun Xu, Huanyu Wang, Zhenwei Miao 외

Point cloud panoptic segmentation is a challenging task that seeks a holistic solution for both semantic and instance segmentation to predict groupings of coherent points. Previous approaches treat semantic and instance …

DecoderInstance SegmentationPanoptic SegmentationSegmentation+1