Lighting-aware Unified Model for Instance Segmentation
Foundation models like the Segment Anything Model (SAM) demonstrate impressive zero-shot generalization but frequently degrade under diverse real-world illumination, particularly for instance segmentation. In this work, we address this limitation by developing \textit{Lighting Convolutional-Attention (\lca{})}, an adapter module that enhances segmentation robustness without fine-tuning the heavy backbone. \lca{} employs a dual-branch architecture to process RGB features alongside contrast maps, enabling physically motivated sensitivity to structural changes rather than illumination artifacts. We optimize \lca{} through a pairwise training strategy, introducing a targeted loss term that explicitly penalizes discrepancies between clean images and their corresponding illumination variants. To evaluate and support this architecture, we conduct a comprehensive empirical study across multiple existing benchmarks and present a novel Unity-based synthetic dataset specifically designed to accurately replicate complex real-world lighting conditions. Extensive experimental results demonstrate that our approach successfully bridges the domain gap, delivering superior lighting-robust segmentation.
Code (0)
등록된 구현이 없습니다.
Tasks
Zero-shot GeneralizationInstance SegmentationSimilar Papers 제목 키워드 기반
PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentation
This paper presents a unified framework for depth-aware panoptic segmentation (DPS), which aims to reconstruct 3D scene with instance-level semantics from one single image. Prior works address this problem by simply addi…
Depth EstimationDepth PredictionPanoptic SegmentationSegmentationDocSAM: Unified Document Image Segmentation via Query Decomposition and Heterogeneous Mixed Learning
Document image segmentation is crucial in document analysis and recognition but remains challenging due to the heterogeneity of document formats and diverse segmentation tasks. Existing methods often treat these task…
Document Layout AnalysisImage SegmentationSegmentationSemantic Segmentation+2SwinDocSegmenter: An End-to-End Unified Domain Adaptive Transformer for Document Instance Segmentation
Instance-level segmentation of documents consists in assigning a class-aware and instance-aware label to each pixel of the image. It is a key step in document parsing for their understanding. In this paper, we present a …
DecoderInstance SegmentationSegmentationSemantic SegmentationSRFormer: Text Detection Transformer with Incorporated Segmentation and Regression
Existing techniques for text detection can be broadly classified into two primary groups: segmentation-based and regression-based methods. Segmentation models offer enhanced robustness to font variations but require intr…
DecoderregressionScene Text DetectionSegmentation+1PUPS: Point Cloud Unified Panoptic Segmentation
Point cloud panoptic segmentation is a challenging task that seeks a holistic solution for both semantic and instance segmentation to predict groupings of coherent points. Previous approaches treat semantic and instance …
DecoderInstance SegmentationPanoptic SegmentationSegmentation+1