Spatial-Frequency Aware for Object Detection in RAW Image
Direct RAW-based object detection offers great promise by utilizing RAW data (unprocessed sensor data), but faces inherent challenges due to its wide dynamic range and linear response, which tends to suppress crucial object details. In particular, existing enhancement methods are almost all performed in the spatial domain, making it difficult to effectively recover these suppressed details from the skewed pixel distribution of RAW images. To address this limitation, we turn to the frequency domain, where features, such as object contours and textures, can be naturally separated based on frequency. In this paper, we propose Space-Frequency Aware RAW Image Object Detection Enhancer (SFAE), a novel framework that synergizes spatial and frequency representations. Our contribution is threefold. The first lies in the ``spatialization" of frequency bands. Different from the traditional paradigm of directly manipulating abstract spectra in deep networks, our method inversely transforms individual frequency bands back into tangible spatial maps, thus preserving direct physical intuition. Then the cross-domain fusion attention module is developed to enable deep multimodal interactions between these maps and the original spatial features. Finally, the framework performs adaptive nonlinear adjustments by predicting and applying different gamma parameters for the two domains.
Code (0)
등록된 구현이 없습니다.
Tasks
Physical IntuitionObject DetectionSimilar Papers 제목 키워드 기반
Fast Fourier Convolution Based Remote Sensor Image Object Detection for Earth Observation
Remote sensor image object detection is an important technology for Earth observation, and is used in various tasks such as forest fire monitoring and ocean monitoring. Image object detection technology, despite the sign…
Earth Observationimage-classificationImage ClassificationObject+3Exploring Boundary-Aware Spatial-Frequency Fusion for Camouflaged Object Detection
Camouflaged Object Detection is challenging due to the high degree of similarity between camouflaged objects and their surrounding backgrounds. Current COD methods mainly rely on edge extraction in the spatial domain and…
Boundary DetectionObject DetectionFreqPDE: Rethinking Positional Depth Embedding for Multi-View 3D Object Detection Transformers
Detecting 3D objects accurately from multi-view 2D images is a challenging yet essential task in the field of autonomous driving. Current methods resort to integrating depth prediction to recover the spatial information …
3D Object DetectionAutonomous DrivingFSDC-DETR: A Frequency-Spatial Domain Collaborative DETR for Small Object Detection
Small object detection (SOD) remains a challenging task in real-world applications. Despite recent advances, existing detectors remain limited by rigid processing that entangle spatial aggregation with implicit frequency…
Small Object DetectionDynamic Graph Learning With Content-Guided Spatial-Frequency Relation Reasoning for Deepfake Detection
With the springing up of face synthesis techniques, it is prominent in need to develop powerful face forgery detection methods due to security concerns. Some existing methods attempt to employ auxiliary frequency-awa…
DeepFake DetectionFace GenerationFace SwappingGraph Learning+1