Improving Classification of Occluded Objects through Scene Context
The presence of occlusions has provided substantial challenges to typically-powerful object recognition algorithms. Additional sources of information can be extremely valuable to reduce errors caused by occlusions. Scene context is known to aid in object recognition in biological vision. In this work, we attempt to add robustness into existing Region Proposal Network-Deep Convolutional Neural Network (RPN-DCNN) object detection networks through two distinct scene-based information fusion techniques. We present one algorithm under each methodology: the first operates prior to prediction, selecting a custom object network to use based on the identified background scene, and the second operates after detection, fusing scene knowledge into initial object scores output by the RPN. We demonstrate our algorithms on challenging datasets featuring partial occlusions, which show overall improvement in both recall and precision against baseline methods. In addition, our experiments contrast multiple training methodologies for occlusion handling, finding that training on a combination of both occluded and unoccluded images demonstrates an improvement over the others. Our method is interpretable and can easily be adapted to other datasets, offering many future directions for research and practical applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Object RecognitionObject DetectionSimilar Papers 제목 키워드 기반
SeeThrough: Finding Chairs in Heavily Occluded Indoor Scene Images
Discovering 3D arrangements of objects from single indoor images is important given its many applications including interior design, content creation, etc. Although heavily researched in the recent years, existing approa…
object-detectionObject DetectionVisiting the Invisible: Layer-by-Layer Completed Scene Decomposition
Existing scene understanding systems mainly focus on recognizing the visible parts of a scene, ignoring the intact appearance of physical objects in the real-world. Concurrently, image completion has aimed to create plau…
Instance SegmentationScene UnderstandingSemantic SegmentationInner-Scene Similarities as a Contextual Cue for Object Detection
Using image context is an effective approach for improving object detection. Previously proposed methods used contextual cues that rely on semantic or spatial information. In this work, we explore a different kind of con…
object-detectionObject DetectionLearning to Generate Multiple Objects from Dense and Occluded Layouts
Text-to-image diffusion models fail to generate correct object counts in dense scenes, where overlapping instances collapse into indistinguishable structures despite appearing visually plausible. We identify this as inst…
Topologically Persistent Features-based Object Recognition in Cluttered Indoor Environments
Recognition of occluded objects in unseen indoor environments is a challenging problem for mobile robots. This work proposes a new slicing-based topological descriptor that captures the 3D shape of object point clouds to…
Object RecognitionPoint Cloud ClassificationUnity