RDSNet: A New Deep Architecture for Reciprocal Object Detection and Instance Segmentation
Object detection and instance segmentation are two fundamental computer vision tasks. They are closely correlated but their relations have not yet been fully explored in most previous work. This paper presents RDSNet, a novel deep architecture for reciprocal object detection and instance segmentation. To reciprocate these two tasks, we design a two-stream structure to learn features on both the object level (i.e., bounding boxes) and the pixel level (i.e., instance masks) jointly. Within this structure, information from the two streams is fused alternately, namely information on the object level introduces the awareness of instance and translation variance to the pixel level, and information on the pixel level refines the localization accuracy of objects on the object level in return. Specifically, a correlation module and a cropping module are proposed to yield instance masks, as well as a mask based boundary refinement module for more accurate bounding boxes. Extensive experimental analyses and comparisons on the COCO dataset demonstrate the effectiveness and efficiency of RDSNet. The source code is available at https://github.com/wangsr126/RDSNet.
Code (1)
Tasks
Instance SegmentationObjectobject-detectionObject DetectionSegmentationSemantic SegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SCNet: Training Inference Sample Consistency for Instance Segmentation
Cascaded architectures have brought significant performance improvement in object detection and instance segmentation. However, there are lingering issues regarding the disparity in the Intersection-over-Union (IoU) dist…
Instance Segmentationobject-detectionObject DetectionSemantic SegmentationHybrid Task Cascade for Instance Segmentation
Cascade is a classic yet powerful architecture that has boosted performance on various tasks. However, how to introduce cascade to instance segmentation remains an open question. A simple combination of Cascade R-CNN and…
Instance Segmentationobject-detectionObject DetectionOpen-Ended Question Answering+2The Devil is in the Task: Exploiting Reciprocal Appearance-Localization Features for Monocular 3D Object Detection
Low-cost monocular 3D object detection plays a fundamental role in autonomous driving, whereas its accuracy is still far from satisfactory. In this paper, we dig into the 3D object detection task and reformulate it as th…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+4Optimal Control of Mechanical Ventilators with Learned Respiratory Dynamics
Deciding on appropriate mechanical ventilator management strategies significantly impacts the health outcomes for patients with respiratory diseases. Acute Respiratory Distress Syndrome (ARDS) is one such disease that re…
Decision MakingManagementSequential Decision MakingReciprocal Attention Fusion for Visual Question Answering
Existing attention mechanisms either attend to local image grid or object level features for Visual Question Answering (VQA). Motivated by the observation that questions can relate to both object instances and their part…
ObjectQuestion AnsweringTensor DecompositionVisual Question Answering+1