Deep Hierarchical Parsing for Semantic Segmentation
This paper proposes a learning-based approach to scene parsing inspired by the deep Recursive Context Propagation Network (RCPN). RCPN is a deep feed-forward neural network that utilizes the contextual information from the entire image, through bottom-up followed by top-down context propagation via random binary parse trees. This improves the feature representation of every super-pixel in the image for better classification into semantic categories. We analyze RCPN and propose two novel contributions to further improve the model. We first analyze the learning of RCPN parameters and discover the presence of bypass error paths in the computation graph of RCPN that can hinder contextual propagation. We propose to tackle this problem by including the classification loss of the internal nodes of the random parse trees in the original RCPN loss function. Secondly, we use an MRF on the parse tree nodes to model the hierarchical dependency present in the output. Both modifications provide performance boosts over the original RCPN and the new system achieves state-of-the-art performance on Stanford Background, SIFT-Flow and Daimler urban datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationScene ParsingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Progressive refinement: a method of coarse-to-fine image parsing using stacked network
To parse images into fine-grained semantic parts, the complex fine-grained elements will put it in trouble when using off-the-shelf semantic segmentation networks. In this paper, for image parsing task, we propose to par…
Face ParsingHuman ParsingSegmentationSemantic SegmentationLearning Semantic Neural Tree for Human Parsing
The majority of existing human parsing methods formulate the task as semantic segmentation, which regard each semantic category equally and fail to exploit the intrinsic physiological structure of human body, resulting i…
Human ParsingSemantic SegmentationSemi-Supervised Hierarchical Semantic Object Parsing
Models based on Convolutional Neural Networks (CNNs) have been proven very successful for semantic segmentation and object parsing that yield hierarchies of features. Our key insight is to build convolutional networks th…
Instance SegmentationObjectSegmentationSemantic SegmentationSemantic Parsing for Task Oriented Dialog using Hierarchical Representations
Task oriented dialog systems typically first parse user utterances to semantic frames comprised of intents and slots. Previous work on task oriented intent and slot-filling work has been restricted to one intent per quer…
Constituency ParsingSemantic Parsingslot-fillingSlot FillingProgressively Dual Prior Guided Few-shot Semantic Segmentation
Few-shot semantic segmentation task aims at performing segmentation in query images with a few annotated support samples. Currently, few-shot segmentation methods mainly focus on leveraging foreground information without…
Few-Shot Semantic SegmentationSegmentationSemantic Segmentation