Scale-Adaptive Convolutions for Scene Parsing
Many existing scene parsing methods adopt Convolutional Neural Networks with fixed-size receptive fields, which frequently result in inconsistent predictions of large objects and invisibility of small objects. To tackle this issue, we propose a scale-adaptive convolution to acquire flexible-size receptive fields during scene parsing. Through adding a new scale regression layer, we can dynamically infer the position-adaptive scale coefficients which are adopted to resize the convolutional patches. Consequently, the receptive fields can be adjusted automatically according to the various sizes of the objects in scene images. Thus, the problems of invisible small objects and inconsistent large-object predictions can be alleviated. Furthermore, our proposed scale-adaptive convolutions are not only differentiable to learn the convolutional parameters and scale coefficients in an end-to-end way, but also of high parallelizability for the convenience of GPU implementation. Additionally, since the new scale regression layers are learned implicitly, any extra training supervision of object sizes is unnecessary. Extensive experiments on Cityscapes and ADE20K datasets well demonstrate the effectiveness of the proposed scale-adaptive convolutions.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUregressionScene ParsingSimilar Papers 제목 키워드 기반
CaseNet: Content-Adaptive Scale Interaction Networks for Scene Parsing
Objects at different spatial positions in an image exhibit different scales. Adaptive receptive fields are expected to capture suitable ranges of context for accurate pixel level semantic prediction. Recently, atrous con…
PositionScene ParsingMoE-SPNet: A Mixture-of-Experts Scene Parsing Network
Scene parsing is an indispensable component in understanding the semantics within a scene. Traditional methods rely on handcrafted local features and probabilistic graphical models to incorporate local and global cues. R…
Mixture-of-ExpertsScene ParsingTBN-ViT: Temporal Bilateral Network with Vision Transformer for Video Scene Parsing
Video scene parsing in the wild with diverse scenarios is a challenging and great significance task, especially with the rapid development of automatic driving technique. The dataset Video Scene Parsing in the Wild(VSPW)…
Scene ParsingFoveaNet: Perspective-aware Urban Scene Parsing
Parsing urban scene images benefits many applications, especially self-driving. Most of the current solutions employ generic image parsing models that treat all scales and locations in the images equally and do not consi…
Scene ParsingLearning Dynamic Hierarchical Models for Anytime Scene Labeling
With increasing demand for efficient image and video analysis, test-time cost of scene parsing becomes critical for many large-scale or time-sensitive vision applications. We propose a dynamic hierarchical model for anyt…
Model SelectionRepresentation LearningScene LabelingScene Parsing+1