Empirical Study of Multi-Task Hourglass Model for Semantic Segmentation Task
The semantic segmentation (SS) task aims to create a dense classification by labeling at the pixel level each object present on images. Convolutional neural network (CNN) approaches have been widely used, and exhibited the best results in this task. However, the loss of spatial precision on the results is a main drawback that has not been solved. In this work, we propose to use a multi-task approach by complementing the semantic segmentation task with edge detection, semantic contour, and distance transform tasks. We propose that by sharing a common latent space, the complementary tasks can produce more robust representations that can enhance the semantic labels. We explore the influence of contour-based tasks on latent space, as well as their impact on the final results of SS. We demonstrate the effectiveness of learning in a multi-task setting for hourglass models in the Cityscapes, CamVid, and Freiburg Forest datasets by improving the state-of-the-art without any refinement post-processing.
Code (1)
Tasks
Edge DetectionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Contextual Hourglass Network for Semantic Segmentation of High Resolution Aerial Imagery
Semantic segmentation for aerial imagery is a challenging and important problem in remotely sensed imagery analysis. In recent years, with the success of deep learning, various convolutional neural network (CNN) based mo…
DecoderSegmentationSemantic SegmentationVocal Bursts Intensity PredictionRevisiting the Shape Convention of Transformer Language Models
The architectural shape of dense Transformers has remained remarkably stable: narrow-wide-narrow feed-forward networks (FFNs) consume most non-embedding parameters. Motivated by theoretical and empirical evidences that r…
Contraction and Hourglass Persistence for Learning on Graphs, Simplices, and Cells
Persistent homology (PH) encodes global information, such as cycles, and is thus increasingly integrated into graph neural networks (GNNs). PH methods in GNNs typically traverse an increasing sequence of subgraphs. In th…
Graph Representation LearningMulti-Scale Stacked Hourglass Network for Human Pose Estimation
Stacked hourglass network has become an important model for Human pose estimation. The estimation of human body posture depends on the global information of the keypoints type and the local information of the keypoints l…
Pose EstimationLabeling Panoramas with Spherical Hourglass Networks
With the recent proliferation of consumer-grade 360{\deg} cameras, it is worth revisiting visual perception challenges with spherical cameras given the potential benefit of their global field of view. To this end we intr…
Semantic Segmentation