PixelNet: Towards a General Pixel-level Architecture
We explore architectures for general pixel-level prediction problems, from low-level edge detection to mid-level surface normal estimation to high-level semantic segmentation. Convolutional predictors, such as the fully-convolutional network (FCN), have achieved remarkable success by exploiting the spatial redundancy of neighboring pixels through convolutional processing. Though computationally efficient, we point out that such approaches are not statistically efficient during learning precisely because spatial redundancy limits the information learned from neighboring pixels. We demonstrate that (1) stratified sampling allows us to add diversity during batch updates and (2) sampled multi-scale features allow us to explore more nonlinear predictors (multiple fully-connected layers followed by ReLU) that improve overall accuracy. Finally, our objective is to show how a architecture can get performance better than (or comparable to) the architectures designed for a particular task. Interestingly, our single architecture produces state-of-the-art results for semantic segmentation on PASCAL-Context, surface normal estimation on NYUDv2 dataset, and edge detection on BSDS without contextual post-processing.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityEdge DetectionSemantic SegmentationSurface Normal EstimationSimilar Papers 제목 키워드 기반
Class Balanced PixelNet for Neurological Image Segmentation
In this paper, we propose an automatic brain tumor segmentation approach (e.g., PixelNet) using a pixel-level convolutional neural network (CNN). The model extracts feature from multiple convolutional layers and concaten…
Brain Tumor SegmentationImage SegmentationIschemic Stroke Lesion SegmentationLesion Segmentation+3PixelNet: Representation of the pixels, by the pixels, and for the pixels
We explore design principles for general pixel-level prediction problems, from low-level edge detection to mid-level surface normal estimation to high-level semantic segmentation. Convolutional predictors, such as the fu…
DiversityEdge DetectionSegmentationSemantic Segmentation+1Dense RGB-D semantic mapping with Pixel-Voxel neural network
For intelligent robotics applications, extending 3D mapping to 3D semantic mapping enables robots to, not only localize themselves with respect to the scene's geometrical features but also simultaneously understand the h…
3D ReconstructionGPUScene UnderstandingSemantic SegmentationAn Image Dataset for Benchmarking Recommender Systems with Raw Pixels
Recommender systems (RS) have achieved significant success by leveraging explicit identification (ID) features. However, the full potential of content features, especially the pure image pixel features, remains relativel…
BenchmarkingRecommendation SystemsAttention Attention Everywhere: Monocular Depth Prediction with Skip Attention
Monocular Depth Estimation (MDE) aims to predict pixel-wise depth given a single RGB image. For both, the convolutional as well as the recent attention-based models, encoder-decoder-based architectures have been found to…
DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1