Beyond Forward Shortcuts: Fully Convolutional Master-Slave Networks (MSNets) with Backward Skip Connections for Semantic Segmentation
Recent deep CNNs contain forward shortcut connections; i.e. skip connections
from low to high layers. Reusing features from lower layers that have higher
resolution (location information) benefit higher layers to recover lost details
and mitigate information degradation. However, during inference the lower
layers do not know about high layer features, although they contain contextual
high semantics that benefit low layers to adaptively extract informative
features for later layers. In this paper, we study the influence of backward
skip connections which are in the opposite direction to forward shortcuts, i.e.
paths from high layers to low layers. To achieve this -- which indeed runs
counter to the nature of feed-forward networks -- we propose a new fully
convolutional model that consists of a pair of networks. A Slave' network is
dedicated to provide the backward connections from its top layers to the
Master' network's bottom layers. The Master network is used to produce the
final label predictions. In our experiments we validate the proposed FCN model
on ADE20K (ImageNet scene parsing), PASCAL-Context, and PASCAL VOC 2011
datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene ParsingSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence Learning
Previous cycle-consistency correspondence learning methods usually leverage image patches for training. In this paper, we present a fully convolutional method, which is simpler and more coherent to the inference process.…
Landmark TrackingPose TrackingSemantic SegmentationVideo Object Segmentation+1AutoCode: LLMs as Problem Setters for Competitive Programming
Writing competitive programming problems is exacting. Authors must: set constraints, input distributions, and edge cases that rule out shortcuts; target specific algorithms (e.g., max-flow, dynamic programming, data stru…
Probing In-Context Learning: Impact of Task Complexity and Model Architecture on Generalization and Efficiency
We investigate in-context learning (ICL) through a meticulous experimental framework that systematically varies task complexity and model architecture. Extending beyond the linear regression baseline, we introduce Gaussi…
Computational EfficiencyIn-Context LearningMambaregressionOptimizing Mastery Learning by Fast-Forwarding Over-Practice Steps
Mastery learning improves learning proficiency and efficiency. However, the overpractice of skills--students spending time on skills they have already mastered--remains a fundamental challenge for tutoring systems. Previ…
DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs
This paper revives Densely Connected Convolutional Networks (DenseNets) and reveals the underrated effectiveness over predominant ResNet-style architectures. We believe DenseNets' potential was overlooked due to untouche…
Fine-Grained Image ClassificationImage ClassificationInstance Segmentationobject-detection+2