paper-with-me

홈 › Papers

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction

2018-09-11 · NeurIPS 2018 12 · Liang-Chieh Chen, Maxwell D. Collins, Yukun Zhu, George Papandreou, Barret Zoph, Florian Schroff, Hartwig Adam, Jonathon Shlens

The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Much work has endeavored to design and build architectures automatically through clever construction of a search space paired with simple learning algorithms. Recent progress has demonstrated that such meta-learning methods may exceed scalable human-invented architectures on image classification tasks. An open question is the degree to which such methods may generalize to new domains. In this work we explore the construction of meta-learning techniques for dense image prediction focused on the tasks of scene parsing, person-part segmentation, and semantic image segmentation. Constructing viable search spaces in this domain is challenging because of the multi-scale representation of visual information and the necessity to operate on high resolution imagery. Based on a survey of techniques in dense image prediction, we construct a recursive search space and demonstrate that even with efficient random search, we can identify architectures that outperform human-invented architectures and achieve state-of-the-art performance on three dense prediction tasks including 82.7\% on Cityscapes (street scene parsing), 71.3\% on PASCAL-Person-Part (person-part segmentation), and 87.9\% on PASCAL VOC 2012 (semantic image segmentation). Additionally, the resulting architecture is more computationally efficient, requiring half the parameters and half the computational cost as previous state of the art systems.

📄 PDF Abstract BibTeX arXiv:1809.04184

Code (1)

tensorflow/models tf

Tasks

image-classificationImage ClassificationImage SegmentationMeta-LearningOpen-Ended Question AnsweringScene ParsingSegmentationSemantic SegmentationStreet Scene Parsing

Similar Papers 제목 키워드 기반

HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers

2021-06-11 · CVPR 2021 1 · Mingyu Ding, Xiaochen Lian, Linjie Yang, Peng Wang 외

High-resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search …

image-classificationImage ClassificationNeural Architecture SearchPose Estimation+2

Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery

2021-06-14 · Jingwei Song, Qiuchen Zhu, Jianyu Lin, Maani Ghaffari

This paper reports a CPU-level real-time stereo matching method for surgical images (10 Hz on 640 * 480 image with a single core of i5-9400). The proposed method is built on the fast ''dense inverse searching'' algorithm…

CPUStereo Matching

MixSearch: Searching for Domain Generalized Medical Image Segmentation Architectures

2021-02-26 · Luyan Liu, Zhiwei Wen, Songwei Liu, Hong-Yu Zhou 외

Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical imag…

DecoderImage SegmentationMedical Image AnalysisMedical Image Segmentation+2

Exploring Lottery Ticket Hypothesis in Spiking Neural Networks

2022-07-04 · Youngeun Kim, Yuhang Li, Hyoungseob Park, Yeshwanth Venkatesha 외

Spiking Neural Networks (SNNs) have recently emerged as a new generation of low-power deep neural networks, which is suitable to be implemented on low-power mobile/edge devices. As such devices have limited memory storag…

Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation

2019-01-10 · CVPR 2019 6 · Chenxi Liu, Liang-Chieh Chen, Florian Schroff, Hartwig Adam 외

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segm…

GPUimage-classificationImage ClassificationImage Segmentation+3