paper-with-me

Papers

Efficient Re-parameterization Operations Search for Easy-to-Deploy Network Based on Directional Evolutionary Strategy

2022-04-13 · Xinyi Yu, Xiaowei Wang, Jintao Rong, Mingyang Zhang, Linlin Ou

Structural re-parameterization (Rep) methods has achieved significant performance improvement on traditional convolutional network. Most current Rep methods rely on prior knowledge to select the reparameterization operations. However, the performance of architecture is limited by the type of operations and prior knowledge. To break this restriction, in this work, an improved re-parameterization search space is designed, which including more type of re-parameterization operations. Concretely, the performance of convolutional networks can be further improved by the search space. To effectively explore this search space, an automatic re-parameterization enhancement strategy is designed based on neural architecture search (NAS), which can search a excellent re-parameterization architecture. Besides, we visualize the output features of the architecture to analyze the reasons for the formation of the re-parameterization architecture. On public datasets, we achieve better results. Under the same training conditions as ResNet, we improve the accuracy of ResNet-50 by 1.82% on ImageNet-1k.

📄 PDF Abstract BibTeX arXiv:2204.06403

Code (0)

등록된 구현이 없습니다.

Tasks

Neural Architecture Search

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Average Pooling 설명 없음
Batch Normalization 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Kaiming Initialization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Discrete Army Ant Search Optimizer-Based Target Coverage Enhancement in Directional Sensor Networks

2023-07-03 · Yindi Yao, Qin Wen, Yanpeng Cui, Bozhan Zhao

Coverage of interest points is one of the most critical issues in directional sensor networks. However, considering the remote or inhospitable environment and the limitation of the perspective of directional sensors, it …

Rethinking Directional Parameterization in Neural Implicit Surface Reconstruction

2024-09-11 · Zijie Jiang, Tianhan Xu, Hiroharu Kato

Multi-view 3D surface reconstruction using neural implicit representations has made notable progress by modeling the geometry and view-dependent radiance fields within a unified framework. However, their effectiveness in…

Surface Reconstruction

EasyRAG: Efficient Retrieval-Augmented Generation Framework for Automated Network Operations

2024-10-14 · Zhangchi Feng, Dongdong Kuang, Zhongyuan Wang, Zhijie Nie 외

This paper presents EasyRAG, a simple, lightweight, and efficient retrieval-augmented generation framework for automated network operations. Our framework has three advantages. The first is accurate question answering. W…

Answer GenerationQuestion AnsweringRAGReranking+2

Scalable Unidirectional Pareto Optimality for Multi-Task Learning with Constraints

2021-10-28 · Soumyajit Gupta, Gurpreet Singh, Raghu Bollapragada, Matthew Lease

Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we …

image-classificationImage ClassificationMulti-Task Learning

RepAn: Enhanced Annealing through Re-parameterization

2024-01-01 · CVPR 2024 1 · Xiang Fei, Xiawu Zheng, Yan Wang, Fei Chao 외

The simulated annealing algorithm aims to improve model convergence through multiple restarts of training. However existing annealing algorithms overlook the correlation between different cycles neglecting the potent…

Incremental Learning