paper-with-me

Papers

Towards Evolutional Compression

2017-07-25 · Yunhe Wang, Chang Xu, Jiayan Qiu, Chao Xu, DaCheng Tao

Compressing convolutional neural networks (CNNs) is essential for transferring the success of CNNs to a wide variety of applications to mobile devices. In contrast to directly recognizing subtle weights or filters as redundant in a given CNN, this paper presents an evolutionary method to automatically eliminate redundant convolution filters. We represent each compressed network as a binary individual of specific fitness. Then, the population is upgraded at each evolutionary iteration using genetic operations. As a result, an extremely compact CNN is generated using the fittest individual. In this approach, either large or small convolution filters can be redundant, and filters in the compressed network are more distinct. In addition, since the number of filters in each convolutional layer is reduced, the number of filter channels and the size of feature maps are also decreased, naturally improving both the compression and speed-up ratios. Experiments on benchmark deep CNN models suggest the superiority of the proposed algorithm over the state-of-the-art compression methods.

📄 PDF Abstract BibTeX arXiv:1707.08005

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Complex Evolutional Pattern Learning for Temporal Knowledge Graph Reasoning

2022-03-15 · ACL 2022 5 · Zixuan Li, Saiping Guan, Xiaolong Jin, Weihua Peng 외

A Temporal Knowledge Graph (TKG) is a sequence of KGs corresponding to different timestamps. TKG reasoning aims to predict potential facts in the future given the historical KG sequences. One key of this task is to mine …

Diversity

Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs

2024-12-28 · Yuwei Du, Xinyue Liu, Wenxin Liang, Linlin Zong 외

Temporal knowledge graph (TKG) reasoning has become a hot topic due to its great value in many practical tasks. The key to TKG reasoning is modeling the structural information and evolutional patterns of the TKGs. While …

Knowledge GraphsRepresentation Learning

Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning

2021-04-21 · Zixuan Li, Xiaolong Jin, Wei Li, Saiping Guan 외

Knowledge Graph (KG) reasoning that predicts missing facts for incomplete KGs has been widely explored. However, reasoning over Temporal KG (TKG) that predicts facts in the future is still far from resolved. The key to p…

Representation Learning

Multi evolutional deep neural networks (Multi-EDNN)

2024-07-17 · Hadden Kim, Tamer A. Zaki

Evolutional deep neural networks (EDNN) solve partial differential equations (PDEs) by marching the network representation of the solution fields, using the governing equations. Use of a single network to solve coupled P…

EVAN: Evolutional Video Streaming Adaptation via Neural Representation

2024-04-15 · Mufan Liu, Le Yang, Yiling Xu, Ye-kui Wang 외

Adaptive bitrate (ABR) using conventional codecs cannot further modify the bitrate once a decision has been made, exhibiting limited adaptation capability. This may result in either overly conservative or overly aggressi…

Video Reconstruction