paper-with-me

홈 › Papers

Deep Residual Compensation Convolutional Network without Backpropagation

2023-01-27 · Mubarakah Alotaibi, Richard Wilson

PCANet and its variants provided good accuracy results for classification tasks. However, despite the importance of network depth in achieving good classification accuracy, these networks were trained with a maximum of nine layers. In this paper, we introduce a residual compensation convolutional network, which is the first PCANet-like network trained with hundreds of layers while improving classification accuracy. The design of the proposed network consists of several convolutional layers, each followed by post-processing steps and a classifier. To correct the classification errors and significantly increase the network's depth, we train each layer with new labels derived from the residual information of all its preceding layers. This learning mechanism is accomplished by traversing the network's layers in a single forward pass without backpropagation or gradient computations. Our experiments on four distinct classification benchmarks (MNIST, CIFAR-10, CIFAR-100, and TinyImageNet) show that our deep network outperforms all existing PCANet-like networks and is competitive with several traditional gradient-based models.

📄 PDF Abstract BibTeX arXiv:2301.11663

Code (0)

등록된 구현이 없습니다.

Tasks

Classification

Similar Papers 제목 키워드 기반

Scalable Forward-Forward Algorithm

2025-01-06 · Andrii Krutsylo

We propose a scalable Forward-Forward (FF) algorithm that eliminates the need for backpropagation by training each layer separately. Unlike backpropagation, FF avoids backward gradients and can be more modular and memory…

Transfer Learning

Invertible Residual Network with Regularization for Effective Medical Image Segmentation

2021-03-16 · Kashu Yamazaki, Vidhiwar Singh Rathour, T. Hoang Ngan Le

Deep Convolutional Neural Networks (CNNs) i.e. Residual Networks (ResNets) have been used successfully for many computer vision tasks, but are difficult to scale to 3D volumetric medical data. Memory is increasingly ofte…

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Prediction

2022-06-15 · CVPR 2022 1 · Zhihao Hu, Guo Lu, Jinyang Guo, Shan Liu 외

The previous deep video compression approaches only use the single scale motion compensation strategy and rarely adopt the mode prediction technique from the traditional standards like H.264/H.265 for both motion and res…

Motion CompensationMotion EstimationPredictionVideo Compression

Pipelined Backpropagation at Scale: Training Large Models without Batches

2020-03-25 · Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness 외

New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to explore the hardware and machine learning pr…

Image ClassificationStochastic Optimization

Spatial-Temporal Transformer based Video Compression Framework

2023-09-21 · Yanbo Gao, Wenjia Huang, Shuai Li, Hui Yuan 외

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which…

Motion EstimationPredictionVideo Compression