paper-with-me

홈 › Papers

Enhancing ResNet Image Classification Performance by using Parameterized Hypercomplex Multiplication

2023-01-11 · Nazmul Shahadat, Anthony S. Maida

Recently, many deep networks have introduced hypercomplex and related calculations into their architectures. In regard to convolutional networks for classification, these enhancements have been applied to the convolution operations in the frontend to enhance accuracy and/or reduce the parameter requirements while maintaining accuracy. Although these enhancements have been applied to the convolutional frontend, it has not been studied whether adding hypercomplex calculations improves performance when applied to the densely connected backend. This paper studies ResNet architectures and incorporates parameterized hypercomplex multiplication (PHM) into the backend of residual, quaternion, and vectormap convolutional neural networks to assess the effect. We show that PHM does improve classification accuracy performance on several image datasets, including small, low-resolution CIFAR 10/100 and large high-resolution ImageNet and ASL, and can achieve state-of-the-art accuracy for hypercomplex networks.

📄 PDF Abstract BibTeX arXiv:2301.04623

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classification

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Residual Connection 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Kaiming Initialization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Parameter-Free Channel Attention for Image Classification and Super-Resolution

2023-03-20 · Yuxuan Shi, Lingxiao Yang, Wangpeng An, XianTong Zhen 외

The channel attention mechanism is a useful technique widely employed in deep convolutional neural networks to boost the performance for image processing tasks, eg, image classification and image super-resolution. It is …

Classificationimage-classificationImage ClassificationImage Super-Resolution+1

Nonparametric Classification on Low Dimensional Manifolds using Overparameterized Convolutional Residual Networks

2023-07-04 · Zixuan Zhang, Kaiqi Zhang, Minshuo Chen, Yuma Takeda 외

Convolutional residual neural networks (ConvResNets), though overparameterized, can achieve remarkable prediction performance in practice, which cannot be well explained by conventional wisdom. To bridge this gap, we stu…

Enhancing Histopathological Image Classification via Integrated HOG and Deep Features with Robust Noise Performance

2026-01-03 · Ifeanyi Ezuma, Ugochukwu Ugwu arxiv

The era of digital pathology has advanced histopathological examinations, making automated image analysis essential in clinical practice. This study evaluates the classification performance of machine learning and deep l…

Image Classification

Benefits of Overparameterized Convolutional Residual Networks: Function Approximation under Smoothness Constraint

2022-06-09 · Hao liu, Minshuo Chen, Siawpeng Er, Wenjing Liao 외

Overparameterized neural networks enjoy great representation power on complex data, and more importantly yield sufficiently smooth output, which is crucial to their generalization and robustness. Most existing function a…

image-classificationImage Classification

How Does Overparameterization Affect Features?

2024-07-01 · Ahmet Cagri Duzgun, Samy Jelassi, Yuanzhi Li

Overparameterization, the condition where models have more parameters than necessary to fit their training loss, is a crucial factor for the success of deep learning. However, the characteristics of the features learned …