paper-with-me

홈 › Papers

An Alternative Practice of Tropical Convolution to Traditional Convolutional Neural Networks

2021-03-03 · Shiqing Fan, Liu Liying, Ye Luo

Convolutional neural networks (CNNs) have been used in many machine learning fields. In practical applications, the computational cost of convolutional neural networks is often high with the deepening of the network and the growth of data volume, mostly due to a large amount of multiplication operations of floating-point numbers in convolution operations. To reduce the amount of multiplications, we propose a new type of CNNs called Tropical Convolutional Neural Networks (TCNNs) which are built on tropical convolutions in which the multiplications and additions in conventional convolutional layers are replaced by additions and min/max operations respectively. In addition, since tropical convolution operators are essentially nonlinear operators, we expect TCNNs to have higher nonlinear fitting ability than conventional CNNs. In the experiments, we test and analyze several different architectures of TCNNs for image classification tasks in comparison with similar-sized conventional CNNs. The results show that TCNN can achieve higher expressive power than ordinary convolutional layers on the MNIST and CIFAR10 image data set. In different noise environments, there are wins and losses in the robustness of TCNN and ordinary CNNs.

📄 PDF Abstract BibTeX arXiv:2103.02096

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Compound and Parallel Modes of Tropical Convolutional Neural Networks

2025-04-09 · Mingbo Li, Liying Liu, Charles Wiranto, Ye Luo arxiv

Convolutional neural networks (CNNs) are foundational to many state-of-the-art computer vision systems, yet their reliance on multiplication-intensive computations poses challenges for deployment on resource-constrained …

Improving extreme weather events detection with light-weight neural networks

2023-03-31 · Romain Lacombe, Hannah Grossman, Lucas Hendren, David Lüdeke

To advance automated detection of extreme weather events, which are increasing in frequency and intensity with climate change, we explore modifications to a novel light-weight Context Guided convolutional neural network …

Data AugmentationFeature EngineeringSemantic Segmentation

Tropical Decision Boundaries for Neural Networks Are Robust Against Adversarial Attacks

2024-02-01 · Kurt Pasque, Christopher Teska, Ruriko Yoshida, Keiji Miura 외

We introduce a simple, easy to implement, and computationally efficient tropical convolutional neural network architecture that is robust against adversarial attacks. We exploit the tropical nature of piece-wise linear n…

Tropical Bisectors and Carlini-Wagner Attacks

2025-03-28 · Gillian Grindstaff, Julia Lindberg, Daniela Schkoda, Miruna-Stefana Sorea 외

Pasque et al. showed that using a tropical symmetric metric as an activation function in the last layer can improve the robustness of convolutional neural networks (CNNs) against state-of-the-art attacks, including the C…

Semiring Activation in Neural Networks

2024-05-29 · Bart M. N. Smets, Peter D. Donker, Jim W. Portegies

We introduce a class of trainable nonlinear operators based on semirings that are suitable for use in neural networks. These operators generalize the traditional alternation of linear operators with activation functions …