paper-with-me

Papers

Improved efficient capsule network for Kuzushiji-MNIST benchmark dataset classification

2023-12-15 · Bulletin of the Polish Academy of Sciences Technical Sciences 2023 12 · Michał Bukowski, Izabella Antoniuk, Jarosław Kurek

In this paper, we present an improved efficient capsule network (CN) model for the classification of the Kuzushiji-MNIST and Kuzushiji-49 benchmark datasets. CNs are a promising approach in the field of deep learning, offering advantages such as robustness, better generalization, and a simpler network structure compared to traditional convolutional neural networks (CNNs). Proposed model, based on the Efficient CapsNet architecture, incorporates the self-attention routing mechanism, resulting in improved efficiency and reduced parameter count. The experiments conducted on the Kuzushiji-MNIST and Kuzushiji-49 datasets demonstrate that the model achieves competitive performance, ranking within the top ten solutions for both benchmarks. Despite using significantly fewer parameters compared to higher-rated competitors, presented model achieves comparable accuracy, with overall differences of only 0.91% and 1.97% for the Kuzushiji-MNIST and Kuzushiji- 49 datasets, respectively. Furthermore, the training time required to achieve these results is substantially reduced, enabling training on non- specialized workstations. The proposed novelties of capsule architecture, including the integration of the self-attention mechanism and the efficient network structure, contribute to the improved efficiency and performance of presented model. These findings highlight the potential of CNs as a more efficient and effective approach for character classification tasks, with broader applications in various domains.

📄 PDF Abstract BibTeX

Code (1)

bukson/kmnist-efcaps tf

Tasks

Image Classification

Methods 이 논문이 사용한 방법론

CapsNet Capsule Network is a machine learning system that is a type of artificial neural network that can be used to better model hierarchical relationships. The approach is an…
Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

Deep Learning for Classical Japanese Literature

2018-12-03 · Tarin Clanuwat, Mikel Bober-Irizar, Asanobu Kitamoto, Alex Lamb 외

Much of machine learning research focuses on producing models which perform well on benchmark tasks, in turn improving our understanding of the challenges associated with those tasks. From the perspective of ML researche…

BIG-bench Machine LearningDeep LearningImage Classification

DKDS: A Benchmark Dataset of Degraded Kuzushiji Documents with Seals for Detection and Binarization

2025-11-12 · Rui-Yang Ju, Kohei Yamashita, Hirotaka Kameko, Shinsuke Mori arxiv

Kuzushiji, a pre-modern Japanese cursive script, can currently be read and understood by only a few thousand trained experts in Japan. With the rapid development of deep learning, researchers have begun applying Optical …

A quantifiable testing of global translational invariance in Convolutional and Capsule Networks

2019-05-01 · ICLR 2019 5 · Weikai Qi

We design simple and quantifiable testing of global translation-invariance in deep learning models trained on the MNIST dataset. Experiments on convolutional and capsules neural networks show that both models have poor …

Data AugmentationTranslation

Sparse Unsupervised Capsules Generalize Better

2018-04-17 · David Rawlinson, Abdelrahman Ahmed, Gideon Kowadlo

We show that unsupervised training of latent capsule layers using only the reconstruction loss, without masking to select the correct output class, causes a loss of equivariances and other desirable capsule qualities. Th…

General Classification

Capsule Networks with Max-Min Normalization

2019-03-22 · Zhen Zhao, Ashley Kleinhans, Gursharan Sandhu, Ishan Patel 외

Capsule Networks (CapsNet) use the Softmax function to convert the logits of the routing coefficients into a set of normalized values that signify the assignment probabilities between capsules in adjacent layers. We show…