paper-with-me

Papers

Deep Learning for Oral Health: Benchmarking ViT, DeiT, BEiT, ConvNeXt, and Swin Transformer

2025-09-27 · Ajo Babu George, Sadhvik Bathini, Niranjana S R arxiv

Objective: The aim of this study was to systematically evaluate and compare the performance of five state-of-the-art transformer-based architectures - Vision Transformer (ViT), Data-efficient Image Transformer (DeiT), ConvNeXt, Swin Transformer, and Bidirectional Encoder Representation from Image Transformers (BEiT) - for multi-class dental disease classification. The study specifically focused on addressing real-world challenges such as data imbalance, which is often overlooked in existing literature. Study Design: The Oral Diseases dataset was used to train and validate the selected models. Performance metrics, including validation accuracy, precision, recall, and F1-score, were measured, with special emphasis on how well each architecture managed imbalanced classes. Results: ConvNeXt achieved the highest validation accuracy at 81.06, followed by BEiT at 80.00 and Swin Transformer at 79.73, all demonstrating strong F1-scores. ViT and DeiT achieved accuracies of 79.37 and 78.79, respectively, but both struggled particularly with Caries-related classes. Conclusions: ConvNeXt, Swin Transformer, and BEiT showed reliable diagnostic performance, making them promising candidates for clinical application in dental imaging. These findings provide guidance for model selection in future AI-driven oral disease diagnostic tools and highlight the importance of addressing data imbalance in real-world scenarios

📄 PDF Abstract BibTeX arXiv:2509.23100

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification

2025-11-24 · Kazi Reyazul Hasan, Md Nafiu Rahman, Wasif Jalal, Sadif Ahmed 외 arxiv

Hybrid vision architectures combining Transformers and CNNs have significantly advanced image classification, but they usually do so at significant computational cost. We introduce EVCC (Enhanced Vision Transformer-ConvN…

Image ClassificationMulti-Task Learning

8-Calves Image dataset

2025-03-17 · Xuyang Fang, Sion Hannuna, Neill Campbell

We introduce the 8-Calves dataset, a benchmark for evaluating object detection and identity classification in occlusion-rich, temporally consistent environments. The dataset comprises a 1-hour video (67,760 frames) of ei…

object-detectionObject DetectionOcclusion Handling

BEiT: BERT Pre-Training of Image Transformers

2021-06-15 · ICLR 2022 4 · Hangbo Bao, Li Dong, Songhao Piao, Furu Wei

We introduce a self-supervised vision representation model BEiT, which stands for Bidirectional Encoder representation from Image Transformers. Following BERT developed in the natural language processing area, we propose…

Document Image ClassificationDocument Layout Analysisimage-classificationImage Classification+2

CAE-Net: Generalized Deepfake Image Detection using Convolution and Attention Mechanisms with Spatial and Frequency Domain Features

2025-02-15 · Kafi Anan, Anindya Bhattacharjee, Ashir Intesher, Kaidul Islam 외

Effective deepfake detection tools are becoming increasingly essential to the growing usage of deepfakes in unethical practices. There exists a wide range of deepfake generation techniques, which makes it challenging to …

DeepFake DetectionFace Swapping

Domain Generalisation with Bidirectional Encoder Representations from Vision Transformers

2023-07-16 · Hamza Riaz, Alan F. Smeaton

Domain generalisation involves pooling knowledge from source domain(s) into a single model that can generalise to unseen target domain(s). Recent research in domain generalisation has faced challenges when using deep lea…