paper-with-me

홈 › Papers

Semi-Supervised Noisy Student Pre-training on EfficientNet Architectures for Plant Pathology Classification

2020-12-01 · Sedrick Scott Keh

In recent years, deep learning has vastly improved the identification and diagnosis of various diseases in plants. In this report, we investigate the problem of pathology classification using images of a single leaf. We explore the use of standard benchmark models such as VGG16, ResNet101, and DenseNet 161 to achieve a 0.945 score on the task. Furthermore, we explore the use of the newer EfficientNet model, improving the accuracy to 0.962. Finally, we introduce the state-of-the-art idea of semi-supervised Noisy Student training to the EfficientNet, resulting in significant improvements in both accuracy and convergence rate. The final ensembled Noisy Student model performs very well on the task, achieving a test score of 0.982.

📄 PDF Abstract BibTeX arXiv:2012.00332

Code (0)

등록된 구현이 없습니다.

Tasks

General Classification

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Dense Block A Dense Block is a module used in convolutional neural networks that connects *all layers* (with matching feature-map sizes) directly with each other. It was originally…
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Self-training with Noisy Student improves ImageNet classification

2019-11-11 · CVPR 2020 6 · Qizhe Xie, Minh-Thang Luong, Eduard Hovy, Quoc V. Le

We present Noisy Student Training, a semi-supervised learning approach that works well even when labeled data is abundant. Noisy Student Training achieves 88.4% top-1 accuracy on ImageNet, which is 2.0% better than the s…

Data AugmentationGeneral ClassificationImage Classification

Self-training with noisy student model and semi-supervised loss function for dcase 2021 challenge task 4

2021-07-06 · Nam Kyun Kim, Hong Kook Kim

This report proposes a polyphonic sound event detection (SED) method for the DCASE 2021 Challenge Task 4. The proposed SED model consists of two stages: a mean-teacher model for providing target labels regarding weakly l…

Event DetectionSound Event Detection

Revisiting ResNets: Improved Training and Scaling Strategies

2021-03-13 · NeurIPS 2021 12 · Irwan Bello, William Fedus, Xianzhi Du, Ekin D. Cubuk 외

Novel computer vision architectures monopolize the spotlight, but the impact of the model architecture is often conflated with simultaneous changes to training methodology and scaling strategies. Our work revisits the ca…

Action ClassificationDocument Image ClassificationImage ClassificationSemantic Object Interaction Classification+1

Improving noisy student training for low-resource languages in End-to-End ASR using CycleGAN and inter-domain losses

2024-07-26 · Chia-Yu Li, Ngoc Thang Vu

Training a semi-supervised end-to-end speech recognition system using noisy student training has significantly improved performance. However, this approach requires a substantial amount of paired speech-text and unlabele…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition

Private Semi-supervised Knowledge Transfer for Deep Learning from Noisy Labels

2022-11-03 · Qiuchen Zhang, Jing Ma, Jian Lou, Li Xiong 외

Deep learning models trained on large-scale data have achieved encouraging performance in many real-world tasks. Meanwhile, publishing those models trained on sensitive datasets, such as medical records, could pose serio…

Transfer Learning