Uncovering bias in the PlantVillage dataset
We report our investigation on the use of the popular PlantVillage dataset for training deep learning based plant disease detection models. We trained a machine learning model using only 8 pixels from the PlantVillage image backgrounds. The model achieved 49.0% accuracy on the held-out test set, well above the random guessing accuracy of 2.6%. This result indicates that the PlantVillage dataset contains noise correlated with the labels and deep learning models can easily exploit this bias to make predictions. Possible approaches to alleviate this problem are discussed.
Code (1)
Tasks
Bias DetectionDeep LearningImage ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Uncovering Implicit Bias in Large Language Models with Concept Learning Dataset
We introduce a dataset of concept learning tasks that helps uncover implicit biases in large language models. Using in-context concept learning experiments, we found that language models may have a bias toward upward mon…
Uncovering Bias Mechanisms in Observational Studies
Observational studies are a key resource for causal inference but are often affected by systematic biases. Prior work has focused mainly on detecting these biases, via sensitivity analyses and comparisons with randomized…
Causal InferenceUncovering Gender Bias in Media Coverage of Politicians with Machine Learning
This paper presents research uncovering systematic gender bias in the representation of political leaders in the media, using artificial intelligence. Newspaper coverage of Irish ministers over a fifteen year period was …
BIG-bench Machine LearningExplainability of Deep Learning-Based Plant Disease Classifiers Through Automated Concept Identification
While deep learning has significantly advanced automatic plant disease detection through image-based classification, improving model explainability remains crucial for reliable disease detection. In this study, we apply …
ClassificationDeep LearningManagementUncovering the Background-Induced bias in RGB based 6-DoF Object Pose Estimation
In recent years, there has been a growing trend of using data-driven methods in industrial settings. These kinds of methods often process video images or parts, therefore the integrity of such images is crucial. Sometime…
6D Pose EstimationData AugmentationPose Estimation