Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images
Distribution shifts are characterized by differences between the training and test data distributions. They can significantly reduce the accuracy of machine learning models deployed in real-world scenarios. This paper explores the distribution shift problem when classifying pollen grains from microscopic images collected in the wild with a low-cost camera sensor. We leverage the domain knowledge that geometric features are highly important for accurate pollen identification and introduce two novel geometric image augmentation techniques to significantly narrow the accuracy gap between the model performance on the train and test datasets. In particular, we show that Tenengrad and ImageToSketch filters are highly effective to balance the shape and texture information while leaving out unimportant details that may confuse the model. Extensive evaluations on various model architectures demonstrate a consistent improvement of the model generalization to field data of up to 14% achieved by the geometric augmentation techniques when compared to a wide range of standard image augmentations. The approach is validated through an ablation study using pollen hydration tests to recover the shape of dry pollen grains. The proposed geometric augmentations also receive the highest scores according to the affinity and diversity measures from the literature.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityImage AugmentationSimilar Papers 제목 키워드 기반
Exploring the Design of Adaptation Protocols for Improved Generalization and Machine Learning Safety
While directly fine-tuning (FT) large-scale, pretrained models on task-specific data is well-known to induce strong in-distribution task performance, recent works have demonstrated that different adaptation protocols, su…
Anomaly DetectionBIG-bench Machine LearningData AugmentationOut-of-Distribution GeneralizationConnect Later: Improving Fine-tuning for Robustness with Targeted Augmentations
Models trained on a labeled source domain (e.g., labeled images from wildlife camera traps) often generalize poorly when deployed on an out-of-distribution (OOD) target domain (e.g., images from new camera trap locations…
Contrastive LearningDomain AdaptationTime SeriesTime Series ClassificationThe Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
We introduce four new real-world distribution shift datasets consisting of changes in image style, image blurriness, geographic location, camera operation, and more. With our new datasets, we take stock of previously pro…
Data AugmentationDomain GeneralizationOut-of-Distribution GeneralizationA Flat Minima Perspective on Understanding Augmentations and Model Robustness
Model robustness indicates a model's capability to generalize well on unforeseen distributional shifts, including data corruption, adversarial attacks, and domain shifts. Data augmentation is one of the prevalent and eff…
Adversarial RobustnessData AugmentationDomain GeneralizationAn Analysis of Model Robustness across Concurrent Distribution Shifts
Machine learning models, meticulously optimized for source data, often fail to predict target data when faced with distribution shifts (DSs). Previous benchmarking studies, though extensive, have mainly focused on simple…
Benchmarking