paper-with-me

홈 › Papers

BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversity

2024-06-25 · Chih-Hsuan Yang, Benjamin Feuer, Zaki Jubery, Zi K. Deng, Andre Nakkab, Md Zahid Hasan, Shivani Chiranjeevi, Kelly Marshall, Nirmal Baishnab, Asheesh K Singh, Arti Singh, Soumik Sarkar, Nirav Merchant, Chinmay Hegde, Baskar Ganapathysubramanian

We introduce BioTrove, the largest publicly accessible dataset designed to advance AI applications in biodiversity. Curated from the iNaturalist platform and vetted to include only research-grade data, BioTrove contains 161.9 million images, offering unprecedented scale and diversity from three primary kingdoms: Animalia ("animals"), Fungi ("fungi"), and Plantae ("plants"), spanning approximately 366.6K species. Each image is annotated with scientific names, taxonomic hierarchies, and common names, providing rich metadata to support accurate AI model development across diverse species and ecosystems. We demonstrate the value of BioTrove by releasing a suite of CLIP models trained using a subset of 40 million captioned images, known as BioTrove-Train. This subset focuses on seven categories within the dataset that are underrepresented in standard image recognition models, selected for their critical role in biodiversity and agriculture: Aves ("birds"), Arachnida ("spiders/ticks/mites"), Insecta ("insects"), Plantae ("plants"), Fungi ("fungi"), Mollusca ("snails"), and Reptilia ("snakes/lizards"). To support rigorous assessment, we introduce several new benchmarks and report model accuracy for zero-shot learning across life stages, rare species, confounding species, and multiple taxonomic levels. We anticipate that BioTrove will spur the development of AI models capable of supporting digital tools for pest control, crop monitoring, biodiversity assessment, and environmental conservation. These advancements are crucial for ensuring food security, preserving ecosystems, and mitigating the impacts of climate change. BioTrove is publicly available, easily accessible, and ready for immediate use.

📄 PDF Abstract BibTeX arXiv:2406.17720

Code (2)

baskargroup/Arboretum 공식 구현 pytorch
baskargroup/biotrove 공식 구현 pytorch

Tasks

Zero-Shot Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Divide and Contrast: Self-supervised Learning from Uncurated Data

2021-05-17 · ICCV 2021 10 · Yonglong Tian, Olivier J. Henaff, Aaron van den Oord

Self-supervised learning holds promise in leveraging large amounts of unlabeled data, however much of its progress has thus far been limited to highly curated pre-training data such as ImageNet. We explore the effects of…

ClusteringContrastive LearningSelf-Supervised Image ClassificationSelf-Supervised Learning

Multi-Task Learning of Object State Changes from Uncurated Videos

2022-11-24 · Tomáš Souček, Jean-Baptiste Alayrac, Antoine Miech, Ivan Laptev 외

We aim to learn to temporally localize object state changes and the corresponding state-modifying actions by observing people interacting with objects in long uncurated web videos. We introduce three principal contributi…

Multi-Task LearningObjectSelf-Supervised LearningTemporal Localization

IMA++: ISIC Archive Multi-Annotator Dermoscopic Skin Lesion Segmentation Dataset

2025-12-25 · Kumar Abhishek, Jeremy Kawahara, Ghassan Hamarneh arxiv

Multi-annotator medical image segmentation is an important research problem, but requires annotated datasets that are expensive to collect. Dermoscopic skin lesion imaging allows human experts and AI systems to observe m…

Medical Image SegmentationSkin Lesion Segmentation

Unsupervised Pre-Training of Image Features on Non-Curated Data

2019-05-03 · ICCV 2019 10 · Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin

Pre-training general-purpose visual features with convolutional neural networks without relying on annotations is a challenging and important task. Most recent efforts in unsupervised feature learning have focused on eit…

ClusteringSelf-Supervised Image ClassificationUnsupervised Pre-training

ChemPile: A 250GB Diverse and Curated Dataset for Chemical Foundation Models

2025-05-18 · Adrian Mirza, Nawaf Alampara, Martiño Ríos-García, Mohamed Abdelalim 외

Foundation models have shown remarkable success across scientific domains, yet their impact in chemistry remains limited due to the absence of diverse, large-scale, high-quality datasets that reflect the field's multifac…

ArticlesBenchmarking