Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring
We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or by speculatively picking negative samples, we instead also make use of the natural variation that occurs in image collections that are captured using static monitoring cameras. To achieve this, we exploit readily available context data that encodes information such as the spatial and temporal relationships between the input images. We are able to learn representations that are surprisingly effective for downstream supervised classification, by first identifying high probability positive pairs at training time, i.e. those images that are likely to depict the same visual concept. For the critical task of global biodiversity monitoring, this results in image features that can be adapted to challenging visual species classification tasks with limited human supervision. We present results on four different camera trap image collections, across three different families of self-supervised learning methods, and show that careful image selection at training time results in superior performance compared to existing baselines such as conventional self-supervised training and transfer learning.
Code (1)
Tasks
Self-Supervised LearningTransfer LearningSimilar Papers 제목 키워드 기반
Below-ground Fungal Biodiversity Can be Monitored Using Self-Supervised Learning Satellite Features
Mycorrhizal fungi are vital to terrestrial ecosystem functioning. Yet monitoring their biodiversity at landscape scales is often unfeasible due to time and cost constraints. Current predictions suggest that 90\% of mycor…
Self-Supervised LearningPredicting butterfly species presence from satellite imagery using soft contrastive regularisation
The growing demand for scalable biodiversity monitoring methods has fuelled interest in remote sensing data, due to its widespread availability and extensive coverage. Traditionally, the application of remote sensing to …
Self-supervised Learning on Camera Trap Footage Yields a Strong Universal Face Embedder
Camera traps are revolutionising wildlife monitoring by capturing vast amounts of visual data; however, the manual identification of individual animals remains a significant bottleneck. This study introduces a fully self…
Self-Supervised LearningSelf-Supervised Learning of Plant Image Representations
Automated plant recognition plays a crucial role in biodiversity monitoring and conservation, yet current approaches rely heavily on supervised learning, which is limited by the availability of expert-labeled data. Self-…
Self-Supervised LearningRepresentation LearningMonitoring biodiversity loss in rapidly changing Afrotropical ecosystems: An emerging imperative for governance and research
Africa is experiencing extensive biodiversity loss due to rapid changes in the environment, where natural resources constitute the main instrument for socioeconomic development and a mainstay source of livelihoods for an…
Management