paper-with-me

Papers

BloomCoreset: Fast Coreset Sampling using Bloom Filters for Fine-Grained Self-Supervised Learning

2024-12-22 · Prajwal Singh, Gautam Vashishtha, Indra Deep Mastan, Shanmuganathan Raman

The success of deep learning in supervised fine-grained recognition for domain-specific tasks relies heavily on expert annotations. The Open-Set for fine-grained Self-Supervised Learning (SSL) problem aims to enhance performance on downstream tasks by strategically sampling a subset of images (the Core-Set) from a large pool of unlabeled data (the Open-Set). In this paper, we propose a novel method, BloomCoreset, that significantly reduces sampling time from Open-Set while preserving the quality of samples in the coreset. To achieve this, we utilize Bloom filters as an innovative hashing mechanism to store both low- and high-level features of the fine-grained dataset, as captured by Open-CLIP, in a space-efficient manner that enables rapid retrieval of the coreset from the Open-Set. To show the effectiveness of the sampled coreset, we integrate the proposed method into the state-of-the-art fine-grained SSL framework, SimCore [1]. The proposed algorithm drastically outperforms the sampling strategy of the baseline in SimCore [1] with a $98.5\%$ reduction in sampling time with a mere $0.83\%$ average trade-off in accuracy calculated across $11$ downstream datasets.

📄 PDF Abstract BibTeX arXiv:2412.16942

Code (1)

prajwalsingh/bloomcoreset 공식 구현 pytorch

Tasks

Self-Supervised Learning

Methods 이 논문이 사용한 방법론

BLOOM BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages…

Similar Papers 제목 키워드 기반

Advanced Bloom Filter Based Algorithms for Efficient Approximate Data De-Duplication in Streams

2012-12-17 · Suman K. Bera, Sourav Dutta, Ankur Narang, Souvik Bhattacherjee

Applications involving telecommunication call data records, web pages, online transactions, medical records, stock markets, climate warning systems, etc., necessitate efficient management and processing of such massively…

Management

Cascaded Learned Bloom Filter for Optimal Model-Filter Size Balance and Fast Rejection

2025-02-06 · Atsuki Sato, Yusuke Matsui

Recent studies have demonstrated that learned Bloom filters, which combine machine learning with the classical Bloom filter, can achieve superior memory efficiency. However, existing learned Bloom filters face two critic…

A Model for Learned Bloom Filters, and Optimizing by Sandwiching

2019-01-03 · Michael Mitzenmacher

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to determine a function that models the data set the Bloom filter is meant to represent. Here we model such lear…

BIG-bench Machine Learning

A Model for Learned Bloom Filters and Optimizing by Sandwiching

2018-12-01 · NeurIPS 2018 12 · Michael Mitzenmacher

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to determine a function that models the data set the Bloom filter is meant to represent. Here we model such lea…

BIG-bench Machine Learning

Meta-Learning Neural Bloom Filters

2019-06-10 · ICLR 2019 5 · Jack W. Rae, Sergey Bartunov, Timothy P. Lillicrap

There has been a recent trend in training neural networks to replace data structures that have been crafted by hand, with an aim for faster execution, better accuracy, or greater compression. In this setting, a neural da…

Meta-Learning