paper-with-me

홈 › Papers

Deep Active Learning Using Barlow Twins

2022-12-30 · Jaya Krishna Mandivarapu, Blake Camp, Rolando Estrada

The generalisation performance of a convolutional neural networks (CNN) is majorly predisposed by the quantity, quality, and diversity of the training images. All the training data needs to be annotated in-hand before, in many real-world applications data is easy to acquire but expensive and time-consuming to label. The goal of the Active learning for the task is to draw most informative samples from the unlabeled pool which can used for training after annotation. With total different objective, self-supervised learning which have been gaining meteoric popularity by closing the gap in performance with supervised methods on large computer vision benchmarks. self-supervised learning (SSL) these days have shown to produce low-level representations that are invariant to distortions of the input sample and can encode invariance to artificially created distortions, e.g. rotation, solarization, cropping etc. self-supervised learning (SSL) approaches rely on simpler and more scalable frameworks for learning. In this paper, we unify these two families of approaches from the angle of active learning using self-supervised learning mainfold and propose Deep Active Learning using BarlowTwins(DALBT), an active learning method for all the datasets using combination of classifier trained along with self-supervised loss framework of Barlow Twins to a setting where the model can encode the invariance of artificially created distortions, e.g. rotation, solarization, cropping etc.

📄 PDF Abstract BibTeX arXiv:2212.14658

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Barlow Twins Barlow Twins is a self-supervised learning method that applies redundancy-reduction — a principle first proposed in neuroscience — to self supervised learning. The objective…

Similar Papers 제목 키워드 기반

BarlowRL: Barlow Twins for Data-Efficient Reinforcement Learning

2023-08-08 · Omer Veysel Cagatan, Baris Akgun

This paper introduces BarlowRL, a data-efficient reinforcement learning agent that combines the Barlow Twins self-supervised learning framework with DER (Data-Efficient Rainbow) algorithm. BarlowRL outperforms both DER a…

reinforcement-learningReinforcement LearningSelf-Supervised Learning

DinoTwins: Combining DINO and Barlow Twins for Robust, Label-Efficient Vision Transformers

2025-08-24 · Michael Podsiadly, Brendon K Lay arxiv

Training AI models to understand images without costly labeled data remains a challenge. We combine two techniques--DINO (teacher-student learning) and Barlow Twins (redundancy reduction)--to create a model that learns b…

Self-Supervised LearningSemantic Segmentation

Audio Barlow Twins: Self-Supervised Audio Representation Learning

2022-09-28 · Jonah Anton, Harry Coppock, Pancham Shukla, Bjorn W. Schuller

The Barlow Twins self-supervised learning objective requires neither negative samples or asymmetric learning updates, achieving results on a par with the current state-of-the-art within Computer Vision. As such, we prese…

Environmental Sound ClassificationEvent DetectionRepresentation LearningSelf-Supervised Learning

A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning

2021-04-28 · Yao-Hung Hubert Tsai, Shaojie Bai, Louis-Philippe Morency, Ruslan Salakhutdinov

In this report, we relate the algorithmic design of Barlow Twins' method to the Hilbert-Schmidt Independence Criterion (HSIC), thus establishing it as a contrastive learning approach that is free of negative samples. Thr…

Contrastive LearningSelf-Supervised Learning

Guarding Barlow Twins Against Overfitting with Mixed Samples

2023-12-04 · Wele Gedara Chaminda Bandara, Celso M. de Melo, Vishal M. Patel

Self-supervised Learning (SSL) aims to learn transferable feature representations for downstream applications without relying on labeled data. The Barlow Twins algorithm, renowned for its widespread adoption and straight…

Contrastive LearningSelf-Supervised Learning