Upper Bounding Barlow Twins: A Novel Filter for Multi-Relational Clustering

2023-12-21 · Xiaowei Qian, Bingheng Li, Zhao Kang

Multi-relational clustering is a challenging task due to the fact that diverse semantic information conveyed in multi-layer graphs is difficult to extract and fuse. Recent methods integrate topology structure and node attribute information through graph filtering. However, they often use a low-pass filter without fully considering the correlation among multiple graphs. To overcome this drawback, we propose to learn a graph filter motivated by the theoretical analysis of Barlow Twins. We find that input with a negative semi-definite inner product provides a lower bound for Barlow Twins loss, which prevents it from reaching a better solution. We thus learn a filter that yields an upper bound for Barlow Twins. Afterward, we design a simple clustering architecture and demonstrate its state-of-the-art performance on four benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2312.14066

Code (1)

XweiQ/BTGF 공식 구현 pytorch

Tasks

AttributeClustering

Methods 이 논문이 사용한 방법론

Barlow Twins Barlow Twins is a self-supervised learning method that applies redundancy-reduction — a principle first proposed in neuroscience — to self supervised learning. The objective…

BarlowRL: Barlow Twins for Data-Efficient Reinforcement Learning

2023-08-08 · Omer Veysel Cagatan, Baris Akgun

This paper introduces BarlowRL, a data-efficient reinforcement learning agent that combines the Barlow Twins self-supervised learning framework with DER (Data-Efficient Rainbow) algorithm. BarlowRL outperforms both DER a…

reinforcement-learning Reinforcement Learning Self-Supervised Learning

DinoTwins: Combining DINO and Barlow Twins for Robust, Label-Efficient Vision Transformers

2025-08-24 · Michael Podsiadly, Brendon K Lay arxiv

Training AI models to understand images without costly labeled data remains a challenge. We combine two techniques--DINO (teacher-student learning) and Barlow Twins (redundancy reduction)--to create a model that learns b…

Self-Supervised Learning Semantic Segmentation

Audio Barlow Twins: Self-Supervised Audio Representation Learning

2022-09-28 · Jonah Anton, Harry Coppock, Pancham Shukla, Bjorn W. Schuller

The Barlow Twins self-supervised learning objective requires neither negative samples or asymmetric learning updates, achieving results on a par with the current state-of-the-art within Computer Vision. As such, we prese…

Environmental Sound Classification Event Detection Representation Learning Self-Supervised Learning

A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning

2021-04-28 · Yao-Hung Hubert Tsai, Shaojie Bai, Louis-Philippe Morency, Ruslan Salakhutdinov

In this report, we relate the algorithmic design of Barlow Twins' method to the Hilbert-Schmidt Independence Criterion (HSIC), thus establishing it as a contrastive learning approach that is free of negative samples. Thr…

Contrastive Learning Self-Supervised Learning

Guarding Barlow Twins Against Overfitting with Mixed Samples

2023-12-04 · Wele Gedara Chaminda Bandara, Celso M. de Melo, Vishal M. Patel

Self-supervised Learning (SSL) aims to learn transferable feature representations for downstream applications without relying on labeled data. The Barlow Twins algorithm, renowned for its widespread adoption and straight…