paper-with-me

홈 › Papers

Fractal Graph Contrastive Learning

2025-05-16 · Nero Z. Li, Xuehao Zhai, Zhichao Shi, Boshen Shi, Xuhui Jiang

While Graph Contrastive Learning (GCL) has attracted considerable attention in the field of graph self-supervised learning, its performance heavily relies on data augmentations that are expected to generate semantically consistent positive pairs. Existing strategies typically resort to random perturbations or local structure preservation, yet lack explicit control over global structural consistency between augmented views. To address this limitation, we propose Fractal Graph Contrastive Learning (FractalGCL), a theory-driven framework that leverages fractal self-similarity to enforce global topological coherence. FractalGCL introduces two key innovations: a renormalisation-based augmentation that generates structurally aligned positive views via box coverings; and a fractal-dimension-aware contrastive loss that aligns graph embeddings according to their fractal dimensions. While combining the two innovations markedly boosts graph-representation quality, it also adds non-trivial computational overhead. To mitigate the computational overhead of fractal dimension estimation, we derive a one-shot estimator by proving that the dimension discrepancy between original and renormalised graphs converges weakly to a centred Gaussian distribution. This theoretical insight enables a reduction in dimension computation cost by an order of magnitude, cutting overall training time by approximately 61%. The experiments show that FractalGCL not only delivers state-of-the-art results on standard benchmarks but also outperforms traditional baselines on traffic networks by an average margin of about remarkably 7%. Codes are available at (https://anonymous.4open.science/r/FractalGCL-0511).

📄 PDF Abstract BibTeX arXiv:2505.11356

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Fractal Gaussian Networks: A sparse random graph model based on Gaussian Multiplicative Chaos

2020-08-07 · ICML 2020 1 · Subhroshekhar Ghosh, Krishnakumar Balasubramanian, Xiaochuan Yang

We propose a novel stochastic network model, called Fractal Gaussian Network (FGN), that embodies well-defined and analytically tractable fractal structures. Such fractal structures have been empirically observed in dive…

parameter estimationStochastic Block Model

Are Graph Transformers Necessary? Efficient Long-Range Message Passing with Fractal Nodes in MPNNs

2025-11-17 · Jeongwhan Choi, Seungjun Park, Sumin Park, Sung-Bae Cho 외 arxiv

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long…

Computational Efficiencygraph partitioning

Point Cloud Pre-Training With Natural 3D Structures

2022-01-01 · CVPR 2022 1 · Ryosuke Yamada, Hirokatsu Kataoka, Naoya Chiba, Yukiyasu Domae 외

The construction of 3D point cloud datasets requires a great deal of human effort. Therefore, constructing a largescale 3D point clouds dataset is difficult. In order to remedy this issue, we propose a newly develope…

3D Object Detectionobject-detectionObject DetectionPoint Cloud Pre-training+1

A Language and Its Dimensions: Intrinsic Dimensions of Language Fractal Structures

2023-11-16 · Vasilii A. Gromov, Nikita S. Borodin, Asel S. Yerbolova

The present paper introduces a novel object of study - a language fractal structure. We hypothesize that a set of embeddings of all $n$-grams of a natural language constitutes a representative sample of this fractal set.…

AllTopological Data Analysis

GPU Accelerated Fractal Image Compression for Medical Imaging in Parallel Computing Platform

2014-04-03 · Md. Enamul Haque, Abdullah Al Kaisan, Mahmudur R Saniat, Aminur Rahman

In this paper, we implemented both sequential and parallel version of fractal image compression algorithms using CUDA (Compute Unified Device Architecture) programming model for parallelizing the program in Graphics Proc…

GPUImage Compression