Transfer Learning in High-dimensional Ising Models

2026-07-03 · Joonho Kim, Seyoung Park arxiv

In high-dimensional Ising model estimation, target sample sizes are often limited, and effectively using auxiliary binary datasets of unknown relevance remains challenging. To address this, we propose Trans-Ising, a transfer learning method that combines a loss-based source screening rule with a two-stage estimation procedure. The method first identifies informative auxiliary sources using held-out target pseudolikelihood to prevent negative transfer. It then computes an initial estimator via pooled nodewise $\ell_1$-regularized logistic regression, followed by a target-only correction step using a folded-concave penalty. Theoretically, we establish fixed-node $\ell_2$ and $\ell_1$ error bounds, exact graph selection consistency, and the conditional consistency of the screening rule. Through extensive simulations and real-data analyses, we demonstrate that Trans-Ising achieves lower estimation errors than both target-only estimation and naive data pooling.

📄 PDF Abstract BibTeX arXiv:2607.03005

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Transfer Learning Under High-Dimensional Graph Convolutional Regression Model for Node Classification

2024-05-26 · Jiachen Chen, Danyang Huang, Liyuan Wang, Kathryn L. Lunetta 외

Node classification is a fundamental task, but obtaining node classification labels can be challenging and expensive in many real-world scenarios. Transfer learning has emerged as a promising solution to address this cha…

Classification Node Classification regression Transfer Learning

Cross-dimensional transfer learning in medical image segmentation with deep learning

2023-07-29 · Hicham Messaoudi, Ahror Belaid, Douraied Ben Salem, Pierre-Henri Conze

Over the last decade, convolutional neural networks have emerged and advanced the state-of-the-art in various image analysis and computer vision applications. The performance of 2D image classification networks is consta…

image-classification Image Classification Image Segmentation Medical Image Analysis+4

StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting

2024-03-12 · Kunhao Liu, Fangneng Zhan, Muyu Xu, Christian Theobalt 외

We introduce StyleGaussian, a novel 3D style transfer technique that allows instant transfer of any image's style to a 3D scene at 10 frames per second (fps). Leveraging 3D Gaussian Splatting (3DGS), StyleGaussian achiev…

3DGS Decoder Style Transfer

What Makes a Strong Model? A Unified Spectral Analysis of Knowledge Transfer over High-dimensional Linear Regression

2026-05-31 · Wendao Wu, Fangqing Zhang, Haihan Zhang, Cong Fang arxiv

Teacher-Student Knowledge Transfer (KT) is ubiquitous in modern machine learning, ranging from classical model compression via Knowledge Distillation (KD) to the emergent phenomenon of Weak-to-Strong (W2S) generalization…

Knowledge Distillation Model Compression

Rapid aerodynamic prediction of swept wings via physics-embedded transfer learning

2024-09-19 · Yunjia Yang, Runze Li, Yufei Zhang, Lu Lu 외

Machine learning-based models provide a promising way to rapidly acquire transonic swept wing flow fields but suffer from large computational costs in establishing training datasets. Here, we propose a physics-embedded t…