paper-with-me

Papers

Beyond Parameter Finetuning: Test-Time Representation Refinement for Node Classification

2026-01-29 · Jiaxin Zhang, Yiqi Wang, Siwei Wang, Xihong Yang, Yu Shi, Xinwang Liu, En Zhu arxiv

Graph Neural Networks frequently exhibit significant performance degradation in the out-of-distribution test scenario. While test-time training (TTT) offers a promising solution, existing Parameter Finetuning (PaFT) paradigm suffer from catastrophic forgetting, hindering their real-world applicability. We propose TTReFT, a novel Test-Time Representation FineTuning framework that transitions the adaptation target from model parameters to latent representations. Specifically, TTReFT achieves this through three key innovations: (1) uncertainty-guided node selection for specific interventions, (2) low-rank representation interventions that preserve pre-trained knowledge, and (3) an intervention-aware masked autoencoder that dynamically adjust masking strategy to accommodate the node selection scheme. Theoretically, we establish guarantees for TTReFT in OOD settings. Empirically, extensive experiments across five benchmark datasets demonstrate that TTReFT achieves consistent and superior performance. Our work establishes representation finetuning as a new paradigm for graph TTT, offering both theoretical grounding and immediate practical utility for real-world deployment.

📄 PDF Abstract BibTeX arXiv:2601.21615

Code (0)

등록된 구현이 없습니다.

Tasks

Node Classification

Similar Papers 제목 키워드 기반

Understanding Finetuning for Factual Knowledge Extraction from Language Models

2023-01-26 · Mehran Kazemi, Sid Mittal, Deepak Ramachandran

Language models (LMs) pretrained on large corpora of text from the web have been observed to contain large amounts of various types of knowledge about the world. This observation has led to a new and exciting paradigm in…

graph construction

CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesis

2024-04-07 · Gyeongjin Kang, Younggeun Lee, Seungjun Oh, Eunbyung Park

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, …

DecoderNeRFNovel View Synthesis

InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning

2023-04-06 · CVPR 2024 1 · Jing Shi, Wei Xiong, Zhe Lin, Hyun Joon Jung

Recent advances in personalized image generation allow a pre-trained text-to-image model to learn a new concept from a set of images. However, existing personalization approaches usually require heavy test-time finetunin…

Diffusion PersonalizationDiffusion Personalization Tuning FreeImage GenerationPersonalized Image Generation+2

LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models

2023-06-21 · Shizhe Diao, Rui Pan, Hanze Dong, Ka Shun Shum 외

Foundation models have demonstrated a great ability to achieve general human-level intelligence far beyond traditional approaches. As the technique keeps attracting attention from the AI community, an increasing number o…

On Finetuning Tabular Foundation Models

2025-06-10 · Ivan Rubachev, Akim Kotelnikov, Nikolay Kartashev, Artem Babenko

Foundation models are an emerging research direction in tabular deep learning. Notably, TabPFNv2 recently claimed superior performance over traditional GBDT-based methods on small-scale datasets using an in-context learn…

In-Context LearningRetrieval