paper-with-me

Papers

Unified Entropy Optimization for Open-Set Test-Time Adaptation

2024-04-09 · CVPR 2024 1 · Zhengqing Gao, Xu-Yao Zhang, Cheng-Lin Liu

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while neglecting semantic shifts. In this paper, we delve into a realistic open-set TTA setting where the target domain may contain samples from unknown classes. Many state-of-the-art closed-set TTA methods perform poorly when applied to open-set scenarios, which can be attributed to the inaccurate estimation of data distribution and model confidence. To address these issues, we propose a simple but effective framework called unified entropy optimization (UniEnt), which is capable of simultaneously adapting to covariate-shifted in-distribution (csID) data and detecting covariate-shifted out-of-distribution (csOOD) data. Specifically, UniEnt first mines pseudo-csID and pseudo-csOOD samples from test data, followed by entropy minimization on the pseudo-csID data and entropy maximization on the pseudo-csOOD data. Furthermore, we introduce UniEnt+ to alleviate the noise caused by hard data partition leveraging sample-level confidence. Extensive experiments on CIFAR benchmarks and Tiny-ImageNet-C show the superiority of our framework. The code is available at https://github.com/gaozhengqing/UniEnt

📄 PDF Abstract BibTeX arXiv:2404.06065

Code (1)

gaozhengqing/unient 공식 구현 pytorch

Tasks

Test-time Adaptation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization

2025-01-23 · Hao Dong, Eleni Chatzi, Olga Fink

Test-time adaptation (TTA) has demonstrated significant potential in addressing distribution shifts between training and testing data. Open-set test-time adaptation (OSTTA) aims to adapt a source pre-trained model online…

Test-time Adaptation

Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image Compression

2026-04-12 · Shiyin Jiang, Wei Long, Minghao Han, Zhenghao Chen 외 arxiv

The rapid growth of visual data under stringent storage and bandwidth constraints makes extremely low-bitrate image compression increasingly important. While Vector Quantization (VQ) offers strong structural fidelity, ex…

Representation LearningImage Compression

copent: Estimating Copula Entropy and Transfer Entropy in R

2020-05-27 · Jian Ma

Statistical independence and conditional independence are two fundamental concepts in statistics and machine learning. Copula Entropy is a mathematical concept defined by Ma and Sun for multivariate statistical independe…

BIG-bench Machine LearningCausal DiscoveryMutual Information Estimationstatistical independence testing+1

Variational Characterizations of Local Entropy and Heat Regularization in Deep Learning

2019-01-29 · Nicolas Garcia Trillos, Zach Kaplan, Daniel Sanz-Alonso

The aim of this paper is to provide new theoretical and computational understanding on two loss regularizations employed in deep learning, known as local entropy and heat regularization. For both regularized losses we in…

Rethinking Entropy Minimization in Test-Time Adaptation for Autoregressive Models

2026-05-05 · Wei-Ping Huang, Chee-En Yu, Guan-Ting Lin, Hung-yi Lee arxiv

Test-Time Adaptation (TTA) via entropy minimization (EM) has proven effective for classification tasks, yet its application to generative autoregressive models remains theoretically fragmented. Existing approaches typica…

Reinforcement LearningTest-time Adaptation