paper-with-me

홈 › Papers

ETAGE: Enhanced Test Time Adaptation with Integrated Entropy and Gradient Norms for Robust Model Performance

2024-09-14 · Afshar Shamsi, Rejisa Becirovic, Ahmadreza Argha, Ehsan Abbasnejad, Hamid Alinejad-Rokny, Arash Mohammadi

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence metric, its effectiveness can be limited, particularly in biased scenarios. Extending existing approaches like the Pseudo Label Probability Difference (PLPD), we introduce ETAGE, a refined TTA method that integrates entropy minimization with gradient norms and PLPD, to enhance sample selection and adaptation. Our method prioritizes samples that are less likely to cause instability by combining high entropy with high gradient norms out of adaptation, thus avoiding the overfitting to noise often observed in previous methods. Extensive experiments on CIFAR-10-C and CIFAR-100-C datasets demonstrate that our approach outperforms existing TTA techniques, particularly in challenging and biased scenarios, leading to more robust and consistent model performance across diverse test scenarios. The codebase for ETAGE is available on https://github.com/afsharshamsi/ETAGE.

📄 PDF Abstract BibTeX arXiv:2409.09251

Code (1)

afsharshamsi/etage 공식 구현 pytorch

Tasks

Pseudo LabelTest-time Adaptation

Similar Papers 제목 키워드 기반

FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomics

2024-02-24 · Chenrui Duan, Zelin Zang, Yongjie Xu, Hang He 외

Metagenomic data, comprising mixed multi-species genomes, are prevalent in diverse environments like oceans and soils, significantly impacting human health and ecological functions. However, current research relies on K-…

Contrastive LearningLanguage ModelingLanguage ModellingTriplet

Phylogenetic Convolutional Neural Networks in Metagenomics

2017-09-06 · Diego Fioravanti, Ylenia Giarratano, Valerio Maggio, Claudio Agostinelli 외

Background: Convolutional Neural Networks can be effectively used only when data are endowed with an intrinsic concept of neighbourhood in the input space, as is the case of pixels in images. We introduce here Ph-CNN, a …

Deep LearningDomain AdaptationGeneral Classification

MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning

2026-01-27 · Yimeng Wang, Jiaxing Zhao, Hongbin Xie, Hexing Ma 외 arxiv

Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a singl…

Code Generation

PhaBOX: A web server for identifying and characterizing phage contigs in metagenomic data

2023-03-28 · Jiayu Shang, Cheng Peng, Herui Liao, Xubo Tang 외

Motivation: There is accumulating evidence showing the important roles of bacteriophages (phages) in regulating the structure and functions of the microbiome. However, lacking an easy-to-use and integrated phage analysis…

Accurate identification of bacteriophages from metagenomic data using Transformer

2022-01-13 · Jiayu Shang, Xubo Tang, Ruocheng Guo, Yanni Sun

Motivation: Bacteriophages are viruses infecting bacteria. Being key players in microbial communities, they can regulate the composition/function of microbiome by infecting their bacterial hosts and mediating gene transf…

Language Modelling