Diversity-aware Buffer for Coping with Temporally Correlated Data Streams in Online Test-time Adaptation
Since distribution shifts are likely to occur after a model's deployment and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model during test-time, leveraging the current test data. In real-world scenarios, test data streams are not always independent and identically distributed (i.i.d.). Instead, they are frequently temporally correlated, making them non-i.i.d. Many existing methods struggle to cope with this scenario. In response, we propose a diversity-aware and category-balanced buffer that can simulate an i.i.d. data stream, even in non-i.i.d. scenarios. Combined with a diversity and entropy-weighted entropy loss, we show that a stable adaptation is possible on a wide range of corruptions and natural domain shifts, based on ImageNet. We achieve state-of-the-art results on most considered benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityTest-time AdaptationSimilar Papers 제목 키워드 기반
GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation
Test-time adaptation (TTA) enables a pre-trained model to adapt online to an unlabeled test stream under distribution shift. While most TTA research focuses on the adaptation objective, practical streams also depend crit…
Test-time AdaptationDiversity Actor-Critic: Sample-Aware Entropy Regularization for Sample-Efficient Exploration
In this paper, sample-aware policy entropy regularization is proposed to enhance the conventional policy entropy regularization for better exploration. Exploiting the sample distribution obtainable from the replay buffer…
DiversityEfficient Explorationreinforcement-learningReinforcement Learning (RL)Efficient Video Super-Resolution for Real-time Rendering with Decoupled G-buffer Guidance
Latency is a key driver for real-time rendering applications, making super-resolution techniques increasingly popular to accelerate rendering processes. In contrast to existing methods that directly concatenate low-r…
GPUSuper-ResolutionVideo Super-ResolutionUncertainty-Aware and Temporally Regulated Expert Advice in Reinforcement Learning for Autonomous Driving
Exploration in reinforcement learning for autonomous driving is inherently unsafe: agents must experience novel behaviors to learn, yet exploration can lead to collisions or off-road driving. We propose an uncertainty-aw…
Reinforcement LearningAutonomous DrivingOmni SCADA Intrusion Detection Using Deep Learning Algorithms
We investigate deep learning based omni intrusion detection system (IDS) for supervisory control and data acquisition (SCADA) networks that are capable of detecting both temporally uncorrelated and correlated attacks. Re…
Deep LearningIntrusion Detection