Exploring Structured Semantic Priors Underlying Diffusion Score for Test-time Adaptation
Capitalizing on the complementary advantages of generative and discriminative models has always been a compelling vision in machine learning, backed by a growing body of research. This work discloses the hidden semantic structure within score-based generative models, unveiling their potential as effective discriminative priors. Inspired by our theoretical findings, we propose DUSA to exploit the structured semantic priors underlying diffusion score to facilitate the test-time adaptation of image classifiers or dense predictors. Notably, DUSA extracts knowledge from a single timestep of denoising diffusion, lifting the curse of Monte Carlo-based likelihood estimation over timesteps. We demonstrate the efficacy of our DUSA in adapting a wide variety of competitive pre-trained discriminative models on diverse test-time scenarios. Additionally, a thorough ablation study is conducted to dissect the pivotal elements in DUSA. Code is publicly available at https://github.com/BIT-DA/DUSA.
Code (1)
Tasks
DenoisingTest-time AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DecompDiff: Diffusion Models with Decomposed Priors for Structure-Based Drug Design
Designing 3D ligands within a target binding site is a fundamental task in drug discovery. Existing structured-based drug design methods treat all ligand atoms equally, which ignores different roles of atoms in the ligan…
AvgDrug DesignDrug DiscoveryDisentangled Textual Priors for Diffusion-based Image Super-Resolution
Image Super-Resolution (SR) aims to reconstruct high-resolution images from degraded low-resolution inputs. While diffusion-based SR methods offer powerful generative capabilities, their performance heavily depends on ho…
Image Super-ResolutionGenerative Map Priors for Collaborative BEV Semantic Segmentation
Collaborative perception aims to address the constraint of single-agent perception by exchanging information among multiple agents. Previous works primarily focus on collaborative object detection, exploring compress…
Feature Compressionobject-detectionObject DetectionSemantic SegmentationFrom Uniform to Learned Graph Priors: Diffusion for Structure Discovery
Neural relational inference (NRI) methods discover interaction graphs from trajectories through variational reasoning on discrete potential edges. However, these methods typically rely on oversimplified, factorized graph…
DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Model
Constructing high-definition (HD) maps is a crucial requirement for enabling autonomous driving. In recent years, several map segmentation algorithms have been developed to address this need, leveraging advancements in B…
Autonomous DrivingSegmentationSemantic Segmentation