TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models
Medical Vision-Language Models (VLMs) exhibit strong zero-shot performance, yet their effectiveness still declines on out-of-distribution (OOD) data due to domain shifts and class bias inherited from large-scale pretraining. Existing few-shot adaptation methods typically introduce additional trainable components, which can be unstable in extremely low-data regimes (e.g., 1-shot), and lack robustness on different medical data. We present TCLA, a purely training-free few-shot adaptation method for Medical VLMs, which is fast and model-agnostic. TCLA corrects inference logits based on a small set of support samples, boosting pretrained VLMs performance by improving inter-class deconfusion and reducing domain shift. Extensive experiments on nine datasets across multiple medical imaging modalities including X-ray, Ultrasound, MRI, CT, Histopathology, demonstrate that TCLA consistently improves OOD performance of Medical VLMs and, in most of cases, outperforms existing training-based adaptation methods.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Brain Network Construction and Classification Toolbox (BrainNetClass)
Brain functional network has become an increasingly used approach in understanding brain functions and diseases. Many network construction methods have been developed, whereas the majority of the studies still used stati…
ClassificationFunctional ConnectivityGeneral ClassificationLight Curve Classification with DistClassiPy: a new distance-based classifier
The rise of synoptic sky surveys has ushered in an era of big data in time-domain astronomy, making data science and machine learning essential tools for studying celestial objects. While tree-based models (e.g. Random F…
AstronomyClassificationDimensionality ReductionTime SeriesFlow Matching Beyond Kinematics: Generating Jets with Particle-ID and Trajectory Displacement Information
We introduce the first generative model trained on the JetClass dataset. Our model generates jets at the constituent level, and it is a permutation-equivariant continuous normalizing flow (CNF) trained with the flow matc…
Cross-Session Decoding of Neural Spiking Data via Task-Conditioned Latent Alignment
Training a high-performing neural decoder can be difficult when only limited data are available from a recording session. To address this challenge, we propose a Task-Conditioned Latent Alignment framework (TCLA) for cro…
Data-Free Client Contribution Estimation via Logit Maximization for Federated Learning
Federated learning (FL) enables collaborative learning of computer vision models, where privacy and regulatory constraints prevent centralizing data across devices or organizations. However, practical FL deployments ofte…
Federated Learning