paper-with-me

Papers

JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference

2026-03-31 · Bo Ma, Jinsong Wu, Weiqi Yan, Hongjiang Wei, Kun Liu arxiv

We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path. We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline. On a 510-patient same-patient paired BIMCV cohort with patient-level 5-fold cross-validation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice soft-KL supervision yields $Δ\mathrm{BA}{=}{+}0.035$ ($95\%$ CI $[{+}0.011,{+}0.057]$) and mid-slice hard supervision yields $+0.033$ ($[{+}0.007,{+}0.058]$). Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. Confidence-gated auxiliary targets are therefore a more transferable channel than uniformly softened CT logits; the evidence is bounded to one paired cohort, so external paired-cohort replication is required before any deployment claim.

📄 PDF Abstract BibTeX arXiv:2603.29167

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

OPD-V: Visual On-Policy Self-Distillation with Modality Balance

2026-08-05 · Aniri, Jinhe Bi, Peng Liao, Zengjie Jin 외 hf

On-Policy Self-Distillation (OPSD) has become a standard post-training approach for improving visual reasoning in multimodal large language models (MLLMs). Existing methods draw privileged information from diverse input …

Visual Reasoning

CPFD: Confidence-aware Privileged Feature Distillation for Short Video Classification

2024-10-03 · Jinghao Shi, Xiang Shen, Kaili Zhao, Xuedong Wang 외

Dense features, customized for different business scenarios, are essential in short video classification. However, their complexity, specific adaptation requirements, and high computational costs make them resource-inten…

Video Classification

Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillation

2025-05-04 · Chenxi Liu, Hao Miao, Qianxiong Xu, Shaowen Zhou 외

Multivariate time series forecasting (MTSF) endeavors to predict future observations given historical data, playing a crucial role in time series data management systems. With advancements in large language models (LLMs)…

Knowledge DistillationMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

One-stage Modality Distillation for Incomplete Multimodal Learning

2023-09-15 · Shicai Wei, Yang Luo, Chunbo Luo

Learning based on multimodal data has attracted increasing interest recently. While a variety of sensory modalities can be collected for training, not all of them are always available in development scenarios, which rais…

Multi-Task LearningTransfer Learning

The Illusion of Certainty: Decoupling Capability and Calibration in On-Policy Distillation

2026-04-18 · Jiaxin Zhang, Xiangyu Peng, Qinglin Chen, Qinyuan Ye 외 arxiv

On-policy distillation (OPD) is an increasingly important paradigm for post-training language models. However, we identify a pervasive Scaling Law of Miscalibration: while OPD effectively improves task accuracy, it syste…

Continual Learning