paper-with-me

홈 › Papers

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

2024-09-13 · Qiaowei Miao, Yawei Luo, Yi Yang

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features but neglect whether these features are unique to each class. Even if some features are domain-invariant, they cannot serve as key classification criteria if shared across different classes. In OOD tasks, both domain-related and class-shared features act as confounders that hinder generalization. In this paper, we propose a DICS model to extract Domain-Invariant and Class-Specific features, including Domain Invariance Testing (DIT) and Class Specificity Testing (CST), which mitigate the effects of spurious correlations introduced by confounders. DIT learns domain-related features of each source domain and removes them from inputs to isolate domain-invariant class-related features. DIT ensures domain invariance by aligning same-class features across different domains. Then, CST calculates soft labels for those features by comparing them with features learned in previous steps. We optimize the cross-entropy between the soft labels and their true labels, which enhances same-class similarity and different-class distinctiveness, thereby reinforcing class specificity. Extensive experiments on widely-used benchmarks demonstrate the effectiveness of our proposed algorithm. Additional visualizations further demonstrate that DICS effectively identifies the key features of each class in target domains.

📄 PDF Abstract BibTeX arXiv:2409.08557

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution GeneralizationSpecificity

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

DICS: Data-Informed Centroid Splitting for Decision Tree Classifiers

2026-08-20 · MD Saifur Rahman Mazumder, Feng Yu arxiv

Decision tree-based models are widely used in machine learning due to their interpretability and strong empirical performance. However, training decision trees can be computationally expensive, particularly for large and…

Computational Efficiency

IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic Languages

2025-05-06 · Sharvi Endait, Ruturaj Ghatage, Aditya Kulkarni, Rajlaxmi Patil 외

The rapid progress in question-answering (QA) systems has predominantly benefited high-resource languages, leaving Indic languages largely underrepresented despite their vast native speaker base. In this paper, we presen…

Question Answering

SimCS: Simulation for Domain Incremental Online Continual Segmentation

2022-11-29 · Motasem Alfarra, Zhipeng Cai, Adel Bibi, Bernard Ghanem 외

Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image …

Autonomous DrivingContinual Learningimage-classificationImage Classification+1

Explainable AI in Orthopedics: Challenges, Opportunities, and Prospects

2023-08-09 · Soheyla Amirian, Luke A. Carlson, Matthew F. Gong, Ines Lohse 외

While artificial intelligence (AI) has made many successful applications in various domains, its adoption in healthcare lags a little bit behind other high-stakes settings. Several factors contribute to this slower uptak…

Descriptive

POEM: Polarization of Embeddings for Domain-Invariant Representations

2023-05-22 · Sang-Yeong Jo, Sung Whan Yoon

Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capabi…

Domain GeneralizationPhilosophy