paper-with-me

Papers

CoLiDR: Concept Learning using Aggregated Disentangled Representations

2024-07-27 · Sanchit Sinha, Guangzhi Xiong, Aidong Zhang

Interpretability of Deep Neural Networks using concept-based models offers a promising way to explain model behavior through human-understandable concepts. A parallel line of research focuses on disentangling the data distribution into its underlying generative factors, in turn explaining the data generation process. While both directions have received extensive attention, little work has been done on explaining concepts in terms of generative factors to unify mathematically disentangled representations and human-understandable concepts as an explanation for downstream tasks. In this paper, we propose a novel method CoLiDR - which utilizes a disentangled representation learning setup for learning mutually independent generative factors and subsequently learns to aggregate the said representations into human-understandable concepts using a novel aggregation/decomposition module. Experiments are conducted on datasets with both known and unknown latent generative factors. Our method successfully aggregates disentangled generative factors into concepts while maintaining parity with state-of-the-art concept-based approaches. Quantitative and visual analysis of the learned aggregation procedure demonstrates the advantages of our work compared to commonly used concept-based models over four challenging datasets. Lastly, our work is generalizable to an arbitrary number of concepts and generative factors - making it flexible enough to be suitable for various types of data.

📄 PDF Abstract BibTeX arXiv:2407.19300

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Revisiting Factorizing Aggregated Posterior in Learning Disentangled Representations

2020-09-12 · Ze Cheng, Juncheng Li, Chenxu Wang, Jixuan Gu 외

In the problem of learning disentangled representations, one of the promising methods is to factorize aggregated posterior by penalizing the total correlation of sampled latent variables. However, this well-motivated str…

OmniPrism: Learning Disentangled Visual Concept for Image Generation

2024-12-16 · Yangyang Li, Daqing Liu, Wu Liu, Allen He 외

Creative visual concept generation often draws inspiration from specific concepts in a reference image to produce relevant outcomes. However, existing methods are typically constrained to single-aspect concept generation…

DisentanglementImage Generation

DisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis

2024-10-23 · Shangshang Yang, Mingyang Chen, Ziwen Wang, Xiaoshan Yu 외

Existing graph learning-based cognitive diagnosis (CD) methods have made relatively good results, but their student, exercise, and concept representations are learned and exchanged in an implicit unified graph, which mak…

cognitive diagnosisDiagnosticGraph AttentionGraph Learning

Distilling Aggregated Knowledge for Weakly-Supervised Video Anomaly Detection

2024-06-05 · Jash Dalvi, Ali Dabouei, Gunjan Dhanuka, Min Xu

Video anomaly detection aims to develop automated models capable of identifying abnormal events in surveillance videos. The benchmark setup for this task is extremely challenging due to: i) the limited size of the traini…

Anomaly DetectionAnomaly Detection In Surveillance VideosVideo Anomaly DetectionWeakly-supervised Video Anomaly Detection

Towards Learning Fine-Grained Disentangled Representations from Speech

2018-08-08 · Yuan Gong, Christian Poellabauer

Learning disentangled representations of high-dimensional data is currently an active research area. However, compared to the field of computer vision, less work has been done for speech processing. In this paper, we pro…

Representation LearningSpeech Representation Learning