paper-with-me

홈 › Papers

The Conditional Cauchy-Schwarz Divergence with Applications to Time-Series Data and Sequential Decision Making

2023-01-21 · Shujian Yu, Hongming Li, Sigurd Løkse, Robert Jenssen, José C. Príncipe

The Cauchy-Schwarz (CS) divergence was developed by Pr\'{i}ncipe et al. in 2000. In this paper, we extend the classic CS divergence to quantify the closeness between two conditional distributions and show that the developed conditional CS divergence can be simply estimated by a kernel density estimator from given samples. We illustrate the advantages (e.g., rigorous faithfulness guarantee, lower computational complexity, higher statistical power, and much more flexibility in a wide range of applications) of our conditional CS divergence over previous proposals, such as the conditional KL divergence and the conditional maximum mean discrepancy. We also demonstrate the compelling performance of conditional CS divergence in two machine learning tasks related to time series data and sequential inference, namely time series clustering and uncertainty-guided exploration for sequential decision making. The code of conditional CS divergence is available at https://github.com/SJYuCNEL/conditional_CS_divergence.

📄 PDF Abstract BibTeX arXiv:2301.08970

Code (1)

sjyucnel/conditional_cs_divergence 공식 구현 pytorch

Tasks

Decision MakingSequential Decision MakingTime SeriesTime Series AnalysisTime Series Clustering

Similar Papers 제목 키워드 기반

Domain Adaptation with Cauchy-Schwarz Divergence

2024-05-30 · Wenzhe Yin, Shujian Yu, Yicong Lin, Jie Liu 외

Domain adaptation aims to use training data from one or multiple source domains to learn a hypothesis that can be generalized to a different, but related, target domain. As such, having a reliable measure for evaluating …

Domain AdaptationMulti-class ClassificationUnsupervised Domain Adaptation

Efficient Sensor Management for Multitarget Tracking in Passive Sensor Networks via Cauchy-Schwarz Divergence

2020-11-03 · Yun Zhu

This paper presents an efficient sensor management approach for multi-target tracking in passive sensor networks. Compared with active sensor networks, passive sensor networks have larger uncertainty due to the nature of…

Management

On Hölder projective divergences

2017-01-14 · Frank Nielsen, Ke Sun, Stéphane Marchand-Maillet

We describe a framework to build distances by measuring the tightness of inequalities, and introduce the notion of proper statistical divergences and improper pseudo-divergences. We then consider the H\"older ordinary an…

Clustering

Cauchy-Schwarz Divergence Information Bottleneck for Regression

2024-04-27 · Shujian Yu, Xi Yu, Sigurd Løkse, Robert Jenssen 외

The information bottleneck (IB) approach is popular to improve the generalization, robustness and explainability of deep neural networks. Essentially, it aims to find a minimum sufficient representation $\mathbf{t}$ by s…

Adversarial RobustnessInformation PlaneregressionVariational Inference

Generalized Cauchy-Schwarz Divergence and Its Deep Learning Applications

2024-05-07 · Mingfei Lu, Chenxu Li, Shujian Yu, Robert Jenssen 외

Divergence measures play a central role and become increasingly essential in deep learning, yet efficient measures for multiple (more than two) distributions are rarely explored. This becomes particularly crucial in area…

ClusteringDeep ClusteringDeep LearningDensity Estimation+3