paper-with-me

Papers

Learning novel representations of variable sources from multi-modal $\textit{Gaia}$ data via autoencoders

2025-05-22 · P. Huijse, J. De Ridder, L. Eyer, L. Rimoldini, B. Holl, N. Chornay, J. Roquette, K. Nienartowicz, G. Jevardat de Fombelle, D. J. Fritzewski, A. Kemp, V. Vanlaer, M. Vanrespaille, H. Wang, M. I. Carnerero, C. M. Raiteri, G. Marton, M. Madarász, G. Clementini, P. Gavras, C. Aerts

Gaia Data Release 3 (DR3) published for the first time epoch photometry, BP/RP (XP) low-resolution mean spectra, and supervised classification results for millions of variable sources. This extensive dataset offers a unique opportunity to study their variability by combining multiple Gaia data products. In preparation for DR4, we propose and evaluate a machine learning methodology capable of ingesting multiple Gaia data products to achieve an unsupervised classification of stellar and quasar variability. A dataset of 4 million Gaia DR3 sources is used to train three variational autoencoders (VAE), which are artificial neural networks (ANNs) designed for data compression and generation. One VAE is trained on Gaia XP low-resolution spectra, another on a novel approach based on the distribution of magnitude differences in the Gaia G band, and the third on folded Gaia G band light curves. Each Gaia source is compressed into 15 numbers, representing the coordinates in a 15-dimensional latent space generated by combining the outputs of these three models. The learned latent representation produced by the ANN effectively distinguishes between the main variability classes present in Gaia DR3, as demonstrated through both supervised and unsupervised classification analysis of the latent space. The results highlight a strong synergy between light curves and low-resolution spectral data, emphasising the benefits of combining the different Gaia data products. A two-dimensional projection of the latent variables reveals numerous overdensities, most of which strongly correlate with astrophysical properties, showing the potential of this latent space for astrophysical discovery. We show that the properties of our novel latent representation make it highly valuable for variability analysis tasks, including classification, clustering and outlier detection.

📄 PDF Abstract BibTeX arXiv:2505.16320

Code (0)

등록된 구현이 없습니다.

Tasks

Data CompressionOutlier Detection

Similar Papers 제목 키워드 기반

L0-Sparse Canonical Correlation Analysis

2021-09-29 · ICLR 2022 4 · Ofir Lindenbaum, Moshe Salhov, Amir Averbuch, Yuval Kluger

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsu…

$\ell_0$-based Sparse Canonical Correlation Analysis

2020-10-12 · Ofir Lindenbaum, Moshe Salhov, Amir Averbuch, Yuval Kluger

Canonical Correlation Analysis (CCA) models are powerful for studying the associations between two sets of variables. The canonically correlated representations, termed \textit{canonical variates} are widely used in unsu…

LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Models

2024-06-21 · Mengdan Zhu, Raasikh Kanjiani, Jiahui Lu, Andrew Choi 외

Deep generative models like VAEs and diffusion models have advanced various generation tasks by leveraging latent variables to learn data distributions and generate high-quality samples. Despite the field of explainable …

Uncertainty Quantification

Hierarchical Multimodal Variational Autoencoders

2021-09-29 · Jannik Wolff, Rahul G Krishnan, Lukas Ruff, Jan Nikolas Morshuis 외

Humans find structure in natural phenomena by absorbing stimuli from multiple input sources such as vision, text, and speech. We study the use of deep generative models that generate multimodal data from latent represent…

Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis

2018-07-11 · WS 2018 7 · Hai Pham, Thomas Manzini, Paul Pu Liang, Barnabas Poczos

Multimodal machine learning is a core research area spanning the language, visual and acoustic modalities. The central challenge in multimodal learning involves learning representations that can process and relate inform…

Multimodal Sentiment AnalysisSentiment AnalysisTranslation