ASTROCO: Self-Supervised Conformer-Style Transformers for Light-Curve Embeddings
We present AstroCo, a Conformer-style encoder for irregular stellar light curves. By combining attention with depthwise convolutions and gating, AstroCo captures both global dependencies and local features. On MACHO R-band, AstroCo outperforms Astromer v1 and v2, yielding 70 percent and 61 percent lower error respectively and a relative macro-F1 gain of about 7 percent, while producing embeddings that transfer effectively to few-shot classification. These results highlight AstroCo's potential as a strong and label-efficient foundation for time-domain astronomy.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Astroconformer: Inferring Surface Gravity of Stars from Stellar Light Curves with Transformer
We introduce Astroconformer, a Transformer-based model to analyze stellar light curves from the Kepler mission. We demonstrate that Astrconformer can robustly infer the stellar surface gravity as a supervised task. Impor…
Time SeriesTime Series AnalysisAstroconformer: The Prospects of Analyzing Stellar Light Curves with Transformer-Based Deep Learning Models
Stellar light curves contain valuable information about oscillations and granulation, offering insights into stars' internal structures and evolutionary states. Traditional asteroseismic techniques, primarily focused on …
RoBo6: Standardized MMT Light Curve Dataset for Rocket Body Classification
Space debris presents a critical challenge for the sustainability of future space missions, emphasizing the need for robust and standardized identification methods. However, a comprehensive benchmark for rocket body clas…
ClassificationConformer-Based Self-Supervised Learning for Non-Speech Audio Tasks
Representation learning from unlabeled data has been of major interest in artificial intelligence research. While self-supervised speech representation learning has been popular in the speech research community, very few…
Audio ClassificationRepresentation LearningSelf-Supervised LearningSpeech Representation LearningNeonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder
In this paper, we propose the MAEConformer, a novel self-supervised learning framework that combines the Conformer architecture with the Masked Autoencoder (MAE) paradigm for large-scale representation learning from unla…
Self-Supervised LearningRepresentation Learning