paper-with-me

Papers

Applying Vision Transformers on Spectral Analysis of Astronomical Objects

2025-05-30 · Luis Felipe Strano Moraes, Ignacio Becker, Pavlos Protopapas, Guillermo Cabrera-Vives

We apply pre-trained Vision Transformers (ViTs), originally developed for image recognition, to the analysis of astronomical spectral data. By converting traditional one-dimensional spectra into two-dimensional image representations, we enable ViTs to capture both local and global spectral features through spatial self-attention. We fine-tune a ViT pretrained on ImageNet using millions of spectra from the SDSS and LAMOST surveys, represented as spectral plots. Our model is evaluated on key tasks including stellar object classification and redshift ($z$) estimation, where it demonstrates strong performance and scalability. We achieve classification accuracy higher than Support Vector Machines and Random Forests, and attain $R^2$ values comparable to AstroCLIP's spectrum encoder, even when generalizing across diverse object types. These results demonstrate the effectiveness of using pretrained vision models for spectroscopic data analysis. To our knowledge, this is the first application of ViTs to large-scale, which also leverages real spectroscopic data and does not rely on synthetic inputs.

📄 PDF Abstract BibTeX arXiv:2506.00294

Code (1)

astromer-science/spectromer 공식 구현 pytorch

Similar Papers 제목 키워드 기반

AstroSpy: On detecting Fake Images in Astronomy via Joint Image-Spectral Representations

2024-07-09 · Mohammed Talha Alam, Raza Imam, Mohsen Guizani, Fakhri Karray

The prevalence of AI-generated imagery has raised concerns about the authenticity of astronomical images, especially with advanced text-to-image models like Stable Diffusion producing highly realistic synthetic samples. …

AstronomyMisinformation

Spectral Vision Transformer for Efficient Tokenization with Limited Data

2026-05-12 · Alexandra G. Roberts, Maneesh John, Jinwei Zhang, Dominick Romano 외 arxiv

We propose a novel spectral vision transformer architecture for efficient tokenization in limited data, with an emphasis on medical imaging. We outline convenient theoretical properties arising from the choice of basis i…

Multiresolution and Hierarchical Analysis of Astronomical Spectroscopic Cubes using 3D Discrete Wavelet Transform

2017-11-17 · Martín Villanueva, Mauricio Araya

The intrinsically hierarchical and blended structure of interstellar molecular clouds, plus the always increasing resolution of astronomical instruments, demand advanced and automated pattern recognition techniques for i…

SpectralKD: A Unified Framework for Interpreting and Distilling Vision Transformers via Spectral Analysis

2024-12-26 · Huiyuan Tian, Bonan Xu, Shijian Li, Gang Pan

Knowledge Distillation (KD) has achieved widespread success in compressing large Vision Transformers (ViTs), but a unified theoretical framework for both ViTs and KD is still lacking. In this paper, we propose SpectralKD…

Knowledge DistillationTransfer Learning

Hyperspectral and multispectral image fusion under spectrally varying spatial blurs -- Application to high dimensional infrared astronomical imaging

2019-12-26 · Claire Guilloteau, Thomas Oberlin, Olivier Berné, Nicolas Dobigeon

Hyperspectral imaging has become a significant source of valuable data for astronomers over the past decades. Current instrumental and observing time constraints allow direct acquisition of multispectral images, with hig…

Earth Observation