paper-with-me

Papers

Universal Spectral Tokenization via Self-Supervised Panchromatic Representation Learning

2025-10-20 · Jeff Shen, Francois Lanusse, Liam Holden Parker, Ollie Liu, Tom Hehir, Leopoldo Sarra, Lucas Meyer, Micah Bowles, Sebastian Wagner-Carena, Sebastian Wagner-Carena, Helen Qu, Siavash Golkar, Alberto Bietti, Hatim Bourfoune, Nathan Cassereau, Pierre Cornette, Keiya Hirashima, Geraud Krawezik, Ruben Ohana, Nicholas Lourie, Michael McCabe, Rudy Morel, Payel Mukhopadhyay, Mariel Pettee, Bruno Régaldo-Saint Blancard, Kyunghyun Cho, Miles Cranmer, Shirley Ho arxiv

Sequential scientific data span many resolutions and domains, and unifying them into a common representation is a key step toward developing foundation models for the sciences. Astronomical spectra exemplify this challenge: massive surveys have collected millions of spectra across a wide range of wavelengths and resolutions, yet analyses remain fragmented across spectral domains (e.g., optical vs. infrared) and object types (e.g., stars vs. galaxies), limiting the ability to pool information across datasets. We present a deep learning model that jointly learns from heterogeneous spectra in a self-supervised manner. Our universal spectral tokenizer processes spectra from a variety of object types and resolutions directly on their native wavelength grids, producing intrinsically aligned, homogeneous, and physically meaningful representations that can be efficiently adapted to achieve competitive performance across a range of downstream tasks. For the first time, we demonstrate that a single model can unify spectral data across resolutions and domains, suggesting that our model can serve as a powerful building block for foundation models in astronomy -- and potentially extend to other scientific domains with heterogeneous sequential data, such as climate and healthcare.

📄 PDF Abstract BibTeX arXiv:2510.17959

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

SpectraMorph: Structured Latent Learning for Self-Supervised Hyperspectral Super-Resolution

2025-10-23 · Ritik Shah, Marco F Duarte arxiv

Hyperspectral sensors capture dense spectra per pixel but suffer from low spatial resolution, causing blurred boundaries and mixed-pixel effects. Co-registered companion sensors such as multispectral, RGB, or panchromati…

Fusion of Hyperspectral and Panchromatic Images using Spectral Uumixing Results

2013-10-22 · Roozbeh Rajabi, Hassan Ghassemian

Hyperspectral imaging, due to providing high spectral resolution images, is one of the most important tools in the remote sensing field. Because of technological restrictions hyperspectral sensors has a limited spatial r…

High-Speed Hyperspectral Video Acquisition With a Dual-Camera Architecture

2015-06-01 · CVPR 2015 6 · Lizhi Wang, Zhiwei Xiong, Dahua Gao, Guangming Shi 외

We propose a novel dual-camera design to acquire 4D high-speed hyperspectral (HSHS) videos with high spatial and spectral resolution. Our work has two key technical contributions. First, we build a dual-camera system tha…

Vocal Bursts Intensity Prediction

FusionRF: High-Fidelity Satellite Neural Radiance Fields from Multispectral and Panchromatic Acquisitions

2024-09-23 · Michael Sprintson, Rama Chellappa, Cheng Peng

We introduce FusionRF, a novel framework for digital surface reconstruction from satellite multispectral and panchromatic images. Current work has demonstrated the increased accuracy of neural photogrammetry for surface …

Neural RenderingNovel View SynthesisPansharpeningSurface Reconstruction

Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening

2026-08-12 · Pengwei Xie, Fei Zhu, Jiajun Li, Xiangyuan Liu 외 arxiv

Hyperspectral pansharpening aims to reconstruct a high resolution hyperspectral (HRHS) image from a panchromatic (PAN) image and a low resolution hyperspectral (LRHS) image while preserving both spatial details and spect…