paper-with-me

Papers

SpecTf: Transformers Enable Data-Driven Imaging Spectroscopy Cloud Detection

2025-01-09 · Jake H. Lee, Michael Kiper, David R. Thompson, Philip G. Brodrick

Current and upcoming generations of visible-shortwave infrared (VSWIR) imaging spectrometers promise unprecedented capacity to quantify Earth System processes across the globe. However, reliable cloud screening remains a fundamental challenge for these instruments, where traditional spatial and temporal approaches are limited by cloud variability and limited temporal coverage. The Spectroscopic Transformer (SpecTf) addresses these challenges with a spectroscopy-specific deep learning architecture that performs cloud detection using only spectral information (no spatial or temporal data are required). By treating spectral measurements as sequences rather than image channels, SpecTf learns fundamental physical relationships without relying on spatial context. Our experiments demonstrate that SpecTf significantly outperforms the current baseline approach implemented for the EMIT instrument, and performs comparably with other machine learning methods with orders of magnitude fewer learned parameters. Critically, we demonstrate SpecTf's inherent interpretability through its attention mechanism, revealing physically meaningful spectral features the model has learned. Finally, we present SpecTf's potential for cross-instrument generalization by applying it to a different instrument on a different platform without modifications, opening the door to instrument agnostic data driven algorithms for future imaging spectroscopy tasks.

📄 PDF Abstract BibTeX arXiv:2501.04916

Code (1)

emit-sds/SpecTf 공식 구현 pytorch

Tasks

Cloud Detection

Methods 이 논문이 사용한 방법론

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

SpectFormer: Frequency and Attention is what you need in a Vision Transformer

2023-04-13 · Badri N. Patro, Vinay P. Namboodiri, Vijay Srinivas Agneeswaran

Vision transformers have been applied successfully for image recognition tasks. There have been either multi-headed self-attention based (ViT \cite{dosovitskiy2020image}, DeIT, \cite{touvron2021training}) similar to the …

Instance Segmentationobject-detectionObject DetectionSemantic Segmentation+1

Live Target Detection with Deep Learning Neural Network and Unmanned Aerial Vehicle on Android Mobile Device

2018-03-19 · Ali Canberk Anar, Erkan Bostanci, Mehmet Serdar Guzel

This paper describes the stages faced during the development of an Android program which obtains and decodes live images from DJI Phantom 3 Professional Drone and implements certain features of the TensorFlow Android Cam…

Pardon the Interruption: Automatic Analysis of Gender and Competitive Turn-Taking in United States Supreme Court Hearings

2019-08-01 · WS 2019 8 · Haley Lepp

The United States Supreme Court plays a key role in defining the legal basis for gender discrimination throughout the country, yet there are few checks on gender bias within the court itself. In conversational turn-takin…

MIND: Multimodal Intent-Driven Network via Diffusion Transformers for Medical Image Fusion

2026-07-30 · Yunzhan Fu, Xiangyu Shen, Yifei Sun, Yuhan Chen 외 arxiv

Medical image fusion aims to integrate complementary information from diverse imaging modalities to support clinical diagnosis. Existing methods typically apply uniform fusion rules globally, lacking a deep understanding…

Brain Tumor Segmentation

IRIS: Learning-Driven Task-Specific Cinema Robot Arm for Visuomotor Motion Control

2026-02-19 · Qilong Cheng, Matthew Mackay, Ali Bereyhi arxiv

Robotic camera systems enable dynamic, repeatable motion beyond human capabilities, yet their adoption remains limited by the high cost and operational complexity of industrial-grade platforms. We present the Intelligent…