paper-with-me

홈 › Papers

SeisCLIP: A seismology foundation model pre-trained by multi-modal data for multi-purpose seismic feature extraction

2023-09-05 · Xu Si, Xinming Wu, Hanlin Sheng, Jun Zhu, Zefeng Li

Training specific deep learning models for particular tasks is common across various domains within seismology. However, this approach encounters two limitations: inadequate labeled data for certain tasks and limited generalization across regions. To address these challenges, we develop SeisCLIP, a seismology foundation model trained through contrastive learning from multi-modal data. It consists of a transformer encoder for extracting crucial features from time-frequency seismic spectrum and an MLP encoder for integrating the phase and source information of the same event. These encoders are jointly pre-trained on a vast dataset and the spectrum encoder is subsequently fine-tuned on smaller datasets for various downstream tasks. Notably, SeisCLIP's performance surpasses that of baseline methods in event classification, localization, and focal mechanism analysis tasks, employing distinct datasets from different regions. In conclusion, SeisCLIP holds significant potential as a foundational model in the field of seismology, paving the way for innovative directions in foundation-model-based seismology research.

📄 PDF Abstract BibTeX arXiv:2309.02320

Code (1)

sixu0/SeisCLIP 공식 구현 pytorch

Tasks

Contrastive Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model

2025-02-27 · Xinghao Wang, Feng Liu, Rui Su, Zhihui Wang 외

Recent advances in deep learning have revolutionized seismic monitoring, yet developing a foundation model that performs well across multiple complex tasks remains challenging, particularly when dealing with degraded sig…

Language ModelingLanguage ModellingLarge Language Model

MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding

2026-05-25 · Sai Munikoti, Ian Stewart, Chengping Chai, Lisa Linville 외 arxiv

The application of generalist multimodal models (GMMs) to specialized scientific domains remains limited due to the scarcity of comprehensive domain-specific datasets that integrate multiple data modalities beyond text a…

Information RetrievalMultimodal Reasoning

On Foundation Models for Temporal Point Processes to Accelerate Scientific Discovery

2025-10-14 · David Berghaus, Patrick Seifner, Kostadin Cvejoski, Ramses J. Sanchez arxiv

Many scientific fields, from medicine to seismology, rely on analyzing sequences of events over time to understand complex systems. Traditionally, machine learning models must be built and trained from scratch for each n…

Point Processes

Building The Ph(ysical)AI Layer Of Machine Intelligence

2026-06-02 · Ulbert Jose Botero, Liam Smith, Brooks Olney, Pooya Khorrami 외 arxiv

Foundation models achieve generalization through massive-scale training on diverse data, but have limitations with transfer to truly unseen domains without paired training data. We propose principle-driven foundation mod…

Speaker Recognition

SPT: Spectral Transformer for Red Giant Stars Age and Mass Estimation

2024-01-10 · Mengmeng Zhang, Fan Wu, Yude Bu, Shanshan Li 외

The age and mass of red giants are essential for understanding the structure and evolution of the Milky Way. Traditional isochrone methods for these estimations are inherently limited due to overlapping isochrones in the…

Astronomy