paper-with-me

홈 › Papers

A Mixture of Experts Foundation Model for Scanning Electron Microscopy Image Analysis

2026-04-07 · Sk Miraj Ahmed, Yuewei Lin, Chuntian Cao, Shinjae Yoo, Xinpei Wu, Won-Il Lee, Nikhil Tiwale, Dan N. Le, Thi Thu Huong Chu, Jiyoung Kim, Kevin G. Yager, Chang-Yong Nam arxiv

Scanning Electron Microscopy (SEM) is indispensable in modern materials science, enabling high-resolution imaging across a wide range of structural, chemical, and functional investigations. However, SEM imaging remains constrained by task-specific models and labor-intensive acquisition processes that limit its scalability across diverse applications. Here, we introduce the first foundation model for SEM images, pretrained on a large corpus of multi-instrument, multi-condition scientific micrographs, enabling generalization across diverse material systems and imaging conditions. Leveraging a self-supervised transformer architecture, our model learns rich and transferable representations that can be fine-tuned or adapted to a wide range of downstream tasks. As a compelling demonstration, we focus on defocus-to-focus image translation-an essential yet underexplored challenge in automated microscopy pipelines. Our method not only restores focused detail from defocused inputs without paired supervision but also outperforms state-of-the-art techniques across multiple evaluation metrics. This work lays the groundwork for a new class of adaptable SEM models, accelerating materials discovery by bridging foundational representation learning with real-world imaging needs.

📄 PDF Abstract BibTeX arXiv:2604.05960

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Compressed Sensing of Scanning Transmission Electron Microscopy (STEM) on Non-Rectangular Scans

2018-05-13 · Xin Li, Ondrej Dyck, Sergei V. Kalinin, Stephen Jesse

Scanning Transmission Electron Microscopy (STEM) has become the main stay for materials characterization on atomic level, with applications ranging from visualization of localized and extended defects to mapping order pa…

compressed sensing

The evolution of AI from image interpretation toward scientific inference in nanoparticle electron microscopy

2026-07-11 · Evropi Toulkeridou, Jiafei Li, Leonardo Lari, Panagiotis Grammatikopoulos arxiv

Artificial intelligence (AI) is transforming electron microscopy by enabling quantitative analysis of increasingly large and complex datasets for nanoparticle characterization. Recent advances in machine learning (ML) an…

Self-Supervised Learning

How should a fixed budget of dwell time be spent in scanning electron microscopy to optimize image quality?

2018-01-12 · Patrick Trampert, Faysal Bourghorbel, Pavel Potocek, Maurice Peemen 외

In scanning electron microscopy, the achievable image quality is often limited by a maximum feasible acquisition time per dataset. Particularly with regard to three-dimensional or large field-of-view imaging, a compromis…

DenoisingSuper-Resolution

Segmentation of scanning electron microscopy images from natural rubber samples with gold nanoparticles using starlet wavelets

2016-06-12 · Alexandre Fioravante de Siqueira, Flávio Camargo Cabrera, Aylton Pagamisse, Aldo Eloizo Job

Electronic microscopy has been used for morphology evaluation of different materials structures. However, microscopy results may be affected by several factors. Image processing methods can be used to correct and improve…

Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis

2024-08-27 · Sakhinana Sagar Srinivas, Chidaksh Ravuru, Geethan Sannidhi, Venkataramana Runkana

Semiconductors, crucial to modern electronics, are generally under-researched in foundational models. It highlights the need for research to enhance the semiconductor device technology portfolio and aid in high-end devic…

Instruction FollowingLanguage ModelingLanguage ModellingMixture-of-Experts