paper-with-me

홈 › Papers

SpeckleNN: A unified embedding for real-time speckle pattern classification in X-ray single-particle imaging with limited labeled examples

2023-02-14 · Cong Wang, Eric Florin, Hsing-Yin Chang, Jana Thayer, Chun Hong Yoon

With X-ray free-electron lasers (XFELs), it is possible to determine the three-dimensional structure of noncrystalline nanoscale particles using X-ray single-particle imaging (SPI) techniques at room temperature. Classifying SPI scattering patterns, or "speckles", to extract single hits that are needed for real-time vetoing and three-dimensional reconstruction poses a challenge for high data rate facilities like European XFEL and LCLS-II-HE. Here, we introduce SpeckleNN, a unified embedding model for real-time speckle pattern classification with limited labeled examples that can scale linearly with dataset size. Trained with twin neural networks, SpeckleNN maps speckle patterns to a unified embedding vector space, where similarity is measured by Euclidean distance. We highlight its few-shot classification capability on new never-seen samples and its robust performance despite only tens of labels per classification category even in the presence of substantial missing detector areas. Without the need for excessive manual labeling or even a full detector image, our classification method offers a great solution for real-time high-throughput SPI experiments.

📄 PDF Abstract BibTeX arXiv:2302.06895

Code (1)

carbonscott/speckleNN pytorch

Tasks

Classification

Similar Papers 제목 키워드 기반

FPGA-Accelerated SpeckleNN with SNL for Real-time X-ray Single-Particle Imaging

2025-02-27 · Abhilasha Dave, Cong Wang, James Russell, Ryan Herbst 외

We implement a specialized version of our SpeckleNN model for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI) using the SLAC Neural Network Library (SNL) on an FPGA. This hardware is optim…

GPU

Real Time Speckle Image De-Noising

2014-04-10 · D. Sachin Kumar, P. R. Seshadri, N. Vaishnav, Dr. Saraswathi Janaki

The paper presents real time speckle de-noising based on activity computation algorithm and wavelet transform. Speckles arise in an image when laser light is reflected from an illuminated surface. The process involves de…

Dense Pixel-wise Micro-motion Estimation of Object Surface by using Low Dimensional Embedding of Laser Speckle Pattern

2020-10-31 · Ryusuke Sagawa, Yusuke Higuchi, Hiroshi Kawasaki, Ryo Furukawa 외

This paper proposes a method of estimating micro-motion of an object at each pixel that is too small to detect under a common setup of camera and illumination. The method introduces an active-lighting approach to make th…

Motion Estimation

Multi-temporal speckle reduction with self-supervised deep neural networks

2022-07-22 · Inès Meraoumia, Emanuele Dalsasso, Loïc Denis, Rémy Abergel 외

Speckle filtering is generally a prerequisite to the analysis of synthetic aperture radar (SAR) images. Tremendous progress has been achieved in the domain of single-image despeckling. Latest techniques rely on deep neur…

Time Series Analysis

EdgeSRIE: A hybrid deep learning framework for real-time speckle reduction and image enhancement on portable ultrasound systems

2025-07-05 · Hyunwoo Cho, Jongsoo Lee, Jinbum Kang, Yangmo Yoo arxiv

Speckle patterns in ultrasound images often obscure anatomical details, leading to diagnostic uncertainty. Recently, various deep learning (DL)-based techniques have been introduced to effectively suppress speckle; howev…

Image Enhancement