paper-with-me

홈 › Papers

Physics-based reward driven image analysis in microscopy

2024-04-22 · Kamyar Barakati, Hui Yuan, Amit Goyal, Sergei V. Kalinin

The rise of electron microscopy has expanded our ability to acquire nanometer and atomically resolved images of complex materials. The resulting vast datasets are typically analyzed by human operators, an intrinsically challenging process due to the multiple possible analysis steps and the corresponding need to build and optimize complex analysis workflows. We present a methodology based on the concept of a Reward Function coupled with Bayesian Optimization, to optimize image analysis workflows dynamically. The Reward Function is engineered to closely align with the experimental objectives and broader context and is quantifiable upon completion of the analysis. Here, cross-section, high-angle annular dark field (HAADF) images of ion-irradiated $(Y, Dy)Ba_2Cu_3O_{7-\delta}$ thin-films were used as a model system. The reward functions were formed based on the expected materials density and atomic spacings and used to drive multi-objective optimization of the classical Laplacian-of-Gaussian (LoG) method. These results can be benchmarked against the DCNN segmentation. This optimized LoG* compares favorably against DCNN in the presence of the additional noise. We further extend the reward function approach towards the identification of partially-disordered regions, creating a physics-driven reward function and action space of high-dimensional clustering. We pose that with correct definition, the reward function approach allows real-time optimization of complex analysis workflows at much higher speeds and lower computational costs than classical DCNN-based inference, ensuring the attainment of results that are both precise and aligned with the human-defined objectives.

📄 PDF Abstract BibTeX arXiv:2404.14146

Code (1)

kamyar-v2/rdw 공식 구현

Tasks

Bayesian Optimization

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
DCNN Diffusion-convolutional neural networks (DCNN) is a model for graph-structured data. Through the introduction of a diffusion-convolution operation, diffusion-based representations…

Similar Papers 제목 키워드 기반

SAM$^{*}$: Task-Adaptive SAM with Physics-Guided Rewards

2025-09-08 · Kamyar Barakati, Utkarsh Pratiush, Sheryl L. Sanchez, Aditya Raghavan 외 arxiv

Image segmentation is a critical task in microscopy, essential for accurately analyzing and interpreting complex visual data. This task can be performed using custom models trained on domain-specific datasets, transfer l…

Image SegmentationTransfer Learning

Unsupervised Reward-Driven Image Segmentation in Automated Scanning Transmission Electron Microscopy Experiments

2024-09-19 · Kamyar Barakati, Utkarsh Pratiush, Austin C. Houston, Gerd Duscher 외

Automated experiments in scanning transmission electron microscopy (STEM) require rapid image segmentation to optimize data representation for human interpretation, decision-making, site-selective spectroscopies, and ato…

Decision MakingImage SegmentationSemantic Segmentation

Reward driven workflows for unsupervised explainable analysis of phases and ferroic variants from atomically resolved imaging data

2024-11-19 · Kamyar Barakati, Yu Liu, Chris Nelson, Maxim A. Ziatdinov 외

Rapid progress in aberration corrected electron microscopy necessitates development of robust methods for the identification of phases, ferroic variants, and other pertinent aspects of materials structure from imaging da…

Rewards-based image analysis in microscopy

2025-02-23 · Kamyar Barakati, Yu Liu, Utkarsh Pratiush, Boris N. Slautin 외

Analyzing imaging and hyperspectral data is crucial across scientific fields, including biology, medicine, chemistry, and physics. The primary goal is to transform high-resolution or high-dimensional data into an interpr…

Decision MakingDenoisingDimensionality ReductionImage Segmentation+3

Machine Learning-Based Reward-Driven Tuning of Scanning Probe Microscopy: Towards Fully Automated Microscopy

2024-08-07 · Yu Liu, Roger Proksch, Jason Bemis, Utkarsh Pratiush 외

Since the dawn of scanning probe microscopy (SPM), tapping or intermittent contact mode has been one of the most widely used imaging modes. Manual optimization of tapping mode not only takes a lot of instrument and opera…

Decision Making