paper-with-me

홈 › Papers

PEAR: A Robust and Flexible Automation Framework for Ptychography Enabled by Multiple Large Language Model Agents

2024-10-11 · Xiangyu Yin, Chuqiao Shi, Yimo Han, Yi Jiang

Ptychography is an advanced computational imaging technique in X-ray and electron microscopy. It has been widely adopted across scientific research fields, including physics, chemistry, biology, and materials science, as well as in industrial applications such as semiconductor characterization. In practice, obtaining high-quality ptychographic images requires simultaneous optimization of numerous experimental and algorithmic parameters. Traditionally, parameter selection often relies on trial and error, leading to low-throughput workflows and potential human bias. In this work, we develop the "Ptychographic Experiment and Analysis Robot" (PEAR), a framework that leverages large language models (LLMs) to automate data analysis in ptychography. To ensure high robustness and accuracy, PEAR employs multiple LLM agents for tasks including knowledge retrieval, code generation, parameter recommendation, and image reasoning. Our study demonstrates that PEAR's multi-agent design significantly improves the workflow success rate, even with smaller open-weight models such as LLaMA 3.1 8B. PEAR also supports various automation levels and is designed to work with customized local knowledge bases, ensuring flexibility and adaptability across different research environments.

📄 PDF Abstract BibTeX arXiv:2410.09034

Code (1)

xyin-anl/Nodeology 공식 구현

Tasks

Code GenerationLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

Efficient and flexible approach to ptychography using an optimization framework based on automatic differentiation

2020-10-05 · Jacob Seifert, Dorian Bouchet, Lars Loetgering, Allard P. Mosk

Ptychography is a lensless imaging method that allows for wavefront sensing and phase-sensitive microscopy from a set of diffraction patterns. Recently, it has been shown that the optimization task in ptychography can be…

Deep learning at the edge enables real-time streaming ptychographic imaging

2022-09-20 · Anakha V Babu, Tao Zhou, Saugat Kandel, Tekin Bicer 외

Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells.…

Deep Ptych: Subsampled Fourier Ptychography using Generative Priors

2018-12-22 · Fahad Shamshad, Farwa Abbas, Ali Ahmed

This paper proposes a novel framework to regularize the highly ill-posed and non-linear Fourier ptychography problem using generative models. We demonstrate experimentally that our proposed algorithm, Deep Ptych, outperf…

A modular software framework for the design and implementation of ptychography algorithms

2022-05-06 · Francesco Guzzi, George Kourousias, Fulvio Billè, Roberto Pugliese 외

Computational methods are driving high impact microscopy techniques such as ptychography. However, the design and implementation of new algorithms is often a laborious process, as many parts of the code are written in cl…

GPUPosition

An Interactive, Automated 4D-STEM data acquisition and analysis routine for Scanning Electron Nanobeam Diffraction and Ptychography experiments

2026-08-13 · Mohsen Danaie, Max England, Yiming Xu, Ruomu Zhang 외 arxiv

Modern transmission electron microscopes are versatile instruments which have become indispensable tools for understanding structure and chemical composition at the nano- and atomic scale. In the physical sciences these …