paper-with-me

Papers

Computational 3D topographic microscopy from terabytes of data per sample

2023-06-05 · Kevin C. Zhou, Mark Harfouche, Maxwell Zheng, Joakim Jönsson, Kyung Chul Lee, Ron Appel, Paul Reamey, Thomas Doman, Veton Saliu, Gregor Horstmeyer, Roarke Horstmeyer

We present a large-scale computational 3D topographic microscope that enables 6-gigapixel profilometric 3D imaging at micron-scale resolution across $>$110 cm$^2$ areas over multi-millimeter axial ranges. Our computational microscope, termed STARCAM (Scanning Topographic All-in-focus Reconstruction with a Computational Array Microscope), features a parallelized, 54-camera architecture with 3-axis translation to capture, for each sample of interest, a multi-dimensional, 2.1-terabyte (TB) dataset, consisting of a total of 224,640 9.4-megapixel images. We developed a self-supervised neural network-based algorithm for 3D reconstruction and stitching that jointly estimates an all-in-focus photometric composite and 3D height map across the entire field of view, using multi-view stereo information and image sharpness as a focal metric. The memory-efficient, compressed differentiable representation offered by the neural network effectively enables joint participation of the entire multi-TB dataset during the reconstruction process. To demonstrate the broad utility of our new computational microscope, we applied STARCAM to a variety of decimeter-scale objects, with applications ranging from cultural heritage to industrial inspection.

📄 PDF Abstract BibTeX arXiv:2306.02634

Code (0)

등록된 구현이 없습니다.

Tasks

3D Reconstruction

Similar Papers 제목 키워드 기반

A Bi-channel Aided Stitching of Atomic Force Microscopy Images

2025-03-11 · Huanhuan Zhao, Ruben Millan-Solsona, Marti Checa, Spenser R. Brown 외

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), …

Image Stitching

Multi-View Neural 3D Reconstruction of Micro-/Nanostructures with Atomic Force Microscopy

2024-01-21 · Shuo Chen, Mao Peng, Yijin Li, Bing-Feng Ju 외

Atomic Force Microscopy (AFM) is a widely employed tool for micro-/nanoscale topographic imaging. However, conventional AFM scanning struggles to reconstruct complex 3D micro-/nanostructures precisely due to limitations …

3D ReconstructionSurface Reconstruction

μ-Bench: A Vision-Language Benchmark for Microscopy Understanding

2024-07-01 · Alejandro Lozano, Jeffrey Nirschl, James Burgess, Sanket Rajan Gupte 외

Recent advances in microscopy have enabled the rapid generation of terabytes of image data in cell biology and biomedical research. Vision-language models (VLMs) offer a promising solution for large-scale biological imag…

Cell DetectionClassificationscientific discoveryVisual Question Answering (VQA)

The Berkeley Single Cell Computational Microscopy (BSCCM) Dataset

2024-02-09 · Henry Pinkard, Cherry Liu, Fanice Nyatigo, Daniel A. Fletcher 외

Computational microscopy, in which hardware and algorithms of an imaging system are jointly designed, shows promise for making imaging systems that cost less, perform more robustly, and collect new types of information. …

TDSNNs: Competitive Topographic Deep Spiking Neural Networks for Visual Cortex Modeling

2025-08-06 · Deming Zhou, Yuetong Fang, Zhaorui Wang, Renjing Xu arxiv

The primate visual cortex exhibits topographic organization, where functionally similar neurons are spatially clustered, a structure widely believed to enhance neural processing efficiency. While prior works have demonst…

Object Recognition