paper-with-me

Papers

Segment Anything Model for Zero-shot Single Particle Tracking in Liquid Phase Transmission Electron Microscopy

2025-01-06 · Risha Goel, Zain Shabeeb, Isabel Panicker, Vida Jamali

Liquid phase transmission electron microscopy (LPTEM) offers an unparalleled combination of spatial and temporal resolution, making it a promising tool for single particle tracking at the nanoscale. However, the absence of a standardized framework for identifying and tracking nanoparticles in noisy LPTEM videos has impeded progress in the field to develop this technique as a single particle tracking tool. To address this, we leveraged Segment Anything Model 2 (SAM 2), released by Meta, which is a foundation model developed for segmenting videos and images. Here, we demonstrate that SAM 2 can successfully segment LPTEM videos in a zero-shot manner and without requiring fine-tuning. Building on this capability, we introduce SAM4EM, a comprehensive framework that integrates promptable video segmentation with particle tracking and statistical analysis, providing an end-to-end LPTEM analysis framework for single particle tracking. SAM4EM achieves nearly 50-fold higher accuracy in segmenting and analyzing LPTEM videos compared to state-of-the-art methods, paving the way for broader applications of LPTEM in nanoscale imaging.

📄 PDF Abstract BibTeX arXiv:2501.03153

Code (1)

jamalilab/sam4em 공식 구현 pytorch

Tasks

Video SegmentationVideo Semantic Segmentation

Methods 이 논문이 사용한 방법론

SAM 설명 없음

Similar Papers 제목 키워드 기반

Zero-Shot Surgical Tool Segmentation in Monocular Video Using Segment Anything Model 2

2024-08-03 · Ange Lou, Yamin Li, Yike Zhang, Robert F. Labadie 외

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 5…

DiversitySegmentationVideo SegmentationVideo Semantic Segmentation+1

Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation

2024-11-28 · Finlay G. C. Hudson, William A. P. Smith

We present Track Anything Behind Everything (TABE), a novel dataset, pipeline, and evaluation framework for zero-shot amodal completion from visible masks. Unlike existing methods that require pretrained class labels, ou…

3D ReconstructionSegmentationSemantic SegmentationVideo Object Segmentation+1

RobustSAM: Segment Anything Robustly on Degraded Images

2024-06-13 · CVPR 2024 1 · Wei-Ting Chen, Yu-Jiet Vong, Sy-Yen Kuo, Sizhuo Ma 외

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is cha…

DeblurringImage DehazingImage SegmentationSegmentation+4

Segment anything model for head and neck tumor segmentation with CT, PET and MRI multi-modality images

2024-02-27 · Jintao Ren, Mathis Rasmussen, Jasper Nijkamp, Jesper Grau Eriksen 외

Deep learning presents novel opportunities for the auto-segmentation of gross tumor volume (GTV) in head and neck cancer (HNC), yet fully automatic methods usually necessitate significant manual refinement. This study in…

SegmentationTumor SegmentationZero-shot Generalization

Segment Anything

2023-04-05 · ICCV 2023 1 · Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 외

We introduce the Segment Anything (SA) project: a new task, model, and dataset for image segmentation. Using our efficient model in a data collection loop, we built the largest segmentation dataset to date (by far), with…

Event-based Object SegmentationImage SegmentationRobot Manipulation GeneralizationSegmentation+3