paper-with-me

Papers

Multi-scale attention-based instance segmentation for measuring crystals with large size variation

2024-01-08 · Theresa Neubauer, Astrid Berg, Maria Wimmer, Dimitrios Lenis, David Major, Philip Matthias Winter, Gaia Romana De Paolis, Johannes Novotny, Daniel Lüftner, Katja Reinharter, Katja Bühler

Quantitative measurement of crystals in high-resolution images allows for important insights into underlying material characteristics. Deep learning has shown great progress in vision-based automatic crystal size measurement, but current instance segmentation methods reach their limits with images that have large variation in crystal size or hard to detect crystal boundaries. Even small image segmentation errors, such as incorrectly fused or separated segments, can significantly lower the accuracy of the measured results. Instead of improving the existing pixel-wise boundary segmentation methods, we propose to use an instance-based segmentation method, which gives more robust segmentation results to improve measurement accuracy. Our novel method enhances flow maps with a size-aware multi-scale attention module. The attention module adaptively fuses information from multiple scales and focuses on the most relevant scale for each segmented image area. We demonstrate that our proposed attention fusion strategy outperforms state-of-the-art instance and boundary segmentation methods, as well as simple average fusion of multi-scale predictions. We evaluate our method on a refractory raw material dataset of high-resolution images with large variation in crystal size and show that our model can be used to calculate the crystal size more accurately than existing methods.

📄 PDF Abstract BibTeX arXiv:2401.03939

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationInstance SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Images

2021-07-25 · Tianyang Zhang, Xiangrong Zhang, Peng Zhu, Xu Tang 외

In this paper, we focus on the challenging multicategory instance segmentation problem in remote sensing images (RSIs), which aims at predicting the categories of all instances and localizing them with pixel-level masks.…

Instance SegmentationSegmentationSemantic Segmentation

A Mask Attention Interaction and Scale Enhancement Network for SAR Ship Instance Segmentation

2022-07-08 · Tianwen Zhang, Xiaoling Zhang

Most of existing synthetic aperture radar (SAR) ship in-stance segmentation models do not achieve mask interac-tion or offer limited interaction performance. Besides, their multi-scale ship instance segmentation performa…

Instance SegmentationSegmentationSemantic SegmentationSingle Particle Analysis

A Lightweight Multi-Scale Attention Framework for Real-Time Spinal Endoscopic Instance Segmentation

2025-12-26 · Qi Lai, JunYan Li, Qiang Cai, Lei Wang 외 arxiv

Real-time instance segmentation for spinal endoscopy is important for identifying and protecting critical anatomy during surgery, but it is difficult because of the narrow field of view, specular highlights, smoke/bleedi…

Real-time Instance Segmentation

MSTA3D: Multi-scale Twin-attention for 3D Instance Segmentation

2024-11-04 · Duc Dang Trung Tran, Byeongkeun Kang, Yeejin Lee

Recently, transformer-based techniques incorporating superpoints have become prevalent in 3D instance segmentation. However, they often encounter an over-segmentation problem, especially noticeable with large objects. Ad…

3D Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation

ASF-YOLO: A Novel YOLO Model with Attentional Scale Sequence Fusion for Cell Instance Segmentation

2023-12-11 · Ming Kang, Chee-Ming Ting, Fung Fung Ting, Raphaël C. -W. Phan

We propose a novel Attentional Scale Sequence Fusion based You Only Look Once (YOLO) framework (ASF-YOLO) which combines spatial and scale features for accurate and fast cell instance segmentation. Built on the YOLO segm…

Instance SegmentationPositionSegmentationSemantic Segmentation