paper-with-me

홈 › Papers

Zero-shot System for Automatic Body Region Detection for Volumetric CT and MR Images

2026-02-09 · Farnaz Khun Jush, Grit Werner, Mark Klemens, Matthias Lenga arxiv

Reliable identification of anatomical body regions is a prerequisite for many automated medical imaging workflows, yet existing solutions remain heavily dependent on unreliable DICOM metadata. Current solutions mainly use supervised learning, which limits their applicability in many real-world scenarios. In this work, we investigate whether body region detection in volumetric CT and MR images can be achieved in a fully zero-shot manner by using knowledge embedded in large pre-trained foundation models. We propose and systematically evaluate three training-free pipelines: (1) a segmentation-driven rule-based system leveraging pre-trained multi-organ segmentation models, (2) a Multimodal Large Language Model (MLLM) guided by radiologist-defined rules, and (3) a segmentation-aware MLLM that combines visual input with explicit anatomical evidence. All methods are evaluated on 887 heterogeneous CT and MR scans with manually verified anatomical region labels. The segmentation-driven rule-based approach achieves the strongest and most consistent performance, with weighted F1-scores of 0.947 (CT) and 0.914 (MR), demonstrating robustness across modalities and atypical scan coverage. The MLLM performs competitively in visually distinctive regions, while the segmentation-aware MLLM reveals fundamental limitations.

📄 PDF Abstract BibTeX arXiv:2602.08717

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Zero-Shot Head Swapping in Real-World Scenarios

2025-03-02 · CVPR 2025 1 · SOHYUN JEONG, Taewoong Kang, Hyojin Jang, Jaegul Choo

With growing demand in media and social networks for personalized images, the need for advanced head-swapping techniques, integrating an entire head from the head image with the body from the body image, has increased. H…

A Generalized Zero-Shot Framework for Emotion Recognition from Body Gestures

2020-10-13 · Jinting Wu, Yujia Zhang, Xiaoguang Zhao, Wenbin Gao

Although automatic emotion recognition from facial expressions and speech has made remarkable progress, emotion recognition from body gestures has not been thoroughly explored. People often use a variety of body language…

Emotion ClassificationEmotion RecognitionGeneralized Zero-Shot LearningGesture Recognition+2

Towards Zero-shot Sign Language Recognition

2022-01-15 · Yunus Can Bilge, Ramazan Gokberk Cinbis, Nazli Ikizler-Cinbis

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, r…

AttributeDescriptiveSign Language RecognitionTransfer Learning+1

ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image

2023-05-25 · Zhenzhen Weng, Zeyu Wang, Serena Yeung

Recent advancements in text-to-image generation have enabled significant progress in zero-shot 3D shape generation. This is achieved by score distillation, a methodology that uses pre-trained text-to-image diffusion mode…

3D Shape GenerationImage GenerationImage to 3DNeRF+2

Zero-Shot Sign Language Recognition: Can Textual Data Uncover Sign Languages?

2019-07-24 · Yunus Can Bilge, Nazli Ikizler-Cinbis, Ramazan Gokberk Cinbis

We introduce the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign class examples to recognize the instances of unseen signs. To this end, we propose …

DescriptiveObject RecognitionSign Language RecognitionTransfer Learning+1