paper-with-me

홈 › Papers

DS@GT ARC at ImageCLEFmedical 2026: Architectural Diversity for Concept Detection and Foundation-Model Scaling for Caption Prediction in Medical Image Analysis

2026-07-30 · Bowen Wang, Youwen Zhang, Ritesh Mehta arxiv

We describe the DS@GT submissions to the ImageCLEFmedical Caption 2026 challenge, which continues a long-running benchmark on the ROCOv2 dataset with two tracks: Concept Detection (Task 1), assigning UMLS Concept Unique Identifiers (CUIs) to radiology images, and Caption Prediction (Task 2), generating natural-language captions. For Task 1, our primary submission was a three-way late-fusion ensemble of ConvNeXt-V2, BiomedCLIP ViT-B/16, and DenseNet-169 with a regularized ''Honest Threshold Tuning'' procedure designed to avoid validation overfitting on rare concepts; this submission ranked first on the official submission with a primary $F_1$ of $0.5790$ and a secondary $F_1$ of $0.9657$. In parallel, we submitted a training-free KNN retrieval pipeline over frozen BiomedCLIP embeddings, which reached a primary $F_1$ of $0.5780$ and a secondary $F_1$ of $0.9599$-essentially matching the fine-tuned ensemble on the primary track at a fraction of the cost. For Task 2, our submissions included a fine-tuned Gemma-3 27B model (overall $0.3571$, ranking third in the official submission), a fully fine-tuned BLIP pipeline with custom Vizwins merging ($0.3564$), and a zero-shot MedGemma-4B run with a PubMed-style prompt ($0.3186$), spanning a wide range of model scales and training costs. Code: https://github.com/dsgt-arc/imageclef-caption-2026.

📄 PDF Abstract BibTeX arXiv:2607.27763

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DS@BioMed at ImageCLEFmedical Caption 2024: Enhanced Attention Mechanisms in Medical Caption Generation through Concept Detection Integration

2024-06-01 · Nhi Ngoc-Yen Nguyen, Le-Huy Tu, Dieu-Phuong Nguyen, Nhat-Tan Do 외

Purpose: Our study presents an enhanced approach to medical image caption generation by integrating concept detection into attention mechanisms. Method: This method utilizes sophisticated models to identify critical conc…

Caption GenerationImage Captioning

ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset

2024-05-16 · Johannes Rückert, Louise Bloch, Raphael Brüngel, Ahmad Idrissi-Yaghir 외

Automated medical image analysis systems often require large amounts of training data with high quality labels, which are difficult and time consuming to generate. This paper introduces Radiology Object in COntext versio…

image-classificationImage ClassificationMedical Image AnalysisMulti-Label Image Classification+1

Improving Medical Report Generation with Adapter Tuning and Knowledge Enhancement in Vision-Language Foundation Models

2023-12-07 · Shibin Wu, Bang Yang, Zhiyu Ye, Haoqian Wang 외

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-s…

Domain AdaptationMedical Report Generation

BuildingWorld: A Structured 3D Building Dataset for Urban Foundation Models

2025-11-09 · Shangfeng Huang, Ruisheng Wang, Xin Wang arxiv

As digital twins become central to the transformation of modern cities, accurate and structured 3D building models emerge as a key enabler of high-fidelity, updatable urban representations. These models underpin diverse …

Point Clouds

SITS-DECO: A Generative Decoder Is All You Need For Multitask Satellite Image Time Series Modelling

2025-10-21 · Samuel J. Barrett, Docko Sow arxiv

Earth Observation (EO) Foundation Modelling (FM) holds great promise for simplifying and improving the use of EO data for diverse real-world tasks. However, most existing models require additional adaptation before they …