paper-with-me

홈 › Papers

Automated Histopathology Report Generation via Pyramidal Feature Extraction and the UNI Foundation Model

2026-02-18 · Ahmet Halici, Ece Tugba Cebeci, Musa Balci, Mustafa Cini, Serkan Sokmen arxiv

Generating diagnostic text from histopathology whole slide images (WSIs) is challenging due to the gigapixel scale of the input and the requirement for precise, domain specific language. We propose a hierarchical vision language framework that combines a frozen pathology foundation model with a Transformer decoder for report generation. To make WSI processing tractable, we perform multi resolution pyramidal patch selection (downsampling factors 2^3 to 2^6) and remove background and artifacts using Laplacian variance and HSV based criteria. Patch features are extracted with the UNI Vision Transformer and projected to a 6 layer Transformer decoder that generates diagnostic text via cross attention. To better represent biomedical terminology, we tokenize the output using BioGPT. Finally, we add a retrieval based verification step that compares generated reports with a reference corpus using Sentence BERT embeddings; if a high similarity match is found, the generated report is replaced with the retrieved ground truth reference to improve reliability.

📄 PDF Abstract BibTeX arXiv:2602.16422

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

HARE: an entity and relation centric evaluation framework for histopathology reports

2025-09-19 · Yunsoo Kim, Michal W. S. Ong, Alex Shavick, Honghan Wu 외 arxiv

Medical domain automated text generation is an active area of research and development; however, evaluating the clinical quality of generated reports remains a challenge, especially in instances where domain-specific met…

Relation ExtractionText Generation

HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction

2024-03-08 · Zhengrui Guo, Jiabo Ma, Yingxue Xu, Yihui Wang 외

Histopathology serves as the gold standard in cancer diagnosis, with clinical reports being vital in interpreting and understanding this process, guiding cancer treatment and patient care. The automation of histopatholog…

DiagnosticMedical Report GenerationMultiple Instance LearningSurvival Analysis+2

Leveraging large language models for structured information extraction from pathology reports

2025-02-14 · Jeya Balaji Balasubramanian, Daniel Adams, Ioannis Roxanis, Amy Berrington de Gonzalez 외

Background: Structured information extraction from unstructured histopathology reports facilitates data accessibility for clinical research. Manual extraction by experts is time-consuming and expensive, limiting scalabil…

Automatic Report Generation for Histopathology images using pre-trained Vision Transformers

2023-11-10 · Saurav Sengupta, Donald E. Brown

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challeng…

DecoderImage SegmentationSemantic Segmentationzero-shot-classification+1

Automatic Report Generation for Histopathology images using pre-trained Vision Transformers and BERT

2023-12-03 · Saurav Sengupta, Donald E. Brown

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a c…

Caption GenerationDecoderHistopathological Image ClassificationImage Captioning+4