paper-with-me

홈 › Papers

Knowledge Elicitation with Large Language Models for Interpretable Cancer Stage Identification from Pathology Reports

2025-11-02 · Yeawon Lee, Christopher C. Yang, Chia-Hsuan Chang, Grace Lu-Yao arxiv

Cancer staging is critical for patient prognosis and treatment planning, yet extracting pathologic TNM staging from unstructured pathology reports poses a persistent challenge. Existing natural language processing (NLP) and machine learning (ML) strategies often depend on large annotated datasets, limiting their scalability and adaptability. In this study, we introduce two Knowledge Elicitation methods designed to overcome these limitations by enabling large language models (LLMs) to induce and apply domain-specific rules for cancer staging. The first, Knowledge Elicitation with Long-Term Memory (KEwLTM), uses an iterative prompting strategy to derive staging rules directly from unannotated pathology reports, without requiring ground-truth labels. The second, Knowledge Elicitation with Retrieval-Augmented Generation (KEwRAG), employs a variation of RAG where rules are pre-extracted from relevant guidelines in a single step and then applied, enhancing interpretability and avoiding repeated retrieval overhead. We leverage the ability of LLMs to apply broad knowledge learned during pre-training to new tasks. Using breast cancer pathology reports from the TCGA dataset, we evaluate their performance in identifying T and N stages, comparing them against various baseline approaches on two open-source LLMs. Our results indicate that KEwLTM outperforms KEwRAG when Zero-Shot Chain-of-Thought (ZSCOT) inference is effective, whereas KEwRAG achieves better performance when ZSCOT inference is less effective. Both methods offer transparent, interpretable interfaces by making the induced rules explicit. These findings highlight the promise of our Knowledge Elicitation methods as scalable, high-performing solutions for automated cancer staging with enhanced interpretability, particularly in clinical settings with limited annotated data.

📄 PDF Abstract BibTeX arXiv:2511.01052

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Improving drug sensitivity predictions in precision medicine through active expert knowledge elicitation

2017-05-09 · Iiris Sundin, Tomi Peltola, Muntasir Mamun Majumder, Pedram Daee 외

Predicting the efficacy of a drug for a given individual, using high-dimensional genomic measurements, is at the core of precision medicine. However, identifying features on which to base the predictions remains a challe…

Experimental DesignSensitivity

ElicitationGPT: Text Elicitation Mechanisms via Language Models

2024-06-13 · Yifan Wu, Jason Hartline

Scoring rules evaluate probabilistic forecasts of an unknown state against the realized state and are a fundamental building block in the incentivized elicitation of information and the training of machine learning model…

Language ModelingLanguage ModellingLarge Language Model

NeuReasoner: Theory-grounded Mapping of Reasoning Elicitation Boundaries

2026-06-29 · Aydin Javadov, Shyngys Aitkazinov, Tobias Hoesli, Florian von Wangenheim 외 arxiv

A growing body of work suggests that the reasoning capabilities of large language models are largely latent in their base form, with post-training primarily amplifying rather than introducing them. However, this evidence…

Arithmetic ReasoningCode GenerationDecision Making

Eliciting Secret Knowledge from Language Models

2025-10-01 · Bartosz Cywiński, Emil Ryd, Rowan Wang, Senthooran Rajamanoharan 외 arxiv

We study secret elicitation: discovering knowledge that an AI possesses but does not explicitly verbalize. As a testbed, we train three families of large language models (LLMs) to possess specific knowledge that they app…

Challenges with unsupervised LLM knowledge discovery

2023-12-15 · Sebastian Farquhar, Vikrant Varma, Zachary Kenton, Johannes Gasteiger 외

We show that existing unsupervised methods on large language model (LLM) activations do not discover knowledge -- instead they seem to discover whatever feature of the activations is most prominent. The idea behind unsup…

Language ModelingLanguage ModellingLarge Language Model