paper-with-me

Papers

Active learning using adaptable task-based prioritisation

2022-12-03 · Shaheer U. Saeed, João Ramalhinho, Mark Pinnock, Ziyi Shen, Yunguan Fu, Nina Montaña-Brown, Ester Bonmati, Dean C. Barratt, Stephen P. Pereira, Brian Davidson, Matthew J. Clarkson, Yipeng Hu

Supervised machine learning-based medical image computing applications necessitate expert label curation, while unlabelled image data might be relatively abundant. Active learning methods aim to prioritise a subset of available image data for expert annotation, for label-efficient model training. We develop a controller neural network that measures priority of images in a sequence of batches, as in batch-mode active learning, for multi-class segmentation tasks. The controller is optimised by rewarding positive task-specific performance gain, within a Markov decision process (MDP) environment that also optimises the task predictor. In this work, the task predictor is a segmentation network. A meta-reinforcement learning algorithm is proposed with multiple MDPs, such that the pre-trained controller can be adapted to a new MDP that contains data from different institutes and/or requires segmentation of different organs or structures within the abdomen. We present experimental results using multiple CT datasets from more than one thousand patients, with segmentation tasks of nine different abdominal organs, to demonstrate the efficacy of the learnt prioritisation controller function and its cross-institute and cross-organ adaptability. We show that the proposed adaptable prioritisation metric yields converging segmentation accuracy for the novel class of kidney, unseen in training, using between approximately 40\% to 60\% of labels otherwise required with other heuristic or random prioritisation metrics. For clinical datasets of limited size, the proposed adaptable prioritisation offers a performance improvement of 22.6\% and 10.2\% in Dice score, for tasks of kidney and liver vessel segmentation, respectively, compared to random prioritisation and alternative active sampling strategies.

📄 PDF Abstract BibTeX arXiv:2212.01703

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningMeta Reinforcement LearningSegmentation

Similar Papers 제목 키워드 기반

Active PETs: Active Data Annotation Prioritisation for Few-Shot Claim Verification with Pattern Exploiting Training

2022-08-18 · Xia Zeng, Arkaitz Zubiaga

To mitigate the impact of the scarcity of labelled data on fact-checking systems, we focus on few-shot claim verification. Despite recent work on few-shot classification by proposing advanced language models, there is a …

Active LearningClaim VerificationFact Checking

Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search

2022-12-18 · Shuai Wang, Harrisen Scells, Bevan Koopman, Guido Zuccon

Medical systematic reviews typically require assessing all the documents retrieved by a search. The reason is two-fold: the task aims for ``total recall''; and documents retrieved using Boolean search are an unordered se…

Document Ranking

Dense Retrieval with Continuous Explicit Feedback for Systematic Review Screening Prioritisation

2024-06-30 · Xinyu Mao, Shengyao Zhuang, Bevan Koopman, Guido Zuccon

The goal of screening prioritisation in systematic reviews is to identify relevant documents with high recall and rank them in early positions for review. This saves reviewing effort if paired with a stopping criterion, …

RetrievalTAR

GARL: Game-Theoretic Reinforcement Learning for Multi-Agent Strategic Prioritisation

2026-06-03 · Yuxiao Ye, Yiwen Zhang, Huiyuan Xie, Yuqin Huang 외 arxiv

LLM-based multi-agent systems are increasingly used for strategic decision-making tasks. In such settings, performance depends not only on individual model capabilities, but also on the policies by which agents interact …

Multi-agent Reinforcement Learning

DenseReviewer: A Screening Prioritisation Tool for Systematic Review based on Dense Retrieval

2025-02-05 · Xinyu Mao, Teerapong Leelanupab, Harrisen Scells, Guido Zuccon

Screening is a time-consuming and labour-intensive yet required task for medical systematic reviews, as tens of thousands of studies often need to be screened. Prioritising relevant studies to be screened allows downstre…

Active Learning