paper-with-me

홈 › Papers

Crowdsourcing with Enhanced Data Quality Assurance: An Efficient Approach to Mitigate Resource Scarcity Challenges in Training Large Language Models for Healthcare

2024-05-16 · P. Barai, G. Leroy, P. Bisht, J. M. Rothman, S. Lee, J. Andrews, S. A. Rice, A. Ahmed

Large Language Models (LLMs) have demonstrated immense potential in artificial intelligence across various domains, including healthcare. However, their efficacy is hindered by the need for high-quality labeled data, which is often expensive and time-consuming to create, particularly in low-resource domains like healthcare. To address these challenges, we propose a crowdsourcing (CS) framework enriched with quality control measures at the pre-, real-time-, and post-data gathering stages. Our study evaluated the effectiveness of enhancing data quality through its impact on LLMs (Bio-BERT) for predicting autism-related symptoms. The results show that real-time quality control improves data quality by 19 percent compared to pre-quality control. Fine-tuning Bio-BERT using crowdsourced data generally increased recall compared to the Bio-BERT baseline but lowered precision. Our findings highlighted the potential of crowdsourcing and quality control in resource-constrained environments and offered insights into optimizing healthcare LLMs for informed decision-making and improved patient care.

📄 PDF Abstract BibTeX arXiv:2405.13030

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Crowd Access Path Optimization: Diversity Matters

2015-08-08 · Besmira Nushi, Adish Singla, Anja Gruenheid, Erfan Zamanian 외

Quality assurance is one the most important challenges in crowdsourcing. Assigning tasks to several workers to increase quality through redundant answers can be expensive if asking homogeneous sources. This limitation ha…

Diversity

Radiologist-in-the-Loop Self-Training for Generalizable CT Metal Artifact Reduction

2025-01-26 · Chenglong Ma, Zilong Li, Yuanlin Li, Jing Han 외

Metal artifacts in computed tomography (CT) images can significantly degrade image quality and impede accurate diagnosis. Supervised metal artifact reduction (MAR) methods, trained using simulated datasets, often struggl…

Computed Tomography (CT)Metal Artifact Reduction

Crowdsourcing via Annotator Co-occurrence Imputation and Provable Symmetric Nonnegative Matrix Factorization

2021-06-14 · Shahana Ibrahim, Xiao Fu

Unsupervised learning of the Dawid-Skene (D&S) model from noisy, incomplete and crowdsourced annotations has been a long-standing challenge, and is a critical step towards reliably labeling massive data. A recent work ta…

Imputation

Understand Customer Behavior And Complaints Eight areas of quantifiable data can be integrated into quality assurance decisions

2023-01-01 · QUAL ITY PROGRESS 2023 1 · John Goodman, Steve Newman

USTOMER COMPLAINTS PROVIDE valuable quality assurance, service and marketing data. But the challenge is to use the data to make decisions that result in substantive action. To use complaint data to solve problems in…

Marketing

Enhanced Nearest Neighbor Classification for Crowdsourcing

2022-02-26 · Jiexin Duan, Xingye Qiao, Guang Cheng

In machine learning, crowdsourcing is an economical way to label a large amount of data. However, the noise in the produced labels may deteriorate the accuracy of any classification method applied to the labelled data. W…

Classification