Early Experiences with Crowdsourcing Airway Annotations in Chest CT
Measuring airways in chest computed tomography (CT) images is important for characterizing diseases such as cystic fibrosis, yet very time-consuming to perform manually. Machine learning algorithms offer an alternative, but need large sets of annotated data to perform well. We investigate whether crowdsourcing can be used to gather airway annotations which can serve directly for measuring the airways, or as training data for the algorithms. We generate image slices at known locations of airways and request untrained crowd workers to outline the airway lumen and airway wall. Our results show that the workers are able to interpret the images, but that the instructions are too complex, leading to many unusable annotations. After excluding unusable annotations, quantitative results show medium to high correlations with expert measurements of the airways. Based on this positive experience, we describe a number of further research directions and provide insight into the challenges of crowdsourcing in medical images from the perspective of first-time users.
Code (0)
등록된 구현이 없습니다.
Tasks
Computed Tomography (CT)Similar Papers 제목 키워드 기반
Crowdsourcing Airway Annotations in Chest Computed Tomography Images
Measuring airways in chest computed tomography (CT) scans is important for characterizing diseases such as cystic fibrosis, yet very time-consuming to perform manually. Machine learning algorithms offer an alternative, b…
Computed Tomography (CT)Lung airway geometry as an early predictor of autism: A preliminary machine learning-based study
The goal of this study is to assess the feasibility of airway geometry as a biomarker for ASD. Chest CT images of children with a documented diagnosis of ASD as well as healthy controls were identified retrospectively. 5…
feature selectionSpecificityAugmenting Chest X-ray Datasets with Non-Expert Annotations
The advancement of machine learning algorithms in medical image analysis requires the expansion of training datasets. A popular and cost-effective approach is automated annotation extraction from free-text medical report…
DiagnosticMedical Image AnalysisAirway segmentation from 3D chest CT volumes based on volume of interest using gradient vector flow
Some lung diseases are related to bronchial airway structures and morphology. Although airway segmentation from chest CT volumes is an important task in the computer-aided diagnosis and surgery assistance systems for the…
SegmentationAutomatic Airway Segmentation in chest CT using Convolutional Neural Networks
Segmentation of the airway tree from chest computed tomography (CT) images is critical for quantitative assessment of airway diseases including bronchiectasis and chronic obstructive pulmonary disease (COPD). However, ob…
Computed Tomography (CT)Data AugmentationSegmentation