TCuPGAN: A novel framework developed for optimizing human-machine interactions in citizen science
In the era of big data in scientific research, there is a necessity to leverage techniques which reduce human effort in labeling and categorizing large datasets by involving sophisticated machine tools. To combat this problem, we present a novel, general purpose model for 3D segmentation that leverages patch-wise adversariality and Long Short-Term Memory to encode sequential information. Using this model alongside citizen science projects which use 3D datasets (image cubes) on the Zooniverse platforms, we propose an iterative human-machine optimization framework where only a fraction of the 2D slices from these cubes are seen by the volunteers. We leverage the patch-wise discriminator in our model to provide an estimate of which slices within these image cubes have poorly generalized feature representations, and correspondingly poor machine performance. These images with corresponding machine proposals would be presented to volunteers on Zooniverse for correction, leading to a drastic reduction in the volunteer effort on citizen science projects. We trained our model on ~2300 liver tissue 3D electron micrographs. Lipid droplets were segmented within these images through human annotation via the `Etch A Cell - Fat Checker' citizen science project, hosted on the Zooniverse platform. In this work, we demonstrate this framework and the selection methodology which resulted in a measured reduction in volunteer effort by more than 60%. We envision this type of joint human-machine partnership will be of great use on future Zooniverse projects.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop
Training and deploying machine learning models relies on a large amount of human-annotated data. As human labeling becomes increasingly expensive and time-consuming, recent research has developed multiple strategies to s…
Active LearningVVC+M: Plug and Play Scalable Image Coding for Humans and Machines
Compression for machines is an emerging field, where inputs are encoded while optimizing the performance of downstream automated analysis. In scalable coding for humans and machines, the compressed representation used fo…
Image CompressionOptimizing human-interpretable dialog management policy using Genetic Algorithm
Automatic optimization of spoken dialog management policies that are robust to environmental noise has long been the goal for both academia and industry. Approaches based on reinforcement learning have been proved to be …
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF
Reinforcement Learning from Human Feedback (RLHF) is popular in large language models (LLMs), whereas traditional Reinforcement Learning (RL) often falls short. Current autonomous driving methods typically utilize either…
Autonomous Drivingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Tetra-AML: Automatic Machine Learning via Tensor Networks
Neural networks have revolutionized many aspects of society but in the era of huge models with billions of parameters, optimizing and deploying them for commercial applications can require significant computational and f…
Bayesian OptimizationHyperparameter OptimizationModel CompressionNeural Architecture Search+3