A Novel Methodology For Crowdsourcing AI Models in an Enterprise
The evolution of AI is advancing rapidly, creating both challenges and opportunities for industry-community collaboration. In this work, we present a novel methodology aiming to facilitate this collaboration through crowdsourcing of AI models. Concretely, we have implemented a system and a process that any organization can easily adopt to host AI competitions. The system allows them to automatically harvest and evaluate the submitted models against in-house proprietary data and also to incorporate them as reusable services in a product.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Methodology for Word Sense Disambiguation at 90\% based on large-scale CrowdSourcing
Milimili. Collecting Parallel Data via Crowdsourcing
We present a methodology for gathering a parallel corpus through crowdsourcing, which is more cost-effective than hiring professional translators, albeit at the expense of quality. Additionally, we have made available ex…
Crowdsourcing StoryLines: Harnessing the Crowd for Causal Relation Annotation
This paper describes a crowdsourcing experiment on the annotation of plot-like structures in English news articles. CrowdThruth methodology and metrics have been applied to select valid annotations from the crowd. We fur…
ArticlesRelationvalidWord Sense Inventories by Non-Experts.
In this paper, we explore different strategies for implementing a crowdsourcing methodology for a single-step construction of an empirically-derived sense inventory and the corresponding sense-annotated corpus. We report…
Word Sense Disambiguation