paper-with-me

홈 › Papers

Competition and Collaboration in Crowdsourcing Communities: What happens when peers evaluate each other?

2024-04-22 · Christoph Riedl, Tom Grad, Christopher Lettl

Crowdsourcing has evolved as an organizational approach to distributed problem solving and innovation. As contests are embedded in online communities and evaluation rights are assigned to the crowd, community members face a tension: they find themselves exposed to both competitive motives to win the contest prize and collaborative participation motives in the community. The competitive motive suggests they may evaluate rivals strategically according to their self-interest, the collaborative motive suggests they may evaluate their peers truthfully according to mutual interest. Using field data from Threadless on 38 million peer evaluations of more than 150,000 submissions across 75,000 individuals over 10 years and two natural experiments to rule out alternative explanations, we answer the question of how community members resolve this tension. We show that as their skill level increases, they become increasingly competitive and shift from using self-promotion to sabotaging their closest competitors. However, we also find signs of collaborative behavior when high-skilled members show leniency toward those community members who do not directly threaten their chance of winning. We explain how the individual-level use of strategic evaluations translates into important organizational-level outcomes by affecting the community structure through individuals' long-term participation. While low-skill targets of sabotage are less likely to participate in future contests, high-skill targets are more likely. This suggests a feedback loop between competitive evaluation behavior and future participation. These findings have important implications for the literature on crowdsourcing design, and the evolution and sustainability of crowdsourcing communities.

📄 PDF Abstract BibTeX arXiv:2404.14141

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Novel Methodology For Crowdsourcing AI Models in an Enterprise

2021-03-22 · Parthasarathy Suryanarayanan, Sundar Saranathan, Shilpa Mahatma, Divya Pathak

The evolution of AI is advancing rapidly, creating both challenges and opportunities for industry-community collaboration. In this work, we present a novel methodology aiming to facilitate this collaboration through crow…

From Zero to The Hero: A Collaborative Market Aware Recommendation System for Crowd Workers

2021-07-06 · Hamid Shamszare, Razieh Saremi, Sanam Jena

The success of software crowdsourcing depends on active and trustworthy pool of worker supply. The uncertainty of crowd workers' behaviors makes it challenging to predict workers' success and plan accordingly. In a compe…

Decision Making

The ecosystem of machine learning competitions: Platforms, participants, and their impact on AI development

2026-04-09 · Ioannis Nasios arxiv

Machine learning competitions (MLCs) play a pivotal role in advancing artificial intelligence (AI) by fostering innovation, skill development, and practical problem-solving. This study provides a comprehensive analysis o…

Semantic coordinates analysis reveals language changes in the AI field

2020-11-01 · Zining Zhu, Yang Xu, Frank Rudzicz

Semantic shifts can reflect changes in beliefs across hundreds of years, but it is less clear whether trends in fast-changing communities across a short time can be detected. We propose semantic coordinates analysis, a m…

The Power of Stories: Narrative Priming Shapes How LLM Agents Collaborate and Compete

2025-05-06 · Gerrit Großmann, Larisa Ivanova, Sai Leela Poduru, Mohaddeseh Tabrizian 외

According to Yuval Noah Harari, large-scale human cooperation is driven by shared narratives that encode common beliefs and values. This study explores whether such narratives can similarly nudge LLM agents toward collab…