paper-with-me

홈 › Papers

Scalable Bayesian Preference Learning for Crowds

2019-12-04 · Edwin Simpson, Iryna Gurevych

We propose a scalable Bayesian preference learning method for jointly predicting the preferences of individuals as well as the consensus of a crowd from pairwise labels. Peoples' opinions often differ greatly, making it difficult to predict their preferences from small amounts of personal data. Individual biases also make it harder to infer the consensus of a crowd when there are few labels per item. We address these challenges by combining matrix factorisation with Gaussian processes, using a Bayesian approach to account for uncertainty arising from noisy and sparse data. Our method exploits input features, such as text embeddings and user metadata, to predict preferences for new items and users that are not in the training set. As previous solutions based on Gaussian processes do not scale to large numbers of users, items or pairwise labels, we propose a stochastic variational inference approach that limits computational and memory costs. Our experiments on a recommendation task show that our method is competitive with previous approaches despite our scalable inference approximation. We demonstrate the method's scalability on a natural language processing task with thousands of users and items, and show improvements over the state of the art on this task. We make our software publicly available for future work.

📄 PDF Abstract BibTeX arXiv:1912.01987

Code (1)

UKPLab/tacl2018-preference-convincing 공식 구현

Tasks

Gaussian ProcessesVariational Inference

Similar Papers 제목 키워드 기반

Finding Convincing Arguments Using Scalable Bayesian Preference Learning

2018-06-06 · TACL 2018 1 · Edwin Simpson, Iryna Gurevych

We introduce a scalable Bayesian preference learning method for identifying convincing arguments in the absence of gold-standard rat- ings or rankings. In contrast to previous work, we avoid the need for separate methods…

Active LearningVariational InferenceWord Embeddings

Truthful Online Preference Aggregation for LLM Fine-Tuning in Mobile Crowdsourcing

2026-05-22 · Shugang Hao, Lingjie Duan arxiv

To better serve users' demands in mobile applications (e.g., navigation), mobile crowdsourcing platforms can iteratively align large language model (LLM)-generated content (e.g., AI-generated traffic condition prediction…

Computational Design with Crowds

2020-02-20 · Yuki Koyama, Takeo Igarashi

Computational design is aimed at supporting or automating design processes using computational techniques. However, some classes of design tasks involve criteria that are difficult to handle only with computers. For exam…

Bayesian Optimization

On the Design of Strategic Task Recommendations for Sustainable Crowdsourcing-Based Content Moderation

2021-06-04 · Sainath Sanga, Venkata Sriram Siddhardh Nadendla

Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers to review user submissions (e.g. text, images and videos) and make decisions regarding the admissibility of the p…

Recommendation SystemsSpeech-to-Text

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

2023-06-09 · NeurIPS 2023 11 · Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang 외

Evaluating large language model (LLM) based chat assistants is challenging due to their broad capabilities and the inadequacy of existing benchmarks in measuring human preferences. To address this, we explore using stron…

ChatbotLanguage ModellingLarge Language ModelLong-Context Understanding