Pairwise Feedback for Data Programming
The scalability of the labeling process and the attainable quality of labels have become limiting factors for many applications of machine learning. The programmatic creation of labeled datasets via the synthesis of noisy heuristics provides a promising avenue to address this problem. We propose to improve modeling of latent class variables in the programmatic creation of labeled datasets by incorporating pairwise feedback into the process. We discuss the ease with which such pairwise feedback can be obtained or generated in many application domains. Our experiments show that even a small number of sources of pairwise feedback can substantially improve the quality of the posterior estimate of the latent class variable.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Unified Linear Programming Framework for Offline Reward Learning from Human Demonstrations and Feedback
Inverse Reinforcement Learning (IRL) and Reinforcement Learning from Human Feedback (RLHF) are pivotal methodologies in reward learning, which involve inferring and shaping the underlying reward function of sequential de…
Decision Makingreinforcement-learningReinforcement LearningSequential Decision MakingUnbiased Pairwise Learning from Implicit Feedback for Recommender Systems without Biased Variance Control
Generally speaking, the model training for recommender systems can be based on two types of data, namely explicit feedback and implicit feedback. Moreover, because of its general availability, we see wide adoption of imp…
Recommendation SystemsComputing Voting Rules with Improvement Feedback
Aggregating preferences under incomplete or constrained feedback is a fundamental problem in social choice and related domains. While prior work has established strong impossibility results for pairwise comparisons, this…
PERSA: Reinforcement Learning for Professor-Style Personalized Feedback with LLMs
Large language models (LLMs) can provide automated feedback in educational settings, but aligning an LLMs style with a specific instructors tone while maintaining diagnostic correctness remains challenging. We ask how ca…
Reinforcement LearningStyle TransferOn the Opportunities of Large Language Models for Programming Process Data
Computing educators and researchers have used programming process data to understand how programs are constructed and what sorts of problems students struggle with. Although such data shows promise for using it for feedb…