paper-with-me

Papers

Intuitiveness in Active Teaching

2020-12-25 · Jan Philip Göpfert, Ulrike Kuhl, Lukas Hindemith, Heiko Wersing, Barbara Hammer

While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where the machine must learn from a small number of training samples that can be provided by a user within a reasonable time frame. Fortunately, the user can tailor the training data they create to be as useful as possible, severely limiting its necessary size -- as long as they know about the machine's requirements and limitations. Of course, acquiring this knowledge can in turn be cumbersome and costly. This raises the question of how easy machine learning algorithms are to interact with. In this work, we address this issue by analyzing the intuitiveness of certain algorithms when they are actively taught by users. After developing a theoretical framework of intuitiveness as a property of algorithms, we introduce an active teaching paradigm involving a prototypical two-dimensional spatial learning task as a method to judge the efficacy of human-machine interactions. Finally, we present and discuss the results of a large-scale user study into the performance and teaching strategies of 800 users interacting with two prominent machine learning algorithms in our system, providing first evidence for the role of intuition as an important factor impacting human-machine interaction.

📄 PDF Abstract BibTeX arXiv:2012.13551

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learning

2025-03-10 · Haozhuo Li, Yuchen Cui, Dorsa Sadigh

Imitation learning is a promising approach for learning robot policies with user-provided data. The way demonstrations are provided, i.e., demonstration modality, influences the quality of the data. While existing resear…

Imitation Learning

Towards Black-box Iterative Machine Teaching

2017-10-21 · ICML 2018 7 · Weiyang Liu, Bo Dai, Xingguo Li, Zhen Liu 외

In this paper, we make an important step towards the black-box machine teaching by considering the cross-space machine teaching, where the teacher and the learner use different feature representations and the teacher can…

Agent Smith: Teaching Question Answering to Jill Watson

2021-12-22 · Ashok Goel, Harshvardhan Sikka, Eric Gregori

Building AI agents can be costly. Consider a question answering agent such as Jill Watson that automatically answers students' questions on the discussion forums of online classes based on their syllabi and other course …

AI AgentQuestion Answering

Machine Teaching of Active Sequential Learners

2018-09-08 · NeurIPS 2019 12 · Tomi Peltola, Mustafa Mert Çelikok, Pedram Daee, Samuel Kaski

Machine teaching addresses the problem of finding the best training data that can guide a learning algorithm to a target model with minimal effort. In conventional settings, a teacher provides data that are consistent wi…

Multi-Armed BanditsProbabilistic Programming

Interactively Teaching an Inverse Reinforcement Learner with Limited Feedback

2023-09-16 · Rustam Zayanov, Francisco S. Melo, Manuel Lopes

We study the problem of teaching via demonstrations in sequential decision-making tasks. In particular, we focus on the situation when the teacher has no access to the learner's model and policy, and the feedback from th…

Active LearningDecision MakingSequential Decision Making