paper-with-me

Papers

Instance Selection Mechanisms for Human-in-the-Loop Systems in Few-Shot Learning

2022-07-14 · Johannes Jakubik, Benedikt Blumenstiel, Michael Vössing, Patrick Hemmer

Business analytics and machine learning have become essential success factors for various industries - with the downside of cost-intensive gathering and labeling of data. Few-shot learning addresses this challenge and reduces data gathering and labeling costs by learning novel classes with very few labeled data. In this paper, we design a human-in-the-loop (HITL) system for few-shot learning and analyze an extensive range of mechanisms that can be used to acquire human expert knowledge for instances that have an uncertain prediction outcome. We show that the acquisition of human expert knowledge significantly accelerates the few-shot model performance given a negligible labeling effort. We validate our findings in various experiments on a benchmark dataset in computer vision and real-world datasets. We further demonstrate the cost-effectiveness of HITL systems for few-shot learning. Overall, our work aims at supporting researchers and practitioners in effectively adapting machine learning models to novel classes at reduced costs.

📄 PDF Abstract BibTeX arXiv:2207.06835

Code (1)

human-ai-research/hitl-few-shot-learning 공식 구현 pytorch

Tasks

BIG-bench Machine LearningFew-Shot Learning

Similar Papers 제목 키워드 기반

Resource-Constrained Heuristic for Max-SAT

2024-10-11 · Brian Matejek, Daniel Elenius, Cale Gentry, David Stoker 외

We propose a resource-constrained heuristic for instances of Max-SAT that iteratively decomposes a larger problem into smaller subcomponents that can be solved by optimized solvers and hardware. The unconstrained outer l…

Variable Selection

Human-in-the-Loop Feature Selection Using Interpretable Kolmogorov-Arnold Network-based Double Deep Q-Network

2024-11-06 · Md Abrar Jahin, M. F. Mridha, Nilanjan Dey

Feature selection is critical for improving the performance and interpretability of machine learning models, particularly in high-dimensional spaces where complex feature interactions can reduce accuracy and increase com…

feature selection

Improving the Efficiency of Human-in-the-Loop Systems: Adding Artificial to Human Experts

2023-07-06 · Johannes Jakubik, Daniel Weber, Patrick Hemmer, Michael Vössing 외

Information systems increasingly leverage artificial intelligence (AI) and machine learning (ML) to generate value from vast amounts of data. However, ML models are imperfect and can generate incorrect classifications. H…

image-classificationImage Classification

EvalLoop: A Methodology for Evaluation-Driven Iterative Improvement of Business AI Systems

2026-07-06 · Kenneth Benavides, Josh Fleischer, Danti Chen arxiv

Teams deploying large language models in business contexts need evaluation systems, yet most treat evaluation as static model selection: run benchmarks, rank models, deploy the winner. This framing misses evaluation's pr…

AI and Human Oversight: A Risk-Based Framework for Alignment

2025-10-10 · Laxmiraju Kandikatla, Branislav Radeljic arxiv

As Artificial Intelligence (AI) technologies continue to advance, protecting human autonomy and promoting ethical decision-making are essential to fostering trust and accountability. Human agency (the capacity of individ…