paper-with-me

Papers

Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop

2024-11-07 · Ekaterina Artemova, Akim Tsvigun, Dominik Schlechtweg, Natalia Fedorova, Konstantin Chernyshev, Sergei Tilga, Boris Obmoroshev

Training and deploying machine learning models relies on a large amount of human-annotated data. As human labeling becomes increasingly expensive and time-consuming, recent research has developed multiple strategies to speed up annotation and reduce costs and human workload: generating synthetic training data, active learning, and hybrid labeling. This tutorial is oriented toward practical applications: we will present the basics of each strategy, highlight their benefits and limitations, and discuss in detail real-life case studies. Additionally, we will walk through best practices for managing human annotators and controlling the quality of the final dataset. The tutorial includes a hands-on workshop, where attendees will be guided in implementing a hybrid annotation setup. This tutorial is designed for NLP practitioners from both research and industry backgrounds who are involved in or interested in optimizing data labeling projects.

📄 PDF Abstract BibTeX arXiv:2411.04637

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Crowdsourcing Natural Language Data at Scale: A Hands-On Tutorial

2021-06-01 · NAACL 2021 4 · Alexey Drutsa, Dmitry Ustalov, Valentina Fedorova, Olga Megorskaya 외

In this tutorial, we present a portion of unique industry experience in efficient natural language data annotation via crowdsourcing shared by both leading researchers and engineers from Yandex. We will make an introduct…

Topological Methods in Machine Learning: A Tutorial for Practitioners

2024-09-04 · Baris Coskunuzer, Cüneyt Gürcan Akçora

Topological Machine Learning (TML) is an emerging field that leverages techniques from algebraic topology to analyze complex data structures in ways that traditional machine learning methods may not capture. This tutoria…

Tutorial on Deep Learning for Human Activity Recognition

2021-10-13 · Marius Bock, Alexander Hoelzemann, Michael Moeller, Kristof Van Laerhoven

Activity recognition systems that are capable of estimating human activities from wearable inertial sensors have come a long way in the past decades. Not only have state-of-the-art methods moved away from feature enginee…

Activity RecognitionDeep LearningFeature EngineeringHuman Activity Recognition

Quantum Machine Learning: A Hands-on Tutorial for Machine Learning Practitioners and Researchers

2025-02-03 · Yuxuan Du, Xinbiao Wang, Naixu Guo, Zhan Yu 외

This tutorial intends to introduce readers with a background in AI to quantum machine learning (QML) -- a rapidly evolving field that seeks to leverage the power of quantum computers to reshape the landscape of machine l…

Quantum Machine Learning

"I'm Not Confident in Debiasing AI Systems Since I Know Too Little": Teaching AI Creators About Gender Bias Through Hands-on Tutorials

2023-09-15 · Kyrie Zhixuan Zhou, Jiaxun Cao, Xiaowen Yuan, Daniel E. Weissglass 외

Gender bias is rampant in AI systems, causing bad user experience, injustices, and mental harm to women. School curricula fail to educate AI creators on this topic, leaving them unprepared to mitigate gender bias in AI. …