Should I Stop or Should I Go: Early Stopping with Heterogeneous Populations

2023-09-21 · NeurIPS 2023 11

Randomized experiments often need to be stopped prematurely due to the treatment having an unintended harmful effect. Existing methods that determine when to stop an experiment early are typically applied to the data in aggregate and do not account for treatment effect heterogeneity. In this paper, we study the early stopping of experiments for harm on heterogeneous populations. We first establish that current methods often fail to stop experiments when the treatment harms a minority group of participants. We then use causal machine learning to develop CLASH, the first broadly-applicable method for heterogeneous early stopping. We demonstrate CLASH's performance on simulated and real data and show that it yields effective early stopping for both clinical trials and A/B tests.Submission Number: 5208

📄 PDF Abstract BibTeX

Code (1)

hammaadadam1/clash 공식 구현

Methods 이 논문이 사용한 방법론

Early Stopping Early Stopping is a regularization technique for deep neural networks that stops training when parameter updates no longer begin to yield improves on a validation set. In…

Instance-dependent Early Stopping

2025-02-11 · Suqin Yuan, Runqi Lin, Lei Feng, Bo Han 외

In machine learning practice, early stopping has been widely used to regularize models and can save computational costs by halting the training process when the model's performance on a validation set stops improving. Ho…

Transfer Learning

AutoML Benchmark with shorter time constraints and early stopping

2025-04-01 · Israel Campero Jurado, Pieter Gijsbers, Joaquin Vanschoren

Automated Machine Learning (AutoML) automatically builds machine learning (ML) models on data. The de facto standard for evaluating new AutoML frameworks for tabular data is the AutoML Benchmark (AMLB). AMLB proposed to …

AutoML

Early Stopping for Large Reasoning Models via Confidence Dynamics

2026-04-06 · Parsa Hosseini, Sumit Nawathe, Mahdi Salmani, Meisam Razaviyayn 외 arxiv

Large reasoning models rely on long chain-of-thought generation to solve complex problems, but extended reasoning often incurs substantial computational cost and can even degrade performance due to overthinking. A key ch…

Adaptive Stopping for Multi-Turn LLM Reasoning

2026-04-01 · Xiaofan Zhou, Huy Nguyen, Bo Yu, Chenxi Liu 외 arxiv

Large Language Models (LLMs) increasingly rely on multi-turn reasoning and interaction, such as adaptive retrieval-augmented generation (RAG) and ReAct-style agents, to answer difficult questions. These methods improve a…

Multi-hop Question Answering

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

2021-05-19 · Abderrahim Fathan, Erick Delage

Optimal stopping is the problem of deciding the right time at which to take a particular action in a stochastic system, in order to maximize an expected reward. It has many applications in areas such as finance, healthca…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning (RL)