ShakyPrepend: A Multi-Group Learner with Improved Sample Complexity
Multi-group learning is a learning task that focuses on controlling predictors' conditional losses over specified subgroups. We propose ShakyPrepend, a method that leverages tools inspired by differential privacy to obtain improved theoretical guarantees over existing approaches. Through numerical experiments, we demonstrate that ShakyPrepend adapts to both group structure and spatial heterogeneity. We provide practical guidance for deploying multi-group learning algorithms in real-world settings.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The price of multi-group transductive learning
We show every multi-group learner in the transductive setting may incur a multiplicative penalty in its error rate on some group relative to the error rate achievable in the single-group setting, and the penalty can incr…
Context-lumpable stochastic bandits
We consider a contextual bandit problem with $S$ contexts and $K$ actions. In each round $t=1,2,\dots$, the learner observes a random context and chooses an action based on its past experience. The learner then observes …
Few-shot Learning with Global Relatedness Decoupled-Distillation
Despite the success that metric learning based approaches have achieved in few-shot learning, recent works reveal the ineffectiveness of their episodic training mode. In this paper, we point out two potential reasons for…
Few-Shot LearningMetric LearningCost-Aware Learning for Improved Identifiability with Multiple Experiments
We analyze the sample complexity of learning from multiple experiments where the experimenter has a total budget for obtaining samples. In this problem, the learner should choose a hypothesis that performs well with resp…
Small-Group Learning, with Application to Neural Architecture Search
In human learning, an effective learning methodology is small-group learning: a small group of students work together towards the same learning objective, where they express their understanding of a topic to their peers,…
Neural Architecture Search