paper-with-me

Papers

Distributionally Robust Safe Sample Elimination under Covariate Shift

2024-06-10 · Hiroyuki Hanada, Tatsuya Aoyama, Satoshi Akahane, Tomonari Tanaka, Yoshito Okura, Yu Inatsu, Noriaki Hashimoto, Shion Takeno, Taro Murayama, Hanju Lee, Shinya Kojima, Ichiro Takeuchi

We consider a machine learning setup where one training dataset is used to train multiple models across slightly different data distributions. This occurs when customized models are needed for various deployment environments. To reduce storage and training costs, we propose the DRSSS method, which combines distributionally robust (DR) optimization and safe sample screening (SSS). The key benefit of this method is that models trained on the reduced dataset will perform the same as those trained on the full dataset for all possible different environments. In this paper, we focus on covariate shift as a type of data distribution change and demonstrate the effectiveness of our method through experiments.

📄 PDF Abstract BibTeX arXiv:2406.05964

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Safe Distributionally Robust Feature Selection under Covariate Shift

2026-03-17 · Hiroyuki Hanada, Satoshi Akahane, Noriaki Hashimoto, Shion Takeno 외 arxiv

In practical machine learning, the environments encountered during the model development and deployment phases often differ, especially when a model is used by many users in diverse settings. Learning models that maintai…

Distributionally Robust Safe Screening

2024-04-25 · Hiroyuki Hanada, Satoshi Akahane, Tatsuya Aoyama, Tomonari Tanaka 외

In this study, we propose a method Distributionally Robust Safe Screening (DRSS), for identifying unnecessary samples and features within a DR covariate shift setting. This method effectively combines DR learning, a para…

Distributionally Robust Policy Evaluation under General Covariate Shift in Contextual Bandits

2024-01-21 · Yihong Guo, Hao liu, Yisong Yue, Anqi Liu

We introduce a distributionally robust approach that enhances the reliability of offline policy evaluation in contextual bandits under general covariate shifts. Our method aims to deliver robust policy evaluation results…

Multi-Armed Banditsregression

Distributionally Robust Prescriptive Analytics with Wasserstein Distance

2021-06-10 · Tianyu Wang, Ningyuan Chen, Chun Wang

In prescriptive analytics, the decision-maker observes historical samples of $(X, Y)$, where $Y$ is the uncertain problem parameter and $X$ is the concurrent covariate, without knowing the joint distribution. Given an ad…

Portfolio Optimization

Distributionally Robust Finetuning BERT for Covariate Drift in Spoken Language Understanding

2022-05-01 · ACL 2022 5 · Samuel Broscheit, Quynh Do, Judith Gaspers

In this study, we investigate robustness against covariate drift in spoken language understanding (SLU). Covariate drift can occur in SLUwhen there is a drift between training and testing regarding what users request or …

Spoken Language Understanding