paper-with-me

Papers

Towards Interpretable Multi-Task Learning Using Bilevel Programming

2020-09-11 · Francesco Alesiani, Shujian Yu, Ammar Shaker, Wenzhe Yin

Interpretable Multi-Task Learning can be expressed as learning a sparse graph of the task relationship based on the prediction performance of the learned models. Since many natural phenomenon exhibit sparse structures, enforcing sparsity on learned models reveals the underlying task relationship. Moreover, different sparsification degrees from a fully connected graph uncover various types of structures, like cliques, trees, lines, clusters or fully disconnected graphs. In this paper, we propose a bilevel formulation of multi-task learning that induces sparse graphs, thus, revealing the underlying task relationships, and an efficient method for its computation. We show empirically how the induced sparse graph improves the interpretability of the learned models and their relationship on synthetic and real data, without sacrificing generalization performance. Code at https://bit.ly/GraphGuidedMTL

📄 PDF Abstract BibTeX arXiv:2009.05483

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Implicit Bilevel Optimization: Differentiating through Bilevel Optimization Programming

2023-02-28 · Francesco Alesiani

Bilevel Optimization Programming is used to model complex and conflicting interactions between agents, for example in Robust AI or Privacy-preserving AI. Integrating bilevel mathematical programming within deep learning …

Bilevel OptimizationPrivacy Preserving

BiGrad: Differentiating through Bilevel Optimization Programming

2021-11-22 · AAAI Workshop AdvML 2022 2 · Francesco Alesiani

Integrating mathematical programming, and in particular Bilevel Optimization Programming, within deep learning architectures has vast applications in various domains from machine learning to engineering. Bilevel program…

BIG-bench Machine LearningBilevel OptimizationCombinatorial Optimization

A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming

2022-11-08 · Parvin Nazari, Ahmad Mousavi, Davoud Ataee Tarzanagh, George Michailidis

Bilevel programming has recently received attention in the literature due to its wide range of applications, including reinforcement learning and hyper-parameter optimization. However, it is widely assumed that the under…

Bilevel OptimizationFederated Learning

Bilevel Programming for Hyperparameter Optimization and Meta-Learning

2018-06-13 · ICML 2018 7 · Luca Franceschi, Paolo Frasconi, Saverio Salzo, Riccardo Grazzi 외

We introduce a framework based on bilevel programming that unifies gradient-based hyperparameter optimization and meta-learning. We show that an approximate version of the bilevel problem can be solved by taking into exp…

Few-Shot LearningHyperparameter OptimizationMeta-Learning

Programmatic Reinforcement Learning without Oracles

2021-09-29 · ICLR 2022 4 · Wenjie Qiu, He Zhu

Deep reinforcement learning (RL) has led to encouraging successes in many challenging control tasks. However, a deep RL model lacks interpretability due to the difficulty of identifying how the model's control logic rela…

Bilevel OptimizationDeep Reinforcement LearningPolicy Gradient Methodsreinforcement-learning+2