Learning Feature Selection Dependencies in Multi-task Learning
A probabilistic model based on the horseshoe prior is proposed for learning dependencies in the process of identifying relevant features for prediction. Exact inference is intractable in this model. However, expectation propagation offers an approximate alternative. Because the process of estimating feature selection dependencies may suffer from over-fitting in the model proposed, additional data from a multi-task learning scenario are considered for induction. The same model can be used in this setting with few modifications. Furthermore, the assumptions made are less restrictive than in other multi-task methods: The different tasks must share feature selection dependencies, but can have different relevant features and model coefficients. Experiments with real and synthetic data show that this model performs better than other multi-task alternatives from the literature. The experiments also show that the model is able to induce suitable feature selection dependencies for the problems considered, only from the training data.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionMulti-Task LearningSimilar Papers 제목 키워드 기반
Feature Selection Based on Orthogonal Constraints and Polygon Area
The goal of feature selection is to choose the optimal subset of features for a recognition task by evaluating the importance of each feature, thereby achieving effective dimensionality reduction. Currently, proposed fea…
Dimensionality Reductionfeature selectionFeature Selection: A perspective on inter-attribute cooperation
High-dimensional datasets depict a challenge for learning tasks in data mining and machine learning. Feature selection is an effective technique in dealing with dimensionality reduction. It is often an essential data pro…
AttributeDimensionality Reductionfeature selectionHigh-Order Conditional Mutual Information Maximization for dealing with High-Order Dependencies in Feature Selection
This paper presents a novel feature selection method based on the conditional mutual information (CMI). The proposed High Order Conditional Mutual Information Maximization (HOCMIM) incorporates high order dependencies in…
feature selectionVocal Bursts Intensity PredictionGram-Schmidt Methods for Unsupervised Feature Extraction and Selection
Feature extraction and selection at the presence of nonlinear dependencies among the data is a fundamental challenge in unsupervised learning. We propose using a Gram-Schmidt (GS) type orthogonalization process over func…
feature selectionReducing Spurious Correlations for Answer Selection by Feature Decorrelation and Language Debiasing
Deep neural models have become the mainstream in answer selection, yielding state-of-the-art performance. However, these models tend to rely on spurious correlations between prediction labels and input features, which in…
Answer SelectionContrastive Learning