Structured Feature Selection
Feature dimensionality reduction has been widely used in various computer vision tasks. We explore feature selection as the dimensionality reduction technique and propose to use a structured approach, based on the Markov Blanket (MB), to select features. We first introduce a new MB discovery algorithm, Simultaneous Markov Blanket (STMB) discovery, that improves the efficiency of state-of-the-art algorithms. Then we theoretically justify three advantages of structured feature selection over traditional feature selection methods. Specifically, we show that the Markov Blanket is the minimum feature set that retains the maximal mutual information and also gives the lowest Bayes classification error. Then we apply structured feature selection to two applications: 1) We introduce a new method that enables STMB to scale up and show the competitive performance of our algorithms on large-scale image classification tasks. 2) We propose a method for structured feature selection to handle hierarchical features and show the proposed method can lead to big performance gain in facial expression and action unit (AU) recognition tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality Reductionfeature selectionGeneral Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Simplifying Reinforced Feature Selection via Restructured Choice Strategy of Single Agent
Feature selection aims to select a subset of features to optimize the performances of downstream predictive tasks. Recently, multi-agent reinforced feature selection (MARFS) has been introduced to automate feature select…
feature selectionFeature Selection: A Data Perspective
Feature selection, as a data preprocessing strategy, has been proven to be effective and efficient in preparing data (especially high-dimensional data) for various data mining and machine learning problems. The objective…
feature selectionSparse LearningSurveyInteractive Reinforcement Learning for Feature Selection with Decision Tree in the Loop
We study the problem of balancing effectiveness and efficiency in automated feature selection. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection is mostl…
Feature Importancefeature selectionreinforcement-learningReinforcement Learning (RL)Joint Adaptive Graph and Structured Sparsity Regularization for Unsupervised Feature Selection
Feature selection is an important data preprocessing in data mining and machine learning which can be used to reduce the feature dimension without deteriorating model's performance. Since obtaining annotated data is labo…
feature selectionChallenges of Feature Selection for Big Data Analytics
We are surrounded by huge amounts of large-scale high dimensional data. It is desirable to reduce the dimensionality of data for many learning tasks due to the curse of dimensionality. Feature selection has shown its eff…
feature selection