Loading [a11y]/accessibility-menu.js
A novel technique to prune variable selection ensembles | IEEE Conference Publication | IEEE Xplore

A novel technique to prune variable selection ensembles


Abstract:

In ensemble learning field, it has been proven that selective ensemble learning (i.e., only fusing some instead of all ensemble members) can further improve the predictio...Show More

Abstract:

In ensemble learning field, it has been proven that selective ensemble learning (i.e., only fusing some instead of all ensemble members) can further improve the prediction ability of an ensemble machine. In this paper, we apply it in another framework, that is, variable selection problems in linear regression models. Under this situation, the main goal is to accurately detect the variables which have real influence on the response. As for the existing algorithms to construct a variable selection ensemble, they generally combine all the members to create an importance measure for each variable. In this paper, we propose to insert an additional pruning phase into a state-of-the-art algorithm ST2E [14]. By defining a reference vector, we sort the members generated by ST2E according to the angle between each of them and the reference vector. Then, a subensemble is obtained by only keeping some members ranked ahead. We investigated the performance of the proposed method on several simulated data sets. The experimental results show that it performs better than the original full ensemble as well as several other rivals.
Date of Conference: 29-31 July 2017
Date Added to IEEE Xplore: 25 June 2018
ISBN Information:
Conference Location: Guilin, China

References

References is not available for this document.