TY - GEN
T1 - A novel technique to prune variable selection ensembles
AU - Ren, Liang Pin
AU - Zhang, Chun Xia
AU - Xuan, Hai Yan
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2018/6/21
Y1 - 2018/6/21
N2 - In ensemble learning field, it has been proven that selective ensemble learning (i.e., only fusing some instead of all ensemble members) can further improve the prediction ability of an ensemble machine. In this paper, we apply it in another framework, that is, variable selection problems in linear regression models. Under this situation, the main goal is to accurately detect the variables which have real influence on the response. As for the existing algorithms to construct a variable selection ensemble, they generally combine all the members to create an importance measure for each variable. In this paper, we propose to insert an additional pruning phase into a state-of-the-art algorithm ST2E [14]. By defining a reference vector, we sort the members generated by ST2E according to the angle between each of them and the reference vector. Then, a subensemble is obtained by only keeping some members ranked ahead. We investigated the performance of the proposed method on several simulated data sets. The experimental results show that it performs better than the original full ensemble as well as several other rivals.
AB - In ensemble learning field, it has been proven that selective ensemble learning (i.e., only fusing some instead of all ensemble members) can further improve the prediction ability of an ensemble machine. In this paper, we apply it in another framework, that is, variable selection problems in linear regression models. Under this situation, the main goal is to accurately detect the variables which have real influence on the response. As for the existing algorithms to construct a variable selection ensemble, they generally combine all the members to create an importance measure for each variable. In this paper, we propose to insert an additional pruning phase into a state-of-the-art algorithm ST2E [14]. By defining a reference vector, we sort the members generated by ST2E according to the angle between each of them and the reference vector. Then, a subensemble is obtained by only keeping some members ranked ahead. We investigated the performance of the proposed method on several simulated data sets. The experimental results show that it performs better than the original full ensemble as well as several other rivals.
UR - https://www.scopus.com/pages/publications/85050207444
U2 - 10.1109/FSKD.2017.8393311
DO - 10.1109/FSKD.2017.8393311
M3 - 会议稿件
AN - SCOPUS:85050207444
T3 - ICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery
SP - 449
EP - 454
BT - ICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery
A2 - Zhao, Liang
A2 - Wang, Lipo
A2 - Cai, Guoyong
A2 - Li, Kenli
A2 - Liu, Yong
A2 - Xiao, Guoqing
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017
Y2 - 29 July 2017 through 31 July 2017
ER -