Skip to main navigation Skip to search Skip to main content

A novel technique to prune variable selection ensembles

  • Zhengzhou University
  • Lanzhou University of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

In ensemble learning field, it has been proven that selective ensemble learning (i.e., only fusing some instead of all ensemble members) can further improve the prediction ability of an ensemble machine. In this paper, we apply it in another framework, that is, variable selection problems in linear regression models. Under this situation, the main goal is to accurately detect the variables which have real influence on the response. As for the existing algorithms to construct a variable selection ensemble, they generally combine all the members to create an importance measure for each variable. In this paper, we propose to insert an additional pruning phase into a state-of-the-art algorithm ST2E [14]. By defining a reference vector, we sort the members generated by ST2E according to the angle between each of them and the reference vector. Then, a subensemble is obtained by only keeping some members ranked ahead. We investigated the performance of the proposed method on several simulated data sets. The experimental results show that it performs better than the original full ensemble as well as several other rivals.

Original languageEnglish
Title of host publicationICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery
EditorsLiang Zhao, Lipo Wang, Guoyong Cai, Kenli Li, Yong Liu, Guoqing Xiao
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages449-454
Number of pages6
ISBN (Electronic)9781538621653
DOIs
StatePublished - 21 Jun 2018
Event13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017 - Guilin, Guangxi, China
Duration: 29 Jul 2017 → 31 Jul 2017

Publication series

NameICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery

Conference

Conference13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017
Country/TerritoryChina
CityGuilin, Guangxi
Period29/07/17 → 31/07/17

Fingerprint

Dive into the research topics of 'A novel technique to prune variable selection ensembles'. Together they form a unique fingerprint.

Cite this