A Hybrid Feature Selection Method for Software Fault Prediction

Yiheng JIAN
Xiao YU
Zhou XU
Ziyi MA

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E102-D    No.10    pp.1966-1975
Publication Date: 2019/10/01
Publicized: 2019/07/09
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2019EDP7033
Type of Manuscript: PAPER
Category: Software Engineering
Keyword: 
fault prediction,  feature selection,  hierarchical agglomerative clustering,  

Full Text: PDF(460.9KB)>>
Buy this Article



Summary: 
Fault prediction aims to identify whether a software module is defect-prone or not according to metrics that are mined from software projects. These metric values, also known as features, may involve irrelevance and redundancy, which hurt the performance of fault prediction models. In order to filter out irrelevant and redundant features, a Hybrid Feature Selection (abbreviated as HFS) method for software fault prediction is proposed. The proposed HFS method consists of two major stages. First, HFS groups features with hierarchical agglomerative clustering; second, HFS selects the most valuable features from each cluster to remove irrelevant and redundant ones based on two wrapper based strategies. The empirical evaluation was conducted on 11 widely-studied NASA projects, using three different classifiers with four performance metrics (precision, recall, F-measure, and AUC). Comparison with six filter-based feature selection methods demonstrates that HFS achieves higher average F-measure and AUC values. Compared with two classic wrapper feature selection methods, HFS can obtain a competitive prediction performance in terms of average AUC while significantly reducing the computation cost of the wrapper process.


open access publishing via